Oct 20 08:44:05 user nova-compute[74039]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74039) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 08:44:05 user nova-compute[74039]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74039) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 08:44:05 user nova-compute[74039]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74039) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 08:44:05 user nova-compute[74039]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 20 08:44:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:44:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.021s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:44:05 user nova-compute[74039]: INFO nova.virt.driver [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 20 08:44:05 user nova-compute[74039]: INFO nova.compute.provider_config [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] Acquiring lock "singleton_lock" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] Acquired lock "singleton_lock" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] Releasing lock "singleton_lock" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] Full set of CONF: {{(pid=74039) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ******************************************************************************** {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] Configuration options gathered from: {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ================================================================================ {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] allow_resize_to_same_host      = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] arq_binding_timeout            = 300 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] backdoor_port                  = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] backdoor_socket                = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] block_device_allocate_retries  = 300 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] block_device_allocate_retries_interval = 5 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cert                           = self.pem {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] compute_monitors               = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] config_dir                     = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] config_drive_format            = iso9660 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] config_source                  = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] console_host                   = user {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] control_exchange               = nova {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cpu_allocation_ratio           = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] daemon                         = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] debug                          = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] default_access_ip_network_name = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] default_availability_zone      = nova {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] default_ephemeral_format       = ext4 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] default_green_pool_size        = 1000 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] default_schedule_zone          = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] disk_allocation_ratio          = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] enable_new_services            = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] enabled_ssl_apis               = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] flat_injected                  = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] force_config_drive             = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] force_raw_images               = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] graceful_shutdown_timeout      = 5 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] heal_instance_info_cache_interval = 60 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] host                           = user {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] instance_build_timeout         = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] instance_delete_interval       = 300 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] instance_name_template         = instance-%08x {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] instance_usage_audit           = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] instance_usage_audit_period    = month {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] internal_service_availability_zone = internal {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] key                            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] live_migration_retry_count     = 30 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] log_config_append              = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] log_dir                        = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] log_file                       = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] log_options                    = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] log_rotate_interval            = 1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] log_rotate_interval_type       = days {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] log_rotation_type              = none {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] long_rpc_timeout               = 1800 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] max_concurrent_builds          = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] max_concurrent_live_migrations = 1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] max_concurrent_snapshots       = 5 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] max_local_block_devices        = 3 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] max_logfile_count              = 30 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] max_logfile_size_mb            = 200 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] maximum_instance_delete_attempts = 5 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] metadata_listen                = 0.0.0.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] metadata_listen_port           = 8775 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] metadata_workers               = 3 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] migrate_max_retries            = -1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] mkisofs_cmd                    = genisoimage {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] my_ip                          = 10.0.0.210 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] network_allocate_retries       = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] osapi_compute_listen_port      = 8774 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] osapi_compute_unique_server_name_scope =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] osapi_compute_workers          = 3 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] password_length                = 12 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] periodic_enable                = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] periodic_fuzzy_delay           = 60 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] pointer_model                  = ps2mouse {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] preallocate_images             = none {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] publish_errors                 = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] pybasedir                      = /opt/stack/nova {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ram_allocation_ratio           = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] rate_limit_burst               = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] rate_limit_except_level        = CRITICAL {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] rate_limit_interval            = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] reboot_timeout                 = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] reclaim_instance_interval      = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] record                         = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] reimage_timeout_per_gb         = 60 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] report_interval                = 120 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] rescue_timeout                 = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] reserved_host_cpus             = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] reserved_host_disk_mb          = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] reserved_host_memory_mb        = 512 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] reserved_huge_pages            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] resize_confirm_window          = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] resize_fs_using_block_device   = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] resume_guests_state_on_host_boot = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] rpc_response_timeout           = 60 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] run_external_periodic_tasks    = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] running_deleted_instance_action = reap {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] running_deleted_instance_timeout = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] scheduler_instance_sync_interval = 120 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] service_down_time              = 720 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] servicegroup_driver            = db {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] shelved_offload_time           = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] shelved_poll_interval          = 3600 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] shutdown_timeout               = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] source_is_ipv6                 = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ssl_only                       = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] state_path                     = /opt/stack/data/nova {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] sync_power_state_interval      = 600 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] sync_power_state_pool_size     = 1000 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] syslog_log_facility            = LOG_USER {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] tempdir                        = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] timeout_nbd                    = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] transport_url                  = **** {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] update_resources_interval      = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] use_cow_images                 = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] use_eventlog                   = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] use_journal                    = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] use_json                       = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] use_rootwrap_daemon            = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] use_stderr                     = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] use_syslog                     = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vcpu_pin_set                   = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vif_plugging_is_fatal          = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vif_plugging_timeout           = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] virt_mkfs                      = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] volume_usage_poll_interval     = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] watch_log_file                 = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] web                            = /usr/share/spice-html5 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_concurrency.disable_process_locking = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.auth_strategy              = keystone {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.compute_link_prefix        = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.dhcp_domain                = novalocal {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.enable_instance_password   = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.glance_link_prefix         = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.instance_list_per_project_cells = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.list_records_by_skipping_down_cells = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.local_metadata_per_cell    = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.max_limit                  = 1000 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.metadata_cache_expiration  = 15 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.neutron_default_tenant_id  = default {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.use_forwarded_for          = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.use_neutron_default_nets   = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.vendordata_dynamic_targets = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.vendordata_jsonfile_path   = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.backend_argument         = **** {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.config_prefix            = cache.oslo {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.dead_timeout             = 60.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.debug_cache_backend      = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.enable_retry_client      = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.enable_socket_keepalive  = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.enabled                  = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.expiration_time          = 600 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.hashclient_retry_attempts = 2 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.memcache_dead_retry      = 300 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.memcache_password        =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.memcache_sasl_enabled    = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.memcache_username        =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.proxies                  = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.retry_attempts           = 2 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.retry_delay              = 0.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.socket_keepalive_count   = 1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.socket_keepalive_idle    = 1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.socket_keepalive_interval = 1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.tls_allowed_ciphers      = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.tls_cafile               = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.tls_certfile             = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.tls_enabled              = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cache.tls_keyfile              = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cinder.auth_section            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cinder.auth_type               = password {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cinder.cafile                  = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cinder.certfile                = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cinder.collect_timing          = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cinder.cross_az_attach         = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cinder.debug                   = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cinder.endpoint_template       = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cinder.http_retries            = 3 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cinder.insecure                = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cinder.keyfile                 = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cinder.os_region_name          = RegionOne {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cinder.split_loggers           = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cinder.timeout                 = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] compute.cpu_dedicated_set      = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] compute.cpu_shared_set         = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] compute.image_type_exclude_list = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] compute.resource_provider_association_refresh = 300 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] compute.shutdown_retry_interval = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] conductor.workers              = 3 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] console.allowed_origins        = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] console.ssl_ciphers            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] console.ssl_minimum_version    = default {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] consoleauth.token_ttl          = 600 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cyborg.cafile                  = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cyborg.certfile                = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cyborg.collect_timing          = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cyborg.connect_retries         = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cyborg.connect_retry_delay     = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cyborg.endpoint_override       = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cyborg.insecure                = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cyborg.keyfile                 = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cyborg.max_version             = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cyborg.min_version             = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cyborg.region_name             = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cyborg.service_name            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cyborg.service_type            = accelerator {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cyborg.split_loggers           = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cyborg.status_code_retries     = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cyborg.status_code_retry_delay = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cyborg.timeout                 = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] cyborg.version                 = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] database.backend               = sqlalchemy {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] database.connection            = **** {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] database.connection_debug      = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] database.connection_parameters =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] database.connection_recycle_time = 3600 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] database.connection_trace      = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] database.db_inc_retry_interval = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] database.db_max_retries        = 20 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] database.db_max_retry_interval = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] database.db_retry_interval     = 1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] database.max_overflow          = 50 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] database.max_pool_size         = 5 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] database.max_retries           = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] database.mysql_wsrep_sync_wait = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] database.pool_timeout          = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] database.retry_interval        = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] database.slave_connection      = **** {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] database.sqlite_synchronous    = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api_database.backend           = sqlalchemy {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api_database.connection        = **** {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api_database.connection_debug  = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api_database.connection_parameters =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api_database.connection_recycle_time = 3600 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api_database.connection_trace  = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api_database.db_inc_retry_interval = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api_database.db_max_retries    = 20 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api_database.db_max_retry_interval = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api_database.db_retry_interval = 1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api_database.max_overflow      = 50 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api_database.max_pool_size     = 5 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api_database.max_retries       = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api_database.pool_timeout      = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api_database.retry_interval    = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api_database.slave_connection  = **** {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] api_database.sqlite_synchronous = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] devices.enabled_mdev_types     = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ephemeral_storage_encryption.enabled = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.api_servers             = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.cafile                  = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.certfile                = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.collect_timing          = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.connect_retries         = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.connect_retry_delay     = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.debug                   = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.default_trusted_certificate_ids = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.enable_certificate_validation = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.enable_rbd_download     = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.endpoint_override       = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.insecure                = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.keyfile                 = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.max_version             = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.min_version             = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.num_retries             = 3 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.rbd_ceph_conf           =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.rbd_connect_timeout     = 5 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.rbd_pool                =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.rbd_user                =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.region_name             = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.service_name            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.service_type            = image {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.split_loggers           = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.status_code_retries     = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.status_code_retry_delay = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.timeout                 = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.verify_glance_signatures = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] glance.version                 = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] guestfs.debug                  = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] hyperv.config_drive_cdrom      = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] hyperv.config_drive_inject_password = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] hyperv.enable_remotefx         = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] hyperv.instances_path_share    =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] hyperv.limit_cpu_features      = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] hyperv.use_multipath_io        = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] hyperv.vswitch_name            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] mks.enabled                    = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] image_cache.manager_interval   = 2400 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] image_cache.precache_concurrency = 1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] image_cache.remove_unused_base_images = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] image_cache.subdirectory_name  = _base {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.api_max_retries         = 60 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.api_retry_interval      = 2 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.auth_section            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.auth_type               = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.cafile                  = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.certfile                = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.collect_timing          = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.conductor_group         = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.connect_retries         = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.connect_retry_delay     = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.endpoint_override       = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.insecure                = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.keyfile                 = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.max_version             = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.min_version             = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.peer_list               = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.region_name             = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.serial_console_state_timeout = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.service_name            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.service_type            = baremetal {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.split_loggers           = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.status_code_retries     = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.status_code_retry_delay = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.timeout                 = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ironic.version                 = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] key_manager.fixed_key          = **** {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican.barbican_api_version  = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican.barbican_endpoint     = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican.barbican_endpoint_type = public {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican.barbican_region_name  = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican.cafile                = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican.certfile              = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican.collect_timing        = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican.insecure              = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican.keyfile               = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican.number_of_retries     = 60 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican.retry_delay           = 1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican.send_service_user_token = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican.split_loggers         = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican.timeout               = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican.verify_ssl            = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican.verify_ssl_path       = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican_service_user.auth_section = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican_service_user.auth_type = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican_service_user.cafile   = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican_service_user.certfile = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican_service_user.collect_timing = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican_service_user.insecure = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican_service_user.keyfile  = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican_service_user.split_loggers = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] barbican_service_user.timeout  = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vault.approle_role_id          = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vault.approle_secret_id        = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vault.cafile                   = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vault.certfile                 = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vault.collect_timing           = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vault.insecure                 = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vault.keyfile                  = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vault.kv_mountpoint            = secret {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vault.kv_path                  = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vault.kv_version               = 2 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vault.namespace                = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vault.root_token_id            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vault.split_loggers            = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vault.ssl_ca_crt_file          = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vault.timeout                  = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vault.use_ssl                  = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.auth_section          = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.auth_type             = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.cafile                = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.certfile              = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.collect_timing        = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.connect_retries       = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.connect_retry_delay   = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.endpoint_override     = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.insecure              = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.keyfile               = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.max_version           = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.min_version           = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.region_name           = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.service_name          = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.service_type          = identity {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.split_loggers         = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.status_code_retries   = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.status_code_retry_delay = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.timeout               = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] keystone.version               = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.connection_uri         =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.cpu_mode               = custom {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: WARNING oslo_config.cfg [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.cpu_power_governor_high = performance {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.cpu_power_management   = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.device_detach_attempts = 8 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.device_detach_timeout  = 20 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.disk_cachemodes        = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.disk_prefix            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.enabled_perf_events    = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.file_backed_memory     = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.gid_maps               = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.hw_disk_discard        = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.hw_machine_type        = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.images_rbd_pool        = rbd {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.images_type            = default {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.images_volume_group    = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.inject_key             = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.inject_partition       = -2 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.inject_password        = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.iscsi_iface            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.iser_use_multipath     = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.live_migration_downtime = 500 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.live_migration_inbound_addr = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.live_migration_scheme  = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.live_migration_timeout_action = abort {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.live_migration_tunnelled = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: WARNING oslo_config.cfg [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 20 08:44:06 user nova-compute[74039]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 20 08:44:06 user nova-compute[74039]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 20 08:44:06 user nova-compute[74039]: and ``live_migration_inbound_addr`` respectively.
Oct 20 08:44:06 user nova-compute[74039]: ).  Its value may be silently ignored in the future.
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.live_migration_with_native_tls = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.max_queues             = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.nfs_mount_options      = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.num_pcie_ports         = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.pmem_namespaces        = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.quobyte_client_cfg     = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.rbd_secret_uuid        = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.rbd_user               = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.rescue_image_id        = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.rescue_kernel_id       = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.rx_queue_size          = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.smbfs_mount_options    =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.snapshot_compression   = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.snapshot_image_format  = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.sparse_logical_volumes = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.swtpm_enabled          = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.swtpm_group            = tss {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.swtpm_user             = tss {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.sysinfo_serial         = unique {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.tb_cache_size          = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.tx_queue_size          = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.uid_maps               = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.use_virtio_for_bridges = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.virt_type              = kvm {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.volume_clear           = zero {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.volume_clear_size      = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.volume_use_multipath   = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.vzstorage_cache_path   = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.auth_section           = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.auth_type              = password {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.cafile                 = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.certfile               = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.collect_timing         = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.connect_retries        = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.connect_retry_delay    = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.default_floating_pool  = public {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.endpoint_override      = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.extension_sync_interval = 600 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.http_retries           = 3 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.insecure               = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.keyfile                = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.max_version            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.min_version            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.ovs_bridge             = br-int {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.physnets               = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.region_name            = RegionOne {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.service_metadata_proxy = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.service_name           = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.service_type           = network {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.split_loggers          = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.status_code_retries    = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.status_code_retry_delay = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.timeout                = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] neutron.version                = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] notifications.bdms_in_notifications = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] notifications.default_level    = INFO {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] notifications.notification_format = unversioned {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] notifications.notify_on_state_change = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] pci.alias                      = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] pci.device_spec                = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] pci.report_in_placement        = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.auth_section         = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.auth_type            = password {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.cafile               = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.certfile             = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.collect_timing       = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.connect_retries      = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.connect_retry_delay  = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.default_domain_id    = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.default_domain_name  = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.domain_id            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.domain_name          = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.endpoint_override    = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.insecure             = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.keyfile              = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.max_version          = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.min_version          = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.password             = **** {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.project_domain_id    = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.project_domain_name  = Default {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.project_id           = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.project_name         = service {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.region_name          = RegionOne {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.service_name         = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.service_type         = placement {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.split_loggers        = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.status_code_retries  = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.status_code_retry_delay = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.system_scope         = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.timeout              = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.trust_id             = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.user_domain_id       = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.user_domain_name     = Default {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.user_id              = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.username             = placement {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] placement.version              = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] quota.cores                    = 20 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] quota.count_usage_from_placement = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] quota.injected_file_content_bytes = 10240 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] quota.injected_file_path_length = 255 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] quota.injected_files           = 5 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] quota.instances                = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] quota.key_pairs                = 100 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] quota.metadata_items           = 128 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] quota.ram                      = 51200 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] quota.recheck_quota            = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] quota.server_group_members     = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] quota.server_groups            = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] rdp.enabled                    = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] scheduler.image_metadata_prefilter = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] scheduler.max_attempts         = 3 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] scheduler.max_placement_results = 1000 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] scheduler.workers              = 3 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.host_subset_size = 1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.isolated_hosts = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.isolated_images = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.pci_in_placement = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.track_instance_changes = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] metrics.required               = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] metrics.weight_multiplier      = 1.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] metrics.weight_setting         = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] serial_console.enabled         = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] serial_console.port_range      = 10000:20000 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] serial_console.serialproxy_port = 6083 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] service_user.auth_section      = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] service_user.auth_type         = password {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] service_user.cafile            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] service_user.certfile          = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] service_user.collect_timing    = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] service_user.insecure          = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] service_user.keyfile           = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] service_user.send_service_user_token = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] service_user.split_loggers     = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] service_user.timeout           = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] spice.agent_enabled            = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] spice.enabled                  = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] spice.html5proxy_port          = 6082 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] spice.image_compression        = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] spice.jpeg_compression         = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] spice.playback_compression     = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] spice.server_listen            = 127.0.0.1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] spice.streaming_mode           = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] spice.zlib_compression         = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] upgrade_levels.baseapi         = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] upgrade_levels.cert            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] upgrade_levels.compute         = auto {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] upgrade_levels.conductor       = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] upgrade_levels.scheduler       = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vendordata_dynamic_auth.cafile = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vendordata_dynamic_auth.certfile = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vendordata_dynamic_auth.insecure = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vendordata_dynamic_auth.timeout = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.api_retry_count         = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.ca_file                 = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.cache_prefix            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.cluster_name            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.connection_pool_size    = 10 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.console_delay_seconds   = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.datastore_regex         = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.host_ip                 = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.host_password           = **** {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.host_port               = 443 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.host_username           = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.insecure                = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.integration_bridge      = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.maximum_objects         = 100 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.pbm_default_policy      = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.pbm_enabled             = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.pbm_wsdl_location       = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.serial_port_proxy_uri   = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.serial_port_service_uri = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.task_poll_interval      = 0.5 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.use_linked_clone        = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.vnc_keymap              = en-us {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.vnc_port                = 5900 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vmware.vnc_port_total          = 10000 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vnc.auth_schemes               = ['none'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vnc.enabled                    = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vnc.novncproxy_port            = 6080 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vnc.vencrypt_ca_certs          = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vnc.vencrypt_client_cert       = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vnc.vencrypt_client_key        = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] workarounds.disable_rootwrap   = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] workarounds.enable_numa_live_migration = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] workarounds.libvirt_disable_apic = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] wsgi.client_socket_timeout     = 900 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] wsgi.default_pool_size         = 1000 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] wsgi.keep_alive                = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] wsgi.max_header_line           = 16384 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] wsgi.ssl_ca_file               = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] wsgi.ssl_cert_file             = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] wsgi.ssl_key_file              = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] wsgi.tcp_keepidle              = 600 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] zvm.ca_file                    = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] zvm.cloud_connector_url        = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] zvm.reachable_timeout          = 300 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_policy.enforce_new_defaults = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_policy.enforce_scope      = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_policy.policy_default_rule = default {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] profiler.connection_string     = messaging:// {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] profiler.enabled               = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] profiler.es_doc_type           = notification {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] profiler.es_scroll_size        = 10000 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] profiler.es_scroll_time        = 2m {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] profiler.filter_error_trace    = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] profiler.hmac_keys             = **** {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] profiler.sentinel_service_name = mymaster {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] profiler.socket_timeout        = 0.1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] profiler.trace_requests        = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] profiler.trace_sqlalchemy      = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] profiler_jaeger.process_tags   = {} {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] profiler_jaeger.service_name_prefix = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] profiler_otlp.service_name_prefix = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] remote_debug.host              = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] remote_debug.port              = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_notifications.retry = -1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.auth_section        = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.auth_type           = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.cafile              = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.certfile            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.collect_timing      = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.connect_retries     = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.connect_retry_delay = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.endpoint_id         = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.endpoint_override   = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.insecure            = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.keyfile             = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.max_version         = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.min_version         = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.region_name         = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.service_name        = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.service_type        = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.split_loggers       = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.status_code_retries = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.status_code_retry_delay = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.timeout             = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.valid_interfaces    = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_limit.version             = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_reports.file_event_handler = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] oslo_reports.log_dir           = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vif_plug_ovs_privileged.group  = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] vif_plug_ovs_privileged.user   = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] os_vif_ovs.isolate_vif         = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] os_brick.lock_path             = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] privsep_osbrick.capabilities   = [21] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] privsep_osbrick.group          = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] privsep_osbrick.helper_command = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] privsep_osbrick.user           = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] nova_sys_admin.group           = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] nova_sys_admin.helper_command  = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] nova_sys_admin.user            = None {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG oslo_service.service [None req-92bde297-415b-442d-97ec-10cc7d6a32a1 None None] ******************************************************************************** {{(pid=74039) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 20 08:44:06 user nova-compute[74039]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 20 08:44:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Connecting to libvirt: qemu:///system {{(pid=74039) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fae849062c0> {{(pid=74039) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 20 08:44:06 user nova-compute[74039]: libvirt:  error : internal error: could not initialize domain event timer
Oct 20 08:44:06 user nova-compute[74039]: WARNING nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 20 08:44:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fae849062c0> {{(pid=74039) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Starting native event thread {{(pid=74039) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Starting green dispatch thread {{(pid=74039) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 20 08:44:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Starting connection event dispatch thread {{(pid=74039) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 20 08:44:06 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Connection event '1' reason 'None'
Oct 20 08:44:06 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 20 08:44:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.mount [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Initialising _HostMountState generation 0 {{(pid=74039) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 20 08:44:13 user nova-compute[74039]: INFO nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Libvirt host capabilities <capabilities>
Oct 20 08:44:13 user nova-compute[74039]:   <host>
Oct 20 08:44:13 user nova-compute[74039]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 20 08:44:13 user nova-compute[74039]:     <cpu>
Oct 20 08:44:13 user nova-compute[74039]:       <arch>x86_64</arch>
Oct 20 08:44:13 user nova-compute[74039]:       <model>IvyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <vendor>Intel</vendor>
Oct 20 08:44:13 user nova-compute[74039]:       <microcode version='1070'/>
Oct 20 08:44:13 user nova-compute[74039]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 20 08:44:13 user nova-compute[74039]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature name='ss'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature name='vmx'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature name='pcid'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature name='osxsave'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature name='hypervisor'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature name='arat'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature name='tsc_adjust'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature name='md-clear'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature name='stibp'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature name='arch-capabilities'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature name='ssbd'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature name='invtsc'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature name='rsba'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature name='skip-l1dfl-vmentry'/>
Oct 20 08:44:13 user nova-compute[74039]:       <pages unit='KiB' size='4'/>
Oct 20 08:44:13 user nova-compute[74039]:       <pages unit='KiB' size='2048'/>
Oct 20 08:44:13 user nova-compute[74039]:     </cpu>
Oct 20 08:44:13 user nova-compute[74039]:     <power_management>
Oct 20 08:44:13 user nova-compute[74039]:       <suspend_mem/>
Oct 20 08:44:13 user nova-compute[74039]:       <suspend_disk/>
Oct 20 08:44:13 user nova-compute[74039]:       <suspend_hybrid/>
Oct 20 08:44:13 user nova-compute[74039]:     </power_management>
Oct 20 08:44:13 user nova-compute[74039]:     <iommu support='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     <migration_features>
Oct 20 08:44:13 user nova-compute[74039]:       <live/>
Oct 20 08:44:13 user nova-compute[74039]:       <uri_transports>
Oct 20 08:44:13 user nova-compute[74039]:         <uri_transport>tcp</uri_transport>
Oct 20 08:44:13 user nova-compute[74039]:         <uri_transport>rdma</uri_transport>
Oct 20 08:44:13 user nova-compute[74039]:       </uri_transports>
Oct 20 08:44:13 user nova-compute[74039]:     </migration_features>
Oct 20 08:44:13 user nova-compute[74039]:     <topology>
Oct 20 08:44:13 user nova-compute[74039]:       <cells num='2'>
Oct 20 08:44:13 user nova-compute[74039]:         <cell id='0'>
Oct 20 08:44:13 user nova-compute[74039]:           <memory unit='KiB'>8189224</memory>
Oct 20 08:44:13 user nova-compute[74039]:           <pages unit='KiB' size='4'>2047306</pages>
Oct 20 08:44:13 user nova-compute[74039]:           <pages unit='KiB' size='2048'>0</pages>
Oct 20 08:44:13 user nova-compute[74039]:           <distances>
Oct 20 08:44:13 user nova-compute[74039]:             <sibling id='0' value='10'/>
Oct 20 08:44:13 user nova-compute[74039]:             <sibling id='1' value='20'/>
Oct 20 08:44:13 user nova-compute[74039]:           </distances>
Oct 20 08:44:13 user nova-compute[74039]:           <cpus num='6'>
Oct 20 08:44:13 user nova-compute[74039]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 20 08:44:13 user nova-compute[74039]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 20 08:44:13 user nova-compute[74039]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 20 08:44:13 user nova-compute[74039]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 20 08:44:13 user nova-compute[74039]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 20 08:44:13 user nova-compute[74039]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 20 08:44:13 user nova-compute[74039]:           </cpus>
Oct 20 08:44:13 user nova-compute[74039]:         </cell>
Oct 20 08:44:13 user nova-compute[74039]:         <cell id='1'>
Oct 20 08:44:13 user nova-compute[74039]:           <memory unit='KiB'>8206460</memory>
Oct 20 08:44:13 user nova-compute[74039]:           <pages unit='KiB' size='4'>2051615</pages>
Oct 20 08:44:13 user nova-compute[74039]:           <pages unit='KiB' size='2048'>0</pages>
Oct 20 08:44:13 user nova-compute[74039]:           <distances>
Oct 20 08:44:13 user nova-compute[74039]:             <sibling id='0' value='20'/>
Oct 20 08:44:13 user nova-compute[74039]:             <sibling id='1' value='10'/>
Oct 20 08:44:13 user nova-compute[74039]:           </distances>
Oct 20 08:44:13 user nova-compute[74039]:           <cpus num='6'>
Oct 20 08:44:13 user nova-compute[74039]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 20 08:44:13 user nova-compute[74039]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 20 08:44:13 user nova-compute[74039]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 20 08:44:13 user nova-compute[74039]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 20 08:44:13 user nova-compute[74039]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 20 08:44:13 user nova-compute[74039]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 20 08:44:13 user nova-compute[74039]:           </cpus>
Oct 20 08:44:13 user nova-compute[74039]:         </cell>
Oct 20 08:44:13 user nova-compute[74039]:       </cells>
Oct 20 08:44:13 user nova-compute[74039]:     </topology>
Oct 20 08:44:13 user nova-compute[74039]:     <cache>
Oct 20 08:44:13 user nova-compute[74039]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 20 08:44:13 user nova-compute[74039]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 20 08:44:13 user nova-compute[74039]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 20 08:44:13 user nova-compute[74039]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 20 08:44:13 user nova-compute[74039]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 20 08:44:13 user nova-compute[74039]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 20 08:44:13 user nova-compute[74039]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 20 08:44:13 user nova-compute[74039]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 20 08:44:13 user nova-compute[74039]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 20 08:44:13 user nova-compute[74039]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 20 08:44:13 user nova-compute[74039]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 20 08:44:13 user nova-compute[74039]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 20 08:44:13 user nova-compute[74039]:     </cache>
Oct 20 08:44:13 user nova-compute[74039]:     <secmodel>
Oct 20 08:44:13 user nova-compute[74039]:       <model>apparmor</model>
Oct 20 08:44:13 user nova-compute[74039]:       <doi>0</doi>
Oct 20 08:44:13 user nova-compute[74039]:     </secmodel>
Oct 20 08:44:13 user nova-compute[74039]:     <secmodel>
Oct 20 08:44:13 user nova-compute[74039]:       <model>dac</model>
Oct 20 08:44:13 user nova-compute[74039]:       <doi>0</doi>
Oct 20 08:44:13 user nova-compute[74039]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 20 08:44:13 user nova-compute[74039]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 20 08:44:13 user nova-compute[74039]:     </secmodel>
Oct 20 08:44:13 user nova-compute[74039]:   </host>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='alpha'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>64</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>clipper</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='armv6l'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>32</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>spitz</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>nuri</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>kzm</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>sx1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>z2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>tosa</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>n810</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>n800</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>terrier</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>midway</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>microbit</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>verdex</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>highbank</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>akita</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>connex</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>collie</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='armv7l'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>32</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>spitz</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>nuri</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>kzm</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>sx1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>z2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>tosa</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>n810</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>n800</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>terrier</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>midway</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>microbit</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>verdex</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>highbank</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>akita</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>connex</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>collie</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='aarch64'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>64</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>spitz</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>nuri</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>kzm</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>sx1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>z2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>tosa</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>n810</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>n800</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>terrier</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>midway</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>microbit</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>verdex</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>raspi3b</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>highbank</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>akita</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>connex</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>collie</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <acpi default='on' toggle='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='cris'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>32</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='i686'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>32</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>x-remote</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>isapc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>microvm</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='kvm'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <pae/>
Oct 20 08:44:13 user nova-compute[74039]:       <nonpae/>
Oct 20 08:44:13 user nova-compute[74039]:       <acpi default='on' toggle='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:       <apic default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='m68k'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>32</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>an5206</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>q800</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>next-cube</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='microblaze'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>32</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='microblazeel'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>32</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='mips'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>32</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='16'>malta</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='mipsel'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>32</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='16'>malta</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='mips64'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>64</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='16'>malta</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>pica61</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>magnum</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='mips64el'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>64</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='16'>malta</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>pica61</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>magnum</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='16'>boston</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='ppc'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>32</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mac99</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>40p</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>taihu</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='ppc64'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>64</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2048'>powernv9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>taihu</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2048'>powernv10</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>40p</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mac99</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2048'>powernv8</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='ppc64le'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>64</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2048'>powernv9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>taihu</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2048'>powernv10</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>40p</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>mac99</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2048'>powernv8</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='riscv32'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>32</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='8'>spike</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>opentitan</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='5'>sifive_u</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>sifive_e</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='8'>virt</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='riscv64'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>64</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='8'>spike</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='5'>sifive_u</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>shakti_c</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>sifive_e</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='8'>virt</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='s390x'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>64</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='sh4'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>32</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>shix</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>r2d</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='sh4eb'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>64</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>shix</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>r2d</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='sparc'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>32</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>SS-5</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>SS-20</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>LX</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>SS-4</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>SS-10</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>Voyager</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='sparc64'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>64</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>sun4u</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>niagara</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>sun4v</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='x86_64'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>64</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>x-remote</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='1'>isapc</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>microvm</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='kvm'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <acpi default='on' toggle='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:       <apic default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='xtensa'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>32</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>sim</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>kc705</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>ml605</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>virt</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>lx200</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>lx60</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]:   <guest>
Oct 20 08:44:13 user nova-compute[74039]:     <os_type>hvm</os_type>
Oct 20 08:44:13 user nova-compute[74039]:     <arch name='xtensaeb'>
Oct 20 08:44:13 user nova-compute[74039]:       <wordsize>32</wordsize>
Oct 20 08:44:13 user nova-compute[74039]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='4'>sim</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>kc705</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>ml605</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>virt</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>lx200</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>lx60</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 20 08:44:13 user nova-compute[74039]:       <domain type='qemu'/>
Oct 20 08:44:13 user nova-compute[74039]:     </arch>
Oct 20 08:44:13 user nova-compute[74039]:     <features>
Oct 20 08:44:13 user nova-compute[74039]:       <cpuselection/>
Oct 20 08:44:13 user nova-compute[74039]:       <deviceboot/>
Oct 20 08:44:13 user nova-compute[74039]:       <disksnapshot default='on' toggle='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     </features>
Oct 20 08:44:13 user nova-compute[74039]:   </guest>
Oct 20 08:44:13 user nova-compute[74039]: </capabilities>
Oct 20 08:44:13 user nova-compute[74039]: 
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 20 08:44:13 user nova-compute[74039]: <domainCapabilities>
Oct 20 08:44:13 user nova-compute[74039]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 08:44:13 user nova-compute[74039]:   <domain>kvm</domain>
Oct 20 08:44:13 user nova-compute[74039]:   <machine>pc-q35-6.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:   <arch>i686</arch>
Oct 20 08:44:13 user nova-compute[74039]:   <vcpu max='288'/>
Oct 20 08:44:13 user nova-compute[74039]:   <iothreads supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:   <os supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:     <enum name='firmware'/>
Oct 20 08:44:13 user nova-compute[74039]:     <loader supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='type'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>rom</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>pflash</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='readonly'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>yes</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>no</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='secure'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>no</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </loader>
Oct 20 08:44:13 user nova-compute[74039]:   </os>
Oct 20 08:44:13 user nova-compute[74039]:   <cpu>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='host-passthrough' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='hostPassthroughMigratable'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>off</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='maximum' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='maximumMigratable'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>on</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>off</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='host-model' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <vendor>Intel</vendor>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ss'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='vmx'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='pcid'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='hypervisor'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='arat'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='umip'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='md-clear'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='stibp'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ssbd'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ibpb'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ibrs'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='amd-stibp'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='disable' name='erms'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='disable' name='lm'/>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='custom' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>qemu64</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>qemu32</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>phenom</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium3</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium2</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>n270</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>kvm64</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>kvm32</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>coreduo</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>core2duo</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>athlon</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Westmere</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Snowridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>SandyBridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Penryn</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G5</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G4</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G3</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G2</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G1</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Nehalem</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>IvyBridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Icelake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-Rome</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-Milan</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Dhyana</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cooperlake</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Conroe</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>486</model>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:   </cpu>
Oct 20 08:44:13 user nova-compute[74039]:   <memoryBacking supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:     <enum name='sourceType'>
Oct 20 08:44:13 user nova-compute[74039]:       <value>file</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>anonymous</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>memfd</value>
Oct 20 08:44:13 user nova-compute[74039]:     </enum>
Oct 20 08:44:13 user nova-compute[74039]:   </memoryBacking>
Oct 20 08:44:13 user nova-compute[74039]:   <devices>
Oct 20 08:44:13 user nova-compute[74039]:     <disk supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='diskDevice'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>disk</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>cdrom</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>floppy</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>lun</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='bus'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>fdc</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>scsi</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>usb</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>sata</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-non-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </disk>
Oct 20 08:44:13 user nova-compute[74039]:     <graphics supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='type'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>sdl</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vnc</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>spice</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>egl-headless</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </graphics>
Oct 20 08:44:13 user nova-compute[74039]:     <video supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='modelType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vga</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>cirrus</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vmvga</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>qxl</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>none</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>bochs</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>ramfb</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </video>
Oct 20 08:44:13 user nova-compute[74039]:     <hostdev supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='mode'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>subsystem</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='startupPolicy'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>default</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>mandatory</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>requisite</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>optional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='subsysType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>usb</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>pci</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>scsi</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='capsType'/>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='pciBackend'/>
Oct 20 08:44:13 user nova-compute[74039]:     </hostdev>
Oct 20 08:44:13 user nova-compute[74039]:     <rng supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-non-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='backendModel'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>random</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>egd</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>builtin</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </rng>
Oct 20 08:44:13 user nova-compute[74039]:     <filesystem supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='driverType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>path</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>handle</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtiofs</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </filesystem>
Oct 20 08:44:13 user nova-compute[74039]:     <tpm supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>tpm-tis</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>tpm-crb</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='backendModel'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>passthrough</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>emulator</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </tpm>
Oct 20 08:44:13 user nova-compute[74039]:   </devices>
Oct 20 08:44:13 user nova-compute[74039]:   <features>
Oct 20 08:44:13 user nova-compute[74039]:     <gic supported='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     <vmcoreinfo supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <genid supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <backingStoreInput supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <backup supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <sev supported='no'/>
Oct 20 08:44:13 user nova-compute[74039]:   </features>
Oct 20 08:44:13 user nova-compute[74039]: </domainCapabilities>
Oct 20 08:44:13 user nova-compute[74039]:  {{(pid=74039) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 20 08:44:13 user nova-compute[74039]: <domainCapabilities>
Oct 20 08:44:13 user nova-compute[74039]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 08:44:13 user nova-compute[74039]:   <domain>kvm</domain>
Oct 20 08:44:13 user nova-compute[74039]:   <machine>pc-i440fx-jammy</machine>
Oct 20 08:44:13 user nova-compute[74039]:   <arch>i686</arch>
Oct 20 08:44:13 user nova-compute[74039]:   <vcpu max='255'/>
Oct 20 08:44:13 user nova-compute[74039]:   <iothreads supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:   <os supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:     <enum name='firmware'/>
Oct 20 08:44:13 user nova-compute[74039]:     <loader supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='type'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>rom</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>pflash</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='readonly'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>yes</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>no</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='secure'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>no</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </loader>
Oct 20 08:44:13 user nova-compute[74039]:   </os>
Oct 20 08:44:13 user nova-compute[74039]:   <cpu>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='host-passthrough' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='hostPassthroughMigratable'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>off</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='maximum' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='maximumMigratable'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>on</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>off</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='host-model' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <vendor>Intel</vendor>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ss'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='vmx'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='pcid'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='hypervisor'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='arat'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='umip'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='md-clear'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='stibp'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ssbd'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ibpb'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ibrs'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='amd-stibp'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='disable' name='erms'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='disable' name='lm'/>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='custom' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>qemu64</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>qemu32</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>phenom</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium3</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium2</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>n270</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>kvm64</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>kvm32</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>coreduo</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>core2duo</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>athlon</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Westmere</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Snowridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>SandyBridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Penryn</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G5</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G4</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G3</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G2</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G1</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Nehalem</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>IvyBridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Icelake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-Rome</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-Milan</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Dhyana</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cooperlake</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Conroe</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>486</model>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:   </cpu>
Oct 20 08:44:13 user nova-compute[74039]:   <memoryBacking supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:     <enum name='sourceType'>
Oct 20 08:44:13 user nova-compute[74039]:       <value>file</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>anonymous</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>memfd</value>
Oct 20 08:44:13 user nova-compute[74039]:     </enum>
Oct 20 08:44:13 user nova-compute[74039]:   </memoryBacking>
Oct 20 08:44:13 user nova-compute[74039]:   <devices>
Oct 20 08:44:13 user nova-compute[74039]:     <disk supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='diskDevice'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>disk</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>cdrom</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>floppy</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>lun</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='bus'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>ide</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>fdc</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>scsi</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>usb</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>sata</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-non-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </disk>
Oct 20 08:44:13 user nova-compute[74039]:     <graphics supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='type'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>sdl</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vnc</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>spice</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>egl-headless</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </graphics>
Oct 20 08:44:13 user nova-compute[74039]:     <video supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='modelType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vga</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>cirrus</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vmvga</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>qxl</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>none</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>bochs</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>ramfb</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </video>
Oct 20 08:44:13 user nova-compute[74039]:     <hostdev supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='mode'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>subsystem</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='startupPolicy'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>default</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>mandatory</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>requisite</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>optional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='subsysType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>usb</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>pci</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>scsi</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='capsType'/>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='pciBackend'/>
Oct 20 08:44:13 user nova-compute[74039]:     </hostdev>
Oct 20 08:44:13 user nova-compute[74039]:     <rng supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-non-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='backendModel'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>random</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>egd</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>builtin</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </rng>
Oct 20 08:44:13 user nova-compute[74039]:     <filesystem supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='driverType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>path</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>handle</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtiofs</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </filesystem>
Oct 20 08:44:13 user nova-compute[74039]:     <tpm supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>tpm-tis</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>tpm-crb</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='backendModel'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>passthrough</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>emulator</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </tpm>
Oct 20 08:44:13 user nova-compute[74039]:   </devices>
Oct 20 08:44:13 user nova-compute[74039]:   <features>
Oct 20 08:44:13 user nova-compute[74039]:     <gic supported='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     <vmcoreinfo supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <genid supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <backingStoreInput supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <backup supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <sev supported='no'/>
Oct 20 08:44:13 user nova-compute[74039]:   </features>
Oct 20 08:44:13 user nova-compute[74039]: </domainCapabilities>
Oct 20 08:44:13 user nova-compute[74039]:  {{(pid=74039) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 20 08:44:13 user nova-compute[74039]: <domainCapabilities>
Oct 20 08:44:13 user nova-compute[74039]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 08:44:13 user nova-compute[74039]:   <domain>kvm</domain>
Oct 20 08:44:13 user nova-compute[74039]:   <machine>pc-i440fx-6.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:   <arch>i686</arch>
Oct 20 08:44:13 user nova-compute[74039]:   <vcpu max='255'/>
Oct 20 08:44:13 user nova-compute[74039]:   <iothreads supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:   <os supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:     <enum name='firmware'/>
Oct 20 08:44:13 user nova-compute[74039]:     <loader supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='type'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>rom</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>pflash</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='readonly'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>yes</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>no</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='secure'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>no</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </loader>
Oct 20 08:44:13 user nova-compute[74039]:   </os>
Oct 20 08:44:13 user nova-compute[74039]:   <cpu>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='host-passthrough' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='hostPassthroughMigratable'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>off</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='maximum' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='maximumMigratable'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>on</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>off</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='host-model' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <vendor>Intel</vendor>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ss'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='vmx'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='pcid'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='hypervisor'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='arat'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='umip'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='md-clear'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='stibp'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ssbd'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ibpb'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ibrs'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='amd-stibp'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='disable' name='erms'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='disable' name='lm'/>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='custom' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>qemu64</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>qemu32</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>phenom</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium3</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium2</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>n270</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>kvm64</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>kvm32</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>coreduo</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>core2duo</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>athlon</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Westmere</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Snowridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>SandyBridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Penryn</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G5</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G4</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G3</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G2</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G1</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Nehalem</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>IvyBridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Icelake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-Rome</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-Milan</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Dhyana</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cooperlake</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Conroe</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>486</model>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:   </cpu>
Oct 20 08:44:13 user nova-compute[74039]:   <memoryBacking supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:     <enum name='sourceType'>
Oct 20 08:44:13 user nova-compute[74039]:       <value>file</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>anonymous</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>memfd</value>
Oct 20 08:44:13 user nova-compute[74039]:     </enum>
Oct 20 08:44:13 user nova-compute[74039]:   </memoryBacking>
Oct 20 08:44:13 user nova-compute[74039]:   <devices>
Oct 20 08:44:13 user nova-compute[74039]:     <disk supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='diskDevice'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>disk</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>cdrom</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>floppy</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>lun</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='bus'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>ide</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>fdc</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>scsi</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>usb</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>sata</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-non-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </disk>
Oct 20 08:44:13 user nova-compute[74039]:     <graphics supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='type'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>sdl</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vnc</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>spice</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>egl-headless</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </graphics>
Oct 20 08:44:13 user nova-compute[74039]:     <video supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='modelType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vga</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>cirrus</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vmvga</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>qxl</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>none</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>bochs</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>ramfb</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </video>
Oct 20 08:44:13 user nova-compute[74039]:     <hostdev supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='mode'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>subsystem</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='startupPolicy'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>default</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>mandatory</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>requisite</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>optional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='subsysType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>usb</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>pci</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>scsi</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='capsType'/>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='pciBackend'/>
Oct 20 08:44:13 user nova-compute[74039]:     </hostdev>
Oct 20 08:44:13 user nova-compute[74039]:     <rng supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-non-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='backendModel'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>random</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>egd</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>builtin</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </rng>
Oct 20 08:44:13 user nova-compute[74039]:     <filesystem supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='driverType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>path</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>handle</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtiofs</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </filesystem>
Oct 20 08:44:13 user nova-compute[74039]:     <tpm supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>tpm-tis</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>tpm-crb</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='backendModel'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>passthrough</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>emulator</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </tpm>
Oct 20 08:44:13 user nova-compute[74039]:   </devices>
Oct 20 08:44:13 user nova-compute[74039]:   <features>
Oct 20 08:44:13 user nova-compute[74039]:     <gic supported='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     <vmcoreinfo supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <genid supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <backingStoreInput supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <backup supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <sev supported='no'/>
Oct 20 08:44:13 user nova-compute[74039]:   </features>
Oct 20 08:44:13 user nova-compute[74039]: </domainCapabilities>
Oct 20 08:44:13 user nova-compute[74039]:  {{(pid=74039) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 20 08:44:13 user nova-compute[74039]: <domainCapabilities>
Oct 20 08:44:13 user nova-compute[74039]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 08:44:13 user nova-compute[74039]:   <domain>kvm</domain>
Oct 20 08:44:13 user nova-compute[74039]:   <machine>pc-q35-jammy</machine>
Oct 20 08:44:13 user nova-compute[74039]:   <arch>i686</arch>
Oct 20 08:44:13 user nova-compute[74039]:   <vcpu max='288'/>
Oct 20 08:44:13 user nova-compute[74039]:   <iothreads supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:   <os supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:     <enum name='firmware'/>
Oct 20 08:44:13 user nova-compute[74039]:     <loader supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='type'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>rom</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>pflash</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='readonly'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>yes</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>no</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='secure'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>no</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </loader>
Oct 20 08:44:13 user nova-compute[74039]:   </os>
Oct 20 08:44:13 user nova-compute[74039]:   <cpu>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='host-passthrough' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='hostPassthroughMigratable'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>off</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='maximum' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='maximumMigratable'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>on</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>off</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='host-model' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <vendor>Intel</vendor>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ss'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='vmx'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='pcid'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='hypervisor'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='arat'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='umip'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='md-clear'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='stibp'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ssbd'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ibpb'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ibrs'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='amd-stibp'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='disable' name='erms'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='disable' name='lm'/>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='custom' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>qemu64</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>qemu32</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>phenom</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium3</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium2</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>n270</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>kvm64</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>kvm32</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>coreduo</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>core2duo</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>athlon</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Westmere</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Snowridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>SandyBridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Penryn</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G5</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G4</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G3</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G2</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G1</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Nehalem</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>IvyBridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Icelake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-Rome</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-Milan</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Dhyana</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cooperlake</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Conroe</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>486</model>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:   </cpu>
Oct 20 08:44:13 user nova-compute[74039]:   <memoryBacking supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:     <enum name='sourceType'>
Oct 20 08:44:13 user nova-compute[74039]:       <value>file</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>anonymous</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>memfd</value>
Oct 20 08:44:13 user nova-compute[74039]:     </enum>
Oct 20 08:44:13 user nova-compute[74039]:   </memoryBacking>
Oct 20 08:44:13 user nova-compute[74039]:   <devices>
Oct 20 08:44:13 user nova-compute[74039]:     <disk supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='diskDevice'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>disk</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>cdrom</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>floppy</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>lun</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='bus'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>fdc</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>scsi</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>usb</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>sata</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-non-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </disk>
Oct 20 08:44:13 user nova-compute[74039]:     <graphics supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='type'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>sdl</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vnc</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>spice</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>egl-headless</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </graphics>
Oct 20 08:44:13 user nova-compute[74039]:     <video supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='modelType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vga</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>cirrus</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vmvga</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>qxl</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>none</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>bochs</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>ramfb</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </video>
Oct 20 08:44:13 user nova-compute[74039]:     <hostdev supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='mode'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>subsystem</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='startupPolicy'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>default</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>mandatory</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>requisite</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>optional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='subsysType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>usb</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>pci</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>scsi</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='capsType'/>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='pciBackend'/>
Oct 20 08:44:13 user nova-compute[74039]:     </hostdev>
Oct 20 08:44:13 user nova-compute[74039]:     <rng supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-non-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='backendModel'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>random</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>egd</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>builtin</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </rng>
Oct 20 08:44:13 user nova-compute[74039]:     <filesystem supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='driverType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>path</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>handle</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtiofs</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </filesystem>
Oct 20 08:44:13 user nova-compute[74039]:     <tpm supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>tpm-tis</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>tpm-crb</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='backendModel'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>passthrough</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>emulator</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </tpm>
Oct 20 08:44:13 user nova-compute[74039]:   </devices>
Oct 20 08:44:13 user nova-compute[74039]:   <features>
Oct 20 08:44:13 user nova-compute[74039]:     <gic supported='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     <vmcoreinfo supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <genid supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <backingStoreInput supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <backup supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <sev supported='no'/>
Oct 20 08:44:13 user nova-compute[74039]:   </features>
Oct 20 08:44:13 user nova-compute[74039]: </domainCapabilities>
Oct 20 08:44:13 user nova-compute[74039]:  {{(pid=74039) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 20 08:44:13 user nova-compute[74039]: <domainCapabilities>
Oct 20 08:44:13 user nova-compute[74039]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 08:44:13 user nova-compute[74039]:   <domain>kvm</domain>
Oct 20 08:44:13 user nova-compute[74039]:   <machine>pc-q35-6.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:   <arch>x86_64</arch>
Oct 20 08:44:13 user nova-compute[74039]:   <vcpu max='288'/>
Oct 20 08:44:13 user nova-compute[74039]:   <iothreads supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:   <os supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:     <enum name='firmware'>
Oct 20 08:44:13 user nova-compute[74039]:       <value>efi</value>
Oct 20 08:44:13 user nova-compute[74039]:     </enum>
Oct 20 08:44:13 user nova-compute[74039]:     <loader supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='type'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>rom</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>pflash</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='readonly'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>yes</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>no</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='secure'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>yes</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>no</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </loader>
Oct 20 08:44:13 user nova-compute[74039]:   </os>
Oct 20 08:44:13 user nova-compute[74039]:   <cpu>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='host-passthrough' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='hostPassthroughMigratable'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>on</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>off</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='maximum' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='maximumMigratable'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>on</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>off</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='host-model' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <vendor>Intel</vendor>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ss'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='vmx'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='pcid'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='hypervisor'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='arat'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='umip'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='md-clear'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='stibp'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ssbd'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='invtsc'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ibpb'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ibrs'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='amd-stibp'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='rsba'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='disable' name='erms'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='custom' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>qemu64</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>qemu32</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>phenom</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium3</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium2</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>n270</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>kvm64</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>kvm32</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>coreduo</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>core2duo</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>athlon</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Westmere</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Snowridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>SandyBridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Penryn</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G5</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G4</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G3</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G2</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Opteron_G1</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Nehalem</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>IvyBridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Icelake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-Rome</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-Milan</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Dhyana</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cooperlake</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Conroe</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>486</model>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:   </cpu>
Oct 20 08:44:13 user nova-compute[74039]:   <memoryBacking supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:     <enum name='sourceType'>
Oct 20 08:44:13 user nova-compute[74039]:       <value>file</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>anonymous</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>memfd</value>
Oct 20 08:44:13 user nova-compute[74039]:     </enum>
Oct 20 08:44:13 user nova-compute[74039]:   </memoryBacking>
Oct 20 08:44:13 user nova-compute[74039]:   <devices>
Oct 20 08:44:13 user nova-compute[74039]:     <disk supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='diskDevice'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>disk</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>cdrom</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>floppy</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>lun</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='bus'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>fdc</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>scsi</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>usb</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>sata</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-non-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </disk>
Oct 20 08:44:13 user nova-compute[74039]:     <graphics supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='type'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>sdl</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vnc</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>spice</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>egl-headless</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </graphics>
Oct 20 08:44:13 user nova-compute[74039]:     <video supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='modelType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vga</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>cirrus</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vmvga</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>qxl</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>none</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>bochs</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>ramfb</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </video>
Oct 20 08:44:13 user nova-compute[74039]:     <hostdev supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='mode'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>subsystem</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='startupPolicy'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>default</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>mandatory</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>requisite</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>optional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='subsysType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>usb</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>pci</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>scsi</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='capsType'/>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='pciBackend'/>
Oct 20 08:44:13 user nova-compute[74039]:     </hostdev>
Oct 20 08:44:13 user nova-compute[74039]:     <rng supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-non-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='backendModel'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>random</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>egd</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>builtin</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </rng>
Oct 20 08:44:13 user nova-compute[74039]:     <filesystem supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='driverType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>path</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>handle</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtiofs</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </filesystem>
Oct 20 08:44:13 user nova-compute[74039]:     <tpm supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>tpm-tis</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>tpm-crb</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='backendModel'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>passthrough</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>emulator</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </tpm>
Oct 20 08:44:13 user nova-compute[74039]:   </devices>
Oct 20 08:44:13 user nova-compute[74039]:   <features>
Oct 20 08:44:13 user nova-compute[74039]:     <gic supported='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     <vmcoreinfo supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <genid supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <backingStoreInput supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <backup supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <sev supported='no'/>
Oct 20 08:44:13 user nova-compute[74039]:   </features>
Oct 20 08:44:13 user nova-compute[74039]: </domainCapabilities>
Oct 20 08:44:13 user nova-compute[74039]:  {{(pid=74039) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 20 08:44:13 user nova-compute[74039]: <domainCapabilities>
Oct 20 08:44:13 user nova-compute[74039]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 08:44:13 user nova-compute[74039]:   <domain>kvm</domain>
Oct 20 08:44:13 user nova-compute[74039]:   <machine>pc-i440fx-jammy</machine>
Oct 20 08:44:13 user nova-compute[74039]:   <arch>x86_64</arch>
Oct 20 08:44:13 user nova-compute[74039]:   <vcpu max='255'/>
Oct 20 08:44:13 user nova-compute[74039]:   <iothreads supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:   <os supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:     <enum name='firmware'>
Oct 20 08:44:13 user nova-compute[74039]:       <value>efi</value>
Oct 20 08:44:13 user nova-compute[74039]:     </enum>
Oct 20 08:44:13 user nova-compute[74039]:     <loader supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='type'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>rom</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>pflash</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='readonly'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>yes</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>no</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='secure'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>no</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </loader>
Oct 20 08:44:13 user nova-compute[74039]:   </os>
Oct 20 08:44:13 user nova-compute[74039]:   <cpu>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='host-passthrough' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='hostPassthroughMigratable'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>on</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>off</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='maximum' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='maximumMigratable'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>on</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>off</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='host-model' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <vendor>Intel</vendor>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ss'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='vmx'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='pcid'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='hypervisor'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='arat'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='umip'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='md-clear'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='stibp'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ssbd'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='invtsc'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ibpb'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ibrs'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='amd-stibp'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='rsba'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='disable' name='erms'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='custom' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>qemu64</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>qemu32</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>phenom</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium3</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium2</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>n270</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>kvm64</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>kvm32</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>coreduo</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>core2duo</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>athlon</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Westmere</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Snowridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>SandyBridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Penryn</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G5</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G4</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G3</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G2</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Opteron_G1</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Nehalem</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>IvyBridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Icelake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-Rome</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-Milan</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Dhyana</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cooperlake</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Conroe</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>486</model>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:   </cpu>
Oct 20 08:44:13 user nova-compute[74039]:   <memoryBacking supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:     <enum name='sourceType'>
Oct 20 08:44:13 user nova-compute[74039]:       <value>file</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>anonymous</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>memfd</value>
Oct 20 08:44:13 user nova-compute[74039]:     </enum>
Oct 20 08:44:13 user nova-compute[74039]:   </memoryBacking>
Oct 20 08:44:13 user nova-compute[74039]:   <devices>
Oct 20 08:44:13 user nova-compute[74039]:     <disk supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='diskDevice'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>disk</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>cdrom</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>floppy</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>lun</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='bus'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>ide</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>fdc</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>scsi</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>usb</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>sata</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-non-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </disk>
Oct 20 08:44:13 user nova-compute[74039]:     <graphics supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='type'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>sdl</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vnc</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>spice</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>egl-headless</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </graphics>
Oct 20 08:44:13 user nova-compute[74039]:     <video supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='modelType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vga</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>cirrus</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vmvga</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>qxl</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>none</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>bochs</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>ramfb</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </video>
Oct 20 08:44:13 user nova-compute[74039]:     <hostdev supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='mode'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>subsystem</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='startupPolicy'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>default</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>mandatory</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>requisite</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>optional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='subsysType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>usb</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>pci</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>scsi</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='capsType'/>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='pciBackend'/>
Oct 20 08:44:13 user nova-compute[74039]:     </hostdev>
Oct 20 08:44:13 user nova-compute[74039]:     <rng supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-non-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='backendModel'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>random</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>egd</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>builtin</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </rng>
Oct 20 08:44:13 user nova-compute[74039]:     <filesystem supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='driverType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>path</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>handle</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtiofs</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </filesystem>
Oct 20 08:44:13 user nova-compute[74039]:     <tpm supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>tpm-tis</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>tpm-crb</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='backendModel'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>passthrough</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>emulator</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </tpm>
Oct 20 08:44:13 user nova-compute[74039]:   </devices>
Oct 20 08:44:13 user nova-compute[74039]:   <features>
Oct 20 08:44:13 user nova-compute[74039]:     <gic supported='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     <vmcoreinfo supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <genid supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <backingStoreInput supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <backup supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <sev supported='no'/>
Oct 20 08:44:13 user nova-compute[74039]:   </features>
Oct 20 08:44:13 user nova-compute[74039]: </domainCapabilities>
Oct 20 08:44:13 user nova-compute[74039]:  {{(pid=74039) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 20 08:44:13 user nova-compute[74039]: <domainCapabilities>
Oct 20 08:44:13 user nova-compute[74039]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 08:44:13 user nova-compute[74039]:   <domain>kvm</domain>
Oct 20 08:44:13 user nova-compute[74039]:   <machine>pc-i440fx-6.2</machine>
Oct 20 08:44:13 user nova-compute[74039]:   <arch>x86_64</arch>
Oct 20 08:44:13 user nova-compute[74039]:   <vcpu max='255'/>
Oct 20 08:44:13 user nova-compute[74039]:   <iothreads supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:   <os supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:     <enum name='firmware'>
Oct 20 08:44:13 user nova-compute[74039]:       <value>efi</value>
Oct 20 08:44:13 user nova-compute[74039]:     </enum>
Oct 20 08:44:13 user nova-compute[74039]:     <loader supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='type'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>rom</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>pflash</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='readonly'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>yes</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>no</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='secure'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>no</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </loader>
Oct 20 08:44:13 user nova-compute[74039]:   </os>
Oct 20 08:44:13 user nova-compute[74039]:   <cpu>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='host-passthrough' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='hostPassthroughMigratable'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>on</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>off</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='maximum' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='maximumMigratable'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>on</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>off</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='host-model' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <vendor>Intel</vendor>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ss'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='vmx'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='pcid'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='hypervisor'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='arat'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='umip'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='md-clear'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='stibp'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ssbd'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='invtsc'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ibpb'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ibrs'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='amd-stibp'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='rsba'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='disable' name='erms'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='custom' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>qemu64</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>qemu32</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>phenom</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium3</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium2</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>n270</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>kvm64</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>kvm32</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>coreduo</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>core2duo</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>athlon</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Westmere</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Snowridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>SandyBridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Penryn</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G5</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G4</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G3</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G2</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Opteron_G1</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Nehalem</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>IvyBridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Icelake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-Rome</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-Milan</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Dhyana</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cooperlake</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Conroe</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>486</model>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:   </cpu>
Oct 20 08:44:13 user nova-compute[74039]:   <memoryBacking supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:     <enum name='sourceType'>
Oct 20 08:44:13 user nova-compute[74039]:       <value>file</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>anonymous</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>memfd</value>
Oct 20 08:44:13 user nova-compute[74039]:     </enum>
Oct 20 08:44:13 user nova-compute[74039]:   </memoryBacking>
Oct 20 08:44:13 user nova-compute[74039]:   <devices>
Oct 20 08:44:13 user nova-compute[74039]:     <disk supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='diskDevice'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>disk</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>cdrom</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>floppy</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>lun</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='bus'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>ide</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>fdc</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>scsi</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>usb</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>sata</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-non-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </disk>
Oct 20 08:44:13 user nova-compute[74039]:     <graphics supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='type'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>sdl</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vnc</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>spice</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>egl-headless</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </graphics>
Oct 20 08:44:13 user nova-compute[74039]:     <video supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='modelType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vga</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>cirrus</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vmvga</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>qxl</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>none</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>bochs</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>ramfb</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </video>
Oct 20 08:44:13 user nova-compute[74039]:     <hostdev supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='mode'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>subsystem</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='startupPolicy'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>default</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>mandatory</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>requisite</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>optional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='subsysType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>usb</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>pci</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>scsi</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='capsType'/>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='pciBackend'/>
Oct 20 08:44:13 user nova-compute[74039]:     </hostdev>
Oct 20 08:44:13 user nova-compute[74039]:     <rng supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-non-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='backendModel'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>random</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>egd</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>builtin</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </rng>
Oct 20 08:44:13 user nova-compute[74039]:     <filesystem supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='driverType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>path</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>handle</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtiofs</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </filesystem>
Oct 20 08:44:13 user nova-compute[74039]:     <tpm supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>tpm-tis</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>tpm-crb</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='backendModel'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>passthrough</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>emulator</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </tpm>
Oct 20 08:44:13 user nova-compute[74039]:   </devices>
Oct 20 08:44:13 user nova-compute[74039]:   <features>
Oct 20 08:44:13 user nova-compute[74039]:     <gic supported='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     <vmcoreinfo supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <genid supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <backingStoreInput supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <backup supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <sev supported='no'/>
Oct 20 08:44:13 user nova-compute[74039]:   </features>
Oct 20 08:44:13 user nova-compute[74039]: </domainCapabilities>
Oct 20 08:44:13 user nova-compute[74039]:  {{(pid=74039) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 20 08:44:13 user nova-compute[74039]: <domainCapabilities>
Oct 20 08:44:13 user nova-compute[74039]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 08:44:13 user nova-compute[74039]:   <domain>kvm</domain>
Oct 20 08:44:13 user nova-compute[74039]:   <machine>pc-q35-jammy</machine>
Oct 20 08:44:13 user nova-compute[74039]:   <arch>x86_64</arch>
Oct 20 08:44:13 user nova-compute[74039]:   <vcpu max='288'/>
Oct 20 08:44:13 user nova-compute[74039]:   <iothreads supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:   <os supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:     <enum name='firmware'>
Oct 20 08:44:13 user nova-compute[74039]:       <value>efi</value>
Oct 20 08:44:13 user nova-compute[74039]:     </enum>
Oct 20 08:44:13 user nova-compute[74039]:     <loader supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='type'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>rom</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>pflash</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='readonly'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>yes</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>no</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='secure'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>yes</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>no</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </loader>
Oct 20 08:44:13 user nova-compute[74039]:   </os>
Oct 20 08:44:13 user nova-compute[74039]:   <cpu>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='host-passthrough' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='hostPassthroughMigratable'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>on</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>off</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='maximum' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='maximumMigratable'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>on</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>off</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='host-model' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <vendor>Intel</vendor>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ss'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='vmx'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='pcid'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='hypervisor'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='arat'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='umip'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='md-clear'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='stibp'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ssbd'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='invtsc'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ibpb'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='ibrs'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='amd-stibp'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='rsba'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='disable' name='erms'/>
Oct 20 08:44:13 user nova-compute[74039]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:     <mode name='custom' supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>qemu64</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>qemu32</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>phenom</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium3</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium2</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>pentium</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>n270</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>kvm64</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>kvm32</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>coreduo</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>core2duo</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>athlon</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Westmere</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Snowridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Skylake-Client</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>SandyBridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Penryn</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G5</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G4</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G3</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Opteron_G2</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Opteron_G1</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Nehalem</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>IvyBridge</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Icelake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Haswell</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-Rome</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-Milan</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>EPYC</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Dhyana</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cooperlake</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>Conroe</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='no'>Broadwell</model>
Oct 20 08:44:13 user nova-compute[74039]:       <model usable='yes'>486</model>
Oct 20 08:44:13 user nova-compute[74039]:     </mode>
Oct 20 08:44:13 user nova-compute[74039]:   </cpu>
Oct 20 08:44:13 user nova-compute[74039]:   <memoryBacking supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:     <enum name='sourceType'>
Oct 20 08:44:13 user nova-compute[74039]:       <value>file</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>anonymous</value>
Oct 20 08:44:13 user nova-compute[74039]:       <value>memfd</value>
Oct 20 08:44:13 user nova-compute[74039]:     </enum>
Oct 20 08:44:13 user nova-compute[74039]:   </memoryBacking>
Oct 20 08:44:13 user nova-compute[74039]:   <devices>
Oct 20 08:44:13 user nova-compute[74039]:     <disk supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='diskDevice'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>disk</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>cdrom</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>floppy</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>lun</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='bus'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>fdc</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>scsi</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>usb</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>sata</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-non-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </disk>
Oct 20 08:44:13 user nova-compute[74039]:     <graphics supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='type'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>sdl</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vnc</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>spice</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>egl-headless</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </graphics>
Oct 20 08:44:13 user nova-compute[74039]:     <video supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='modelType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vga</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>cirrus</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>vmvga</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>qxl</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>none</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>bochs</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>ramfb</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </video>
Oct 20 08:44:13 user nova-compute[74039]:     <hostdev supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='mode'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>subsystem</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='startupPolicy'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>default</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>mandatory</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>requisite</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>optional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='subsysType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>usb</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>pci</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>scsi</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='capsType'/>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='pciBackend'/>
Oct 20 08:44:13 user nova-compute[74039]:     </hostdev>
Oct 20 08:44:13 user nova-compute[74039]:     <rng supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtio-non-transitional</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='backendModel'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>random</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>egd</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>builtin</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </rng>
Oct 20 08:44:13 user nova-compute[74039]:     <filesystem supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='driverType'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>path</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>handle</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>virtiofs</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </filesystem>
Oct 20 08:44:13 user nova-compute[74039]:     <tpm supported='yes'>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='model'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>tpm-tis</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>tpm-crb</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:       <enum name='backendModel'>
Oct 20 08:44:13 user nova-compute[74039]:         <value>passthrough</value>
Oct 20 08:44:13 user nova-compute[74039]:         <value>emulator</value>
Oct 20 08:44:13 user nova-compute[74039]:       </enum>
Oct 20 08:44:13 user nova-compute[74039]:     </tpm>
Oct 20 08:44:13 user nova-compute[74039]:   </devices>
Oct 20 08:44:13 user nova-compute[74039]:   <features>
Oct 20 08:44:13 user nova-compute[74039]:     <gic supported='no'/>
Oct 20 08:44:13 user nova-compute[74039]:     <vmcoreinfo supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <genid supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <backingStoreInput supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <backup supported='yes'/>
Oct 20 08:44:13 user nova-compute[74039]:     <sev supported='no'/>
Oct 20 08:44:13 user nova-compute[74039]:   </features>
Oct 20 08:44:13 user nova-compute[74039]: </domainCapabilities>
Oct 20 08:44:13 user nova-compute[74039]:  {{(pid=74039) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74039) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74039) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Checking secure boot support for host arch (x86_64) {{(pid=74039) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 20 08:44:13 user nova-compute[74039]: INFO nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Secure Boot support detected
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] cpu compare xml: <cpu match="exact">
Oct 20 08:44:13 user nova-compute[74039]:   <model>Nehalem</model>
Oct 20 08:44:13 user nova-compute[74039]: </cpu>
Oct 20 08:44:13 user nova-compute[74039]:  {{(pid=74039) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 20 08:44:13 user nova-compute[74039]: INFO nova.virt.node [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Generated node identity 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb
Oct 20 08:44:13 user nova-compute[74039]: INFO nova.virt.node [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Wrote node identity 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb to /opt/stack/data/nova/compute_id
Oct 20 08:44:13 user nova-compute[74039]: WARNING nova.compute.manager [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Compute nodes ['2e813dfe-3db6-40c5-8768-7e4aa3c40bcb'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 20 08:44:13 user nova-compute[74039]: INFO nova.compute.manager [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 20 08:44:13 user nova-compute[74039]: WARNING nova.compute.manager [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 20 08:44:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:44:13 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 08:44:14 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:44:14 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:44:14 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Hypervisor/Node resource view: name=user free_ram=10984MB free_disk=26.403656005859375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 08:44:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:44:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:44:14 user nova-compute[74039]: WARNING nova.compute.resource_tracker [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] No compute node record for user:2e813dfe-3db6-40c5-8768-7e4aa3c40bcb: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb could not be found.
Oct 20 08:44:14 user nova-compute[74039]: INFO nova.compute.resource_tracker [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Compute node record created for user:user with uuid: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb
Oct 20 08:44:14 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 08:44:14 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 08:44:14 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] [req-489183d4-f2bc-4d4a-9ad0-ed42e2fe4b75] Created resource provider record via placement API for resource provider with UUID 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb and name user.
Oct 20 08:44:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74039) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 20 08:44:14 user nova-compute[74039]: INFO nova.virt.libvirt.host [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] kernel doesn't support AMD SEV
Oct 20 08:44:14 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Updating inventory in ProviderTree for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 08:44:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:44:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Libvirt baseline CPU <cpu>
Oct 20 08:44:14 user nova-compute[74039]:   <arch>x86_64</arch>
Oct 20 08:44:14 user nova-compute[74039]:   <model>Nehalem</model>
Oct 20 08:44:14 user nova-compute[74039]:   <vendor>Intel</vendor>
Oct 20 08:44:14 user nova-compute[74039]:   <topology sockets="6" cores="1" threads="1"/>
Oct 20 08:44:14 user nova-compute[74039]: </cpu>
Oct 20 08:44:14 user nova-compute[74039]:  {{(pid=74039) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 20 08:44:14 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Updated inventory for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 20 08:44:14 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Updating resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb generation from 0 to 1 during operation: update_inventory {{(pid=74039) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 20 08:44:14 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Updating inventory in ProviderTree for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 08:44:14 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Updating resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb generation from 1 to 2 during operation: update_traits {{(pid=74039) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 20 08:44:14 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 08:44:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:44:14 user nova-compute[74039]: DEBUG nova.service [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Creating RPC server for service compute {{(pid=74039) start /opt/stack/nova/nova/service.py:182}}
Oct 20 08:44:14 user nova-compute[74039]: DEBUG nova.service [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] Join ServiceGroup membership for this service compute {{(pid=74039) start /opt/stack/nova/nova/service.py:199}}
Oct 20 08:44:14 user nova-compute[74039]: DEBUG nova.servicegroup.drivers.db [None req-0091d9ee-c814-40d5-988e-cdd6bbcba983 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74039) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 20 08:44:47 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:44:47 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:45:05 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:45:05 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:45:05 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 08:45:05 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Rebuilding the list of instances to heal {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 08:45:05 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Didn't find any instances for network info cache update. {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 08:45:05 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:45:05 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:45:05 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:45:05 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:45:05 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:45:05 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:45:05 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 08:45:05 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:45:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:45:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:45:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:45:05 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 08:45:06 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:45:06 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:45:06 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=10396MB free_disk=26.307308197021484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 08:45:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:45:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:45:06 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 08:45:06 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 08:45:06 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:45:06 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:45:06 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 08:45:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:46:06 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:46:06 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:46:06 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:46:06 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:46:06 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 08:46:06 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:46:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:46:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:46:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:46:06 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 08:46:06 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:46:06 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:46:06 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=10336MB free_disk=26.371681213378906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 08:46:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:46:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:46:06 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 08:46:06 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 08:46:06 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:46:06 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:46:06 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 08:46:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:46:07 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:46:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 08:46:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Rebuilding the list of instances to heal {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 08:46:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Didn't find any instances for network info cache update. {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 08:46:07 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:46:07 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:46:07 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:46:07 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:47:05 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:47:05 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:47:05 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 08:47:06 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:47:06 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:47:07 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:47:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 08:47:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Rebuilding the list of instances to heal {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 08:47:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Didn't find any instances for network info cache update. {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 08:47:07 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:47:07 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:47:07 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:47:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:47:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:47:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:47:07 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 08:47:08 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:47:08 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:47:08 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=10386MB free_disk=26.125041961669922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 08:47:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:47:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:47:08 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 08:47:08 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 08:47:08 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:47:08 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:47:08 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 08:47:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:47:09 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:48:06 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:48:06 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:48:06 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:48:07 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:48:07 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:48:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 08:48:08 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:48:08 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:48:08 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:48:09 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:48:09 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 08:48:09 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Rebuilding the list of instances to heal {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 08:48:09 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Didn't find any instances for network info cache update. {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 08:48:09 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:48:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:09 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 08:48:10 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:48:10 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:48:10 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=9578MB free_disk=26.144283294677734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 08:48:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:10 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 08:48:10 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 08:48:10 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:48:10 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:48:10 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 08:48:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:15 user nova-compute[74039]: DEBUG nova.compute.manager [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 08:48:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:15 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:48:15 user nova-compute[74039]: INFO nova.compute.claims [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Claim successful on node user
Oct 20 08:48:16 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:48:16 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:48:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:16 user nova-compute[74039]: DEBUG nova.compute.manager [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 08:48:16 user nova-compute[74039]: DEBUG nova.compute.manager [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 08:48:16 user nova-compute[74039]: DEBUG nova.network.neutron [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:48:16 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 08:48:16 user nova-compute[74039]: DEBUG nova.compute.manager [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 08:48:16 user nova-compute[74039]: DEBUG nova.compute.manager [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 08:48:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:48:16 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Creating image(s)
Oct 20 08:48:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "/opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "/opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "/opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258.part --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:17 user nova-compute[74039]: DEBUG nova.policy [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4024fa0ccfda49e0a070b9e6166e37ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74bb65080a343afb5cbcea1b5481938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:48:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258.part --force-share --output=json" returned: 0 in 0.204s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:17 user nova-compute[74039]: DEBUG nova.virt.images [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] f58b9629-4790-4951-9492-6447e1485638 was qcow2, converting to raw {{(pid=74039) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 08:48:17 user nova-compute[74039]: DEBUG nova.privsep.utils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74039) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 08:48:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258.part /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258.converted {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258.part /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258.converted" returned: 0 in 0.209s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258.converted --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.239s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:17 user nova-compute[74039]: INFO oslo.privsep.daemon [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4jhbmhqy/privsep.sock']
Oct 20 08:48:17 user sudo[83297]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4jhbmhqy/privsep.sock
Oct 20 08:48:17 user sudo[83297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 08:48:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:18 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 08:48:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:48:18 user nova-compute[74039]: INFO nova.compute.claims [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Claim successful on node user
Oct 20 08:48:18 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:48:18 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:48:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:18 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 08:48:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:18 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 08:48:18 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:48:18 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 08:48:18 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 08:48:18 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 08:48:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:48:18 user nova-compute[74039]: INFO nova.compute.claims [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Claim successful on node user
Oct 20 08:48:19 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:48:19 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Creating image(s)
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "/opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "/opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG nova.network.neutron [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Successfully created port: e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG nova.policy [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4024fa0ccfda49e0a070b9e6166e37ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74bb65080a343afb5cbcea1b5481938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG nova.network.neutron [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:48:19 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 08:48:19 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 08:48:19 user sudo[83297]: pam_unix(sudo:session): session closed for user root
Oct 20 08:48:19 user nova-compute[74039]: INFO oslo.privsep.daemon [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Spawned new privsep daemon via rootwrap
Oct 20 08:48:19 user nova-compute[74039]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 08:48:19 user nova-compute[74039]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 08:48:19 user nova-compute[74039]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 20 08:48:19 user nova-compute[74039]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83303
Oct 20 08:48:19 user nova-compute[74039]: WARNING oslo_privsep.priv_context [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] privsep daemon already running
Oct 20 08:48:19 user nova-compute[74039]: DEBUG nova.policy [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb823f0374a04657be729eb153160659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a58985dce3491d8e45e6e468e0e549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Acquiring lock "971fb41b-7fce-4ffe-b785-5d86f435004a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lock "971fb41b-7fce-4ffe-b785-5d86f435004a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:48:19 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Creating image(s)
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "/opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "/opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "/opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG nova.compute.manager [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:48:19 user nova-compute[74039]: INFO nova.compute.claims [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Claim successful on node user
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.159s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.203s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.184s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk 1073741824" returned: 0 in 0.219s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.395s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.352s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.714s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG nova.compute.manager [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.181s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG nova.compute.manager [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG nova.network.neutron [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.210s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:20 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk 1073741824" returned: 0 in 0.054s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.647s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG nova.compute.manager [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Cannot resize image /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Ensure instance console log exists: /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG nova.policy [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09534beb690444d6bf63e532958db714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b7efa953a4a4049925485acdb855247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.211s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG nova.network.neutron [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Successfully updated port: e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG nova.compute.manager [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:48:20 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Creating image(s)
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Acquiring lock "/opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lock "/opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lock "/opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.259s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquired lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG nova.network.neutron [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk 1073741824" returned: 0 in 0.060s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.372s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Cannot resize image /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Ensure instance console log exists: /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.303s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG nova.network.neutron [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-58c0cc55-e834-4985-b7e3-fea7ac3e1aa1 req-9237cb35-bf2a-4f9e-9c69-a0b2fc810547 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received event network-changed-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-58c0cc55-e834-4985-b7e3-fea7ac3e1aa1 req-9237cb35-bf2a-4f9e-9c69-a0b2fc810547 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Refreshing instance network info cache due to event network-changed-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-58c0cc55-e834-4985-b7e3-fea7ac3e1aa1 req-9237cb35-bf2a-4f9e-9c69-a0b2fc810547 service nova] Acquiring lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.284s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Successfully created port: 24716055-5932-4507-8742-840afce654a2 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.265s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Cannot resize image /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Ensure instance console log exists: /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk 1073741824" returned: 0 in 0.053s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG nova.network.neutron [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Successfully created port: 708d272c-3434-4525-bcbd-3ee50e71eb47 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Cannot resize image /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Ensure instance console log exists: /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.network.neutron [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Updating instance_info_cache with network_info: [{"id": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "address": "fa:16:3e:63:75:a3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9fe7711-d5", "ovs_interfaceid": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Releasing lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.compute.manager [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Instance network_info: |[{"id": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "address": "fa:16:3e:63:75:a3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9fe7711-d5", "ovs_interfaceid": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-58c0cc55-e834-4985-b7e3-fea7ac3e1aa1 req-9237cb35-bf2a-4f9e-9c69-a0b2fc810547 service nova] Acquired lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.network.neutron [req-58c0cc55-e834-4985-b7e3-fea7ac3e1aa1 req-9237cb35-bf2a-4f9e-9c69-a0b2fc810547 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Refreshing network info cache for port e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Start _get_guest_xml network_info=[{"id": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "address": "fa:16:3e:63:75:a3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9fe7711-d5", "ovs_interfaceid": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:48:22 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:48:22 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.privsep.utils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74039) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:48:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1613714497',display_name='tempest-ServerRescueNegativeTestJSON-server-1613714497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1613714497',id=1,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d74bb65080a343afb5cbcea1b5481938',ramdisk_id='',reservation_id='r-a20rs244',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1580334620',owner_user_name='tempest-ServerRescueNegativeTestJSON-1580334620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:48:17Z,user_data=None,user_id='4024fa0ccfda49e0a070b9e6166e37ed',uuid=9fe77a96-fcb5-4410-85cc-58d925548e03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "address": "fa:16:3e:63:75:a3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9fe7711-d5", "ovs_interfaceid": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converting VIF {"id": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "address": "fa:16:3e:63:75:a3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9fe7711-d5", "ovs_interfaceid": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:75:a3,bridge_name='br-int',has_traffic_filtering=True,id=e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9fe7711-d5') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.objects.instance [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fe77a96-fcb5-4410-85cc-58d925548e03 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:48:22 user nova-compute[74039]:   <uuid>9fe77a96-fcb5-4410-85cc-58d925548e03</uuid>
Oct 20 08:48:22 user nova-compute[74039]:   <name>instance-00000001</name>
Oct 20 08:48:22 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:48:22 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:48:22 user nova-compute[74039]:   <metadata>
Oct 20 08:48:22 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:48:22 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:48:22 user nova-compute[74039]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1613714497</nova:name>
Oct 20 08:48:22 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:48:22</nova:creationTime>
Oct 20 08:48:22 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:48:22 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:48:22 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:48:22 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:48:22 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:48:22 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:48:22 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:48:22 user nova-compute[74039]:       <nova:owner>
Oct 20 08:48:22 user nova-compute[74039]:         <nova:user uuid="4024fa0ccfda49e0a070b9e6166e37ed">tempest-ServerRescueNegativeTestJSON-1580334620-project-member</nova:user>
Oct 20 08:48:22 user nova-compute[74039]:         <nova:project uuid="d74bb65080a343afb5cbcea1b5481938">tempest-ServerRescueNegativeTestJSON-1580334620</nova:project>
Oct 20 08:48:22 user nova-compute[74039]:       </nova:owner>
Oct 20 08:48:22 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:48:22 user nova-compute[74039]:       <nova:ports>
Oct 20 08:48:22 user nova-compute[74039]:         <nova:port uuid="e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7">
Oct 20 08:48:22 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 08:48:22 user nova-compute[74039]:         </nova:port>
Oct 20 08:48:22 user nova-compute[74039]:       </nova:ports>
Oct 20 08:48:22 user nova-compute[74039]:     </nova:instance>
Oct 20 08:48:22 user nova-compute[74039]:   </metadata>
Oct 20 08:48:22 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:48:22 user nova-compute[74039]:     <system>
Oct 20 08:48:22 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:48:22 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:48:22 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:48:22 user nova-compute[74039]:       <entry name="serial">9fe77a96-fcb5-4410-85cc-58d925548e03</entry>
Oct 20 08:48:22 user nova-compute[74039]:       <entry name="uuid">9fe77a96-fcb5-4410-85cc-58d925548e03</entry>
Oct 20 08:48:22 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:48:22 user nova-compute[74039]:     </system>
Oct 20 08:48:22 user nova-compute[74039]:   </sysinfo>
Oct 20 08:48:22 user nova-compute[74039]:   <os>
Oct 20 08:48:22 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:48:22 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:48:22 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:48:22 user nova-compute[74039]:   </os>
Oct 20 08:48:22 user nova-compute[74039]:   <features>
Oct 20 08:48:22 user nova-compute[74039]:     <acpi/>
Oct 20 08:48:22 user nova-compute[74039]:     <apic/>
Oct 20 08:48:22 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:48:22 user nova-compute[74039]:   </features>
Oct 20 08:48:22 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:48:22 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:48:22 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:48:22 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:48:22 user nova-compute[74039]:   </clock>
Oct 20 08:48:22 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:48:22 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:48:22 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:48:22 user nova-compute[74039]:   </cpu>
Oct 20 08:48:22 user nova-compute[74039]:   <devices>
Oct 20 08:48:22 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:48:22 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:48:22 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk"/>
Oct 20 08:48:22 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:48:22 user nova-compute[74039]:     </disk>
Oct 20 08:48:22 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:48:22 user nova-compute[74039]:       <mac address="fa:16:3e:63:75:a3"/>
Oct 20 08:48:22 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:48:22 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:48:22 user nova-compute[74039]:       <target dev="tape9fe7711-d5"/>
Oct 20 08:48:22 user nova-compute[74039]:     </interface>
Oct 20 08:48:22 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:48:22 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/console.log" append="off"/>
Oct 20 08:48:22 user nova-compute[74039]:     </serial>
Oct 20 08:48:22 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:48:22 user nova-compute[74039]:     <video>
Oct 20 08:48:22 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:48:22 user nova-compute[74039]:     </video>
Oct 20 08:48:22 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:48:22 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:48:22 user nova-compute[74039]:     </rng>
Oct 20 08:48:22 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:48:22 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:48:22 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:48:22 user nova-compute[74039]:     </memballoon>
Oct 20 08:48:22 user nova-compute[74039]:   </devices>
Oct 20 08:48:22 user nova-compute[74039]: </domain>
Oct 20 08:48:22 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:48:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1613714497',display_name='tempest-ServerRescueNegativeTestJSON-server-1613714497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1613714497',id=1,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d74bb65080a343afb5cbcea1b5481938',ramdisk_id='',reservation_id='r-a20rs244',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1580334620',owner_user_name='tempest-ServerRescueNegativeTestJSON-1580334620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:48:17Z,user_data=None,user_id='4024fa0ccfda49e0a070b9e6166e37ed',uuid=9fe77a96-fcb5-4410-85cc-58d925548e03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "address": "fa:16:3e:63:75:a3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9fe7711-d5", "ovs_interfaceid": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converting VIF {"id": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "address": "fa:16:3e:63:75:a3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9fe7711-d5", "ovs_interfaceid": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:75:a3,bridge_name='br-int',has_traffic_filtering=True,id=e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9fe7711-d5') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG os_vif [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:75:a3,bridge_name='br-int',has_traffic_filtering=True,id=e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9fe7711-d5') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Created schema index Interface.name {{(pid=74039) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Created schema index Port.name {{(pid=74039) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Created schema index Bridge.name {{(pid=74039) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [POLLOUT] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:48:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53418a79-4840-5e9c-9d37-4f2daf698d94', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:48:23 user nova-compute[74039]: INFO oslo.privsep.daemon [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmps2pd7zer/privsep.sock']
Oct 20 08:48:23 user sudo[83372]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmps2pd7zer/privsep.sock
Oct 20 08:48:23 user sudo[83372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 08:48:23 user nova-compute[74039]: DEBUG nova.network.neutron [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Successfully created port: 903853f8-c5ee-49d4-9896-b50b043842c6 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:48:23 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Successfully updated port: 24716055-5932-4507-8742-840afce654a2 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:48:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "refresh_cache-c8054dbd-c0ae-45d2-af95-dae7d05f8c69" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:48:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquired lock "refresh_cache-c8054dbd-c0ae-45d2-af95-dae7d05f8c69" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:48:23 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:48:23 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:48:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-c3d47023-8f52-4174-8a67-8a53bfb459d7 req-1df7e9d9-6eb4-46a1-8e5a-b90e6977f648 service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Received event network-changed-24716055-5932-4507-8742-840afce654a2 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:48:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-c3d47023-8f52-4174-8a67-8a53bfb459d7 req-1df7e9d9-6eb4-46a1-8e5a-b90e6977f648 service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Refreshing instance network info cache due to event network-changed-24716055-5932-4507-8742-840afce654a2. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:48:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c3d47023-8f52-4174-8a67-8a53bfb459d7 req-1df7e9d9-6eb4-46a1-8e5a-b90e6977f648 service nova] Acquiring lock "refresh_cache-c8054dbd-c0ae-45d2-af95-dae7d05f8c69" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:24 user sudo[83372]: pam_unix(sudo:session): session closed for user root
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.network.neutron [req-58c0cc55-e834-4985-b7e3-fea7ac3e1aa1 req-9237cb35-bf2a-4f9e-9c69-a0b2fc810547 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Updated VIF entry in instance network info cache for port e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.network.neutron [req-58c0cc55-e834-4985-b7e3-fea7ac3e1aa1 req-9237cb35-bf2a-4f9e-9c69-a0b2fc810547 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Updating instance_info_cache with network_info: [{"id": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "address": "fa:16:3e:63:75:a3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9fe7711-d5", "ovs_interfaceid": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:48:24 user nova-compute[74039]: INFO oslo.privsep.daemon [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Spawned new privsep daemon via rootwrap
Oct 20 08:48:24 user nova-compute[74039]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 08:48:24 user nova-compute[74039]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 08:48:24 user nova-compute[74039]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 20 08:48:24 user nova-compute[74039]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83376
Oct 20 08:48:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-58c0cc55-e834-4985-b7e3-fea7ac3e1aa1 req-9237cb35-bf2a-4f9e-9c69-a0b2fc810547 service nova] Releasing lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.network.neutron [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Successfully updated port: 708d272c-3434-4525-bcbd-3ee50e71eb47 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquired lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.network.neutron [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Updating instance_info_cache with network_info: [{"id": "24716055-5932-4507-8742-840afce654a2", "address": "fa:16:3e:3e:2e:b3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24716055-59", "ovs_interfaceid": "24716055-5932-4507-8742-840afce654a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Releasing lock "refresh_cache-c8054dbd-c0ae-45d2-af95-dae7d05f8c69" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Instance network_info: |[{"id": "24716055-5932-4507-8742-840afce654a2", "address": "fa:16:3e:3e:2e:b3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24716055-59", "ovs_interfaceid": "24716055-5932-4507-8742-840afce654a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c3d47023-8f52-4174-8a67-8a53bfb459d7 req-1df7e9d9-6eb4-46a1-8e5a-b90e6977f648 service nova] Acquired lock "refresh_cache-c8054dbd-c0ae-45d2-af95-dae7d05f8c69" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.network.neutron [req-c3d47023-8f52-4174-8a67-8a53bfb459d7 req-1df7e9d9-6eb4-46a1-8e5a-b90e6977f648 service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Refreshing network info cache for port 24716055-5932-4507-8742-840afce654a2 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Start _get_guest_xml network_info=[{"id": "24716055-5932-4507-8742-840afce654a2", "address": "fa:16:3e:3e:2e:b3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24716055-59", "ovs_interfaceid": "24716055-5932-4507-8742-840afce654a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:48:24 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:48:24 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1005459278',display_name='tempest-ServerRescueNegativeTestJSON-server-1005459278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1005459278',id=2,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d74bb65080a343afb5cbcea1b5481938',ramdisk_id='',reservation_id='r-xijpimll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1580334620',owner_user_name='tempest-ServerRescueNegativeTestJSON-1580334620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:48:19Z,user_data=None,user_id='4024fa0ccfda49e0a070b9e6166e37ed',uuid=c8054dbd-c0ae-45d2-af95-dae7d05f8c69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24716055-5932-4507-8742-840afce654a2", "address": "fa:16:3e:3e:2e:b3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24716055-59", "ovs_interfaceid": "24716055-5932-4507-8742-840afce654a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converting VIF {"id": "24716055-5932-4507-8742-840afce654a2", "address": "fa:16:3e:3e:2e:b3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24716055-59", "ovs_interfaceid": "24716055-5932-4507-8742-840afce654a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:2e:b3,bridge_name='br-int',has_traffic_filtering=True,id=24716055-5932-4507-8742-840afce654a2,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24716055-59') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.objects.instance [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'pci_devices' on Instance uuid c8054dbd-c0ae-45d2-af95-dae7d05f8c69 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.compute.manager [req-b119a489-4deb-4bb3-a65d-82c99d4c32c1 req-b56962a4-d887-4e63-bd56-822de8a712b6 service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Received event network-changed-708d272c-3434-4525-bcbd-3ee50e71eb47 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.compute.manager [req-b119a489-4deb-4bb3-a65d-82c99d4c32c1 req-b56962a4-d887-4e63-bd56-822de8a712b6 service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Refreshing instance network info cache due to event network-changed-708d272c-3434-4525-bcbd-3ee50e71eb47. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b119a489-4deb-4bb3-a65d-82c99d4c32c1 req-b56962a4-d887-4e63-bd56-822de8a712b6 service nova] Acquiring lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:48:24 user nova-compute[74039]:   <uuid>c8054dbd-c0ae-45d2-af95-dae7d05f8c69</uuid>
Oct 20 08:48:24 user nova-compute[74039]:   <name>instance-00000002</name>
Oct 20 08:48:24 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:48:24 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:48:24 user nova-compute[74039]:   <metadata>
Oct 20 08:48:24 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:48:24 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:48:24 user nova-compute[74039]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1005459278</nova:name>
Oct 20 08:48:24 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:48:24</nova:creationTime>
Oct 20 08:48:24 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:48:24 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:48:24 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:48:24 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:48:24 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:48:24 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:48:24 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:48:24 user nova-compute[74039]:       <nova:owner>
Oct 20 08:48:24 user nova-compute[74039]:         <nova:user uuid="4024fa0ccfda49e0a070b9e6166e37ed">tempest-ServerRescueNegativeTestJSON-1580334620-project-member</nova:user>
Oct 20 08:48:24 user nova-compute[74039]:         <nova:project uuid="d74bb65080a343afb5cbcea1b5481938">tempest-ServerRescueNegativeTestJSON-1580334620</nova:project>
Oct 20 08:48:24 user nova-compute[74039]:       </nova:owner>
Oct 20 08:48:24 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:48:24 user nova-compute[74039]:       <nova:ports>
Oct 20 08:48:24 user nova-compute[74039]:         <nova:port uuid="24716055-5932-4507-8742-840afce654a2">
Oct 20 08:48:24 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 08:48:24 user nova-compute[74039]:         </nova:port>
Oct 20 08:48:24 user nova-compute[74039]:       </nova:ports>
Oct 20 08:48:24 user nova-compute[74039]:     </nova:instance>
Oct 20 08:48:24 user nova-compute[74039]:   </metadata>
Oct 20 08:48:24 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:48:24 user nova-compute[74039]:     <system>
Oct 20 08:48:24 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:48:24 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:48:24 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:48:24 user nova-compute[74039]:       <entry name="serial">c8054dbd-c0ae-45d2-af95-dae7d05f8c69</entry>
Oct 20 08:48:24 user nova-compute[74039]:       <entry name="uuid">c8054dbd-c0ae-45d2-af95-dae7d05f8c69</entry>
Oct 20 08:48:24 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:48:24 user nova-compute[74039]:     </system>
Oct 20 08:48:24 user nova-compute[74039]:   </sysinfo>
Oct 20 08:48:24 user nova-compute[74039]:   <os>
Oct 20 08:48:24 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:48:24 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:48:24 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:48:24 user nova-compute[74039]:   </os>
Oct 20 08:48:24 user nova-compute[74039]:   <features>
Oct 20 08:48:24 user nova-compute[74039]:     <acpi/>
Oct 20 08:48:24 user nova-compute[74039]:     <apic/>
Oct 20 08:48:24 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:48:24 user nova-compute[74039]:   </features>
Oct 20 08:48:24 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:48:24 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:48:24 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:48:24 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:48:24 user nova-compute[74039]:   </clock>
Oct 20 08:48:24 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:48:24 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:48:24 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:48:24 user nova-compute[74039]:   </cpu>
Oct 20 08:48:24 user nova-compute[74039]:   <devices>
Oct 20 08:48:24 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:48:24 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:48:24 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk"/>
Oct 20 08:48:24 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:48:24 user nova-compute[74039]:     </disk>
Oct 20 08:48:24 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:48:24 user nova-compute[74039]:       <mac address="fa:16:3e:3e:2e:b3"/>
Oct 20 08:48:24 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:48:24 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:48:24 user nova-compute[74039]:       <target dev="tap24716055-59"/>
Oct 20 08:48:24 user nova-compute[74039]:     </interface>
Oct 20 08:48:24 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:48:24 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/console.log" append="off"/>
Oct 20 08:48:24 user nova-compute[74039]:     </serial>
Oct 20 08:48:24 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:48:24 user nova-compute[74039]:     <video>
Oct 20 08:48:24 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:48:24 user nova-compute[74039]:     </video>
Oct 20 08:48:24 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:48:24 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:48:24 user nova-compute[74039]:     </rng>
Oct 20 08:48:24 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:48:24 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:48:24 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:48:24 user nova-compute[74039]:     </memballoon>
Oct 20 08:48:24 user nova-compute[74039]:   </devices>
Oct 20 08:48:24 user nova-compute[74039]: </domain>
Oct 20 08:48:24 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1005459278',display_name='tempest-ServerRescueNegativeTestJSON-server-1005459278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1005459278',id=2,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d74bb65080a343afb5cbcea1b5481938',ramdisk_id='',reservation_id='r-xijpimll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1580334620',owner_user_name='tempest-ServerRescueNegativeTestJSON-1580334620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:48:19Z,user_data=None,user_id='4024fa0ccfda49e0a070b9e6166e37ed',uuid=c8054dbd-c0ae-45d2-af95-dae7d05f8c69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24716055-5932-4507-8742-840afce654a2", "address": "fa:16:3e:3e:2e:b3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24716055-59", "ovs_interfaceid": "24716055-5932-4507-8742-840afce654a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converting VIF {"id": "24716055-5932-4507-8742-840afce654a2", "address": "fa:16:3e:3e:2e:b3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24716055-59", "ovs_interfaceid": "24716055-5932-4507-8742-840afce654a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:2e:b3,bridge_name='br-int',has_traffic_filtering=True,id=24716055-5932-4507-8742-840afce654a2,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24716055-59') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG os_vif [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:2e:b3,bridge_name='br-int',has_traffic_filtering=True,id=24716055-5932-4507-8742-840afce654a2,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24716055-59') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02a3fc6d-944a-58c6-9d13-b3e621852cff', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:24 user nova-compute[74039]: DEBUG nova.network.neutron [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9fe7711-d5, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9fe7711-d5, col_values=(('qos', UUID('a6588a3c-00e5-4ee9-a16d-fc067c31e27b')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9fe7711-d5, col_values=(('external_ids', {'iface-id': 'e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:75:a3', 'vm-uuid': '9fe77a96-fcb5-4410-85cc-58d925548e03'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:25 user nova-compute[74039]: INFO os_vif [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:75:a3,bridge_name='br-int',has_traffic_filtering=True,id=e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9fe7711-d5')
Oct 20 08:48:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24716055-59, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap24716055-59, col_values=(('qos', UUID('a9e1c1a7-68cd-4fd8-a775-89e33fdfdce6')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap24716055-59, col_values=(('external_ids', {'iface-id': '24716055-5932-4507-8742-840afce654a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:2e:b3', 'vm-uuid': 'c8054dbd-c0ae-45d2-af95-dae7d05f8c69'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:25 user nova-compute[74039]: INFO os_vif [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:2e:b3,bridge_name='br-int',has_traffic_filtering=True,id=24716055-5932-4507-8742-840afce654a2,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24716055-59')
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] No VIF found with MAC fa:16:3e:63:75:a3, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] No VIF found with MAC fa:16:3e:3e:2e:b3, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.network.neutron [req-c3d47023-8f52-4174-8a67-8a53bfb459d7 req-1df7e9d9-6eb4-46a1-8e5a-b90e6977f648 service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Updated VIF entry in instance network info cache for port 24716055-5932-4507-8742-840afce654a2. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.network.neutron [req-c3d47023-8f52-4174-8a67-8a53bfb459d7 req-1df7e9d9-6eb4-46a1-8e5a-b90e6977f648 service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Updating instance_info_cache with network_info: [{"id": "24716055-5932-4507-8742-840afce654a2", "address": "fa:16:3e:3e:2e:b3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24716055-59", "ovs_interfaceid": "24716055-5932-4507-8742-840afce654a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c3d47023-8f52-4174-8a67-8a53bfb459d7 req-1df7e9d9-6eb4-46a1-8e5a-b90e6977f648 service nova] Releasing lock "refresh_cache-c8054dbd-c0ae-45d2-af95-dae7d05f8c69" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.network.neutron [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Updating instance_info_cache with network_info: [{"id": "708d272c-3434-4525-bcbd-3ee50e71eb47", "address": "fa:16:3e:3f:80:75", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708d272c-34", "ovs_interfaceid": "708d272c-3434-4525-bcbd-3ee50e71eb47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Releasing lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Instance network_info: |[{"id": "708d272c-3434-4525-bcbd-3ee50e71eb47", "address": "fa:16:3e:3f:80:75", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708d272c-34", "ovs_interfaceid": "708d272c-3434-4525-bcbd-3ee50e71eb47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b119a489-4deb-4bb3-a65d-82c99d4c32c1 req-b56962a4-d887-4e63-bd56-822de8a712b6 service nova] Acquired lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.network.neutron [req-b119a489-4deb-4bb3-a65d-82c99d4c32c1 req-b56962a4-d887-4e63-bd56-822de8a712b6 service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Refreshing network info cache for port 708d272c-3434-4525-bcbd-3ee50e71eb47 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Start _get_guest_xml network_info=[{"id": "708d272c-3434-4525-bcbd-3ee50e71eb47", "address": "fa:16:3e:3f:80:75", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708d272c-34", "ovs_interfaceid": "708d272c-3434-4525-bcbd-3ee50e71eb47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:48:25 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:48:25 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:48:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-55801458',display_name='tempest-ServerActionsTestOtherA-server-55801458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-55801458',id=3,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyyJ62onAPVNIcWwPgu8Qk09h8heuIgT4K5VQCSSgQo1m6HsMw9upnfKrs0KtZmErwiBvOSQvzot9EsqbPyLMmcaHuqRr6HWOREqecRp8rh7oJxELHXOR3Is97nl7PEUA==',key_name='tempest-keypair-612179765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88a58985dce3491d8e45e6e468e0e549',ramdisk_id='',reservation_id='r-5c1v27eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1138208404',owner_user_name='tempest-ServerActionsTestOtherA-1138208404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:48:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb823f0374a04657be729eb153160659',uuid=336eb423-89bd-4e51-a2ca-efdc6ded0bf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "708d272c-3434-4525-bcbd-3ee50e71eb47", "address": "fa:16:3e:3f:80:75", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708d272c-34", "ovs_interfaceid": "708d272c-3434-4525-bcbd-3ee50e71eb47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converting VIF {"id": "708d272c-3434-4525-bcbd-3ee50e71eb47", "address": "fa:16:3e:3f:80:75", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708d272c-34", "ovs_interfaceid": "708d272c-3434-4525-bcbd-3ee50e71eb47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:80:75,bridge_name='br-int',has_traffic_filtering=True,id=708d272c-3434-4525-bcbd-3ee50e71eb47,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap708d272c-34') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.objects.instance [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lazy-loading 'pci_devices' on Instance uuid 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:48:25 user nova-compute[74039]:   <uuid>336eb423-89bd-4e51-a2ca-efdc6ded0bf3</uuid>
Oct 20 08:48:25 user nova-compute[74039]:   <name>instance-00000003</name>
Oct 20 08:48:25 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:48:25 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:48:25 user nova-compute[74039]:   <metadata>
Oct 20 08:48:25 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:48:25 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:48:25 user nova-compute[74039]:       <nova:name>tempest-ServerActionsTestOtherA-server-55801458</nova:name>
Oct 20 08:48:25 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:48:25</nova:creationTime>
Oct 20 08:48:25 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:48:25 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:48:25 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:48:25 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:48:25 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:48:25 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:48:25 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:48:25 user nova-compute[74039]:       <nova:owner>
Oct 20 08:48:25 user nova-compute[74039]:         <nova:user uuid="cb823f0374a04657be729eb153160659">tempest-ServerActionsTestOtherA-1138208404-project-member</nova:user>
Oct 20 08:48:25 user nova-compute[74039]:         <nova:project uuid="88a58985dce3491d8e45e6e468e0e549">tempest-ServerActionsTestOtherA-1138208404</nova:project>
Oct 20 08:48:25 user nova-compute[74039]:       </nova:owner>
Oct 20 08:48:25 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:48:25 user nova-compute[74039]:       <nova:ports>
Oct 20 08:48:25 user nova-compute[74039]:         <nova:port uuid="708d272c-3434-4525-bcbd-3ee50e71eb47">
Oct 20 08:48:25 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 08:48:25 user nova-compute[74039]:         </nova:port>
Oct 20 08:48:25 user nova-compute[74039]:       </nova:ports>
Oct 20 08:48:25 user nova-compute[74039]:     </nova:instance>
Oct 20 08:48:25 user nova-compute[74039]:   </metadata>
Oct 20 08:48:25 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:48:25 user nova-compute[74039]:     <system>
Oct 20 08:48:25 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:48:25 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:48:25 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:48:25 user nova-compute[74039]:       <entry name="serial">336eb423-89bd-4e51-a2ca-efdc6ded0bf3</entry>
Oct 20 08:48:25 user nova-compute[74039]:       <entry name="uuid">336eb423-89bd-4e51-a2ca-efdc6ded0bf3</entry>
Oct 20 08:48:25 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:48:25 user nova-compute[74039]:     </system>
Oct 20 08:48:25 user nova-compute[74039]:   </sysinfo>
Oct 20 08:48:25 user nova-compute[74039]:   <os>
Oct 20 08:48:25 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:48:25 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:48:25 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:48:25 user nova-compute[74039]:   </os>
Oct 20 08:48:25 user nova-compute[74039]:   <features>
Oct 20 08:48:25 user nova-compute[74039]:     <acpi/>
Oct 20 08:48:25 user nova-compute[74039]:     <apic/>
Oct 20 08:48:25 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:48:25 user nova-compute[74039]:   </features>
Oct 20 08:48:25 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:48:25 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:48:25 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:48:25 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:48:25 user nova-compute[74039]:   </clock>
Oct 20 08:48:25 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:48:25 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:48:25 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:48:25 user nova-compute[74039]:   </cpu>
Oct 20 08:48:25 user nova-compute[74039]:   <devices>
Oct 20 08:48:25 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:48:25 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:48:25 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk"/>
Oct 20 08:48:25 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:48:25 user nova-compute[74039]:     </disk>
Oct 20 08:48:25 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:48:25 user nova-compute[74039]:       <mac address="fa:16:3e:3f:80:75"/>
Oct 20 08:48:25 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:48:25 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:48:25 user nova-compute[74039]:       <target dev="tap708d272c-34"/>
Oct 20 08:48:25 user nova-compute[74039]:     </interface>
Oct 20 08:48:25 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:48:25 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/console.log" append="off"/>
Oct 20 08:48:25 user nova-compute[74039]:     </serial>
Oct 20 08:48:25 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:48:25 user nova-compute[74039]:     <video>
Oct 20 08:48:25 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:48:25 user nova-compute[74039]:     </video>
Oct 20 08:48:25 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:48:25 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:48:25 user nova-compute[74039]:     </rng>
Oct 20 08:48:25 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:48:25 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:48:25 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:48:25 user nova-compute[74039]:     </memballoon>
Oct 20 08:48:25 user nova-compute[74039]:   </devices>
Oct 20 08:48:25 user nova-compute[74039]: </domain>
Oct 20 08:48:25 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:48:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-55801458',display_name='tempest-ServerActionsTestOtherA-server-55801458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-55801458',id=3,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyyJ62onAPVNIcWwPgu8Qk09h8heuIgT4K5VQCSSgQo1m6HsMw9upnfKrs0KtZmErwiBvOSQvzot9EsqbPyLMmcaHuqRr6HWOREqecRp8rh7oJxELHXOR3Is97nl7PEUA==',key_name='tempest-keypair-612179765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88a58985dce3491d8e45e6e468e0e549',ramdisk_id='',reservation_id='r-5c1v27eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1138208404',owner_user_name='tempest-ServerActionsTestOtherA-1138208404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:48:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb823f0374a04657be729eb153160659',uuid=336eb423-89bd-4e51-a2ca-efdc6ded0bf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "708d272c-3434-4525-bcbd-3ee50e71eb47", "address": "fa:16:3e:3f:80:75", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708d272c-34", "ovs_interfaceid": "708d272c-3434-4525-bcbd-3ee50e71eb47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converting VIF {"id": "708d272c-3434-4525-bcbd-3ee50e71eb47", "address": "fa:16:3e:3f:80:75", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708d272c-34", "ovs_interfaceid": "708d272c-3434-4525-bcbd-3ee50e71eb47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:80:75,bridge_name='br-int',has_traffic_filtering=True,id=708d272c-3434-4525-bcbd-3ee50e71eb47,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap708d272c-34') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG os_vif [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:80:75,bridge_name='br-int',has_traffic_filtering=True,id=708d272c-3434-4525-bcbd-3ee50e71eb47,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap708d272c-34') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e65f67d7-c81f-5ce4-9481-a27a67197cf4', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap708d272c-34, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap708d272c-34, col_values=(('qos', UUID('248387a2-94aa-439c-beb7-4a38c0de12ea')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap708d272c-34, col_values=(('external_ids', {'iface-id': '708d272c-3434-4525-bcbd-3ee50e71eb47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:80:75', 'vm-uuid': '336eb423-89bd-4e51-a2ca-efdc6ded0bf3'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:26 user nova-compute[74039]: INFO os_vif [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:80:75,bridge_name='br-int',has_traffic_filtering=True,id=708d272c-3434-4525-bcbd-3ee50e71eb47,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap708d272c-34')
Oct 20 08:48:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] No VIF found with MAC fa:16:3e:3f:80:75, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Successfully updated port: 903853f8-c5ee-49d4-9896-b50b043842c6 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Acquiring lock "refresh_cache-971fb41b-7fce-4ffe-b785-5d86f435004a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Acquired lock "refresh_cache-971fb41b-7fce-4ffe-b785-5d86f435004a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-78bcf893-4d30-4740-b054-fa1a91e4c215 req-aaec4aa4-d13f-412e-a7af-9956ddf00502 service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Received event network-changed-903853f8-c5ee-49d4-9896-b50b043842c6 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-78bcf893-4d30-4740-b054-fa1a91e4c215 req-aaec4aa4-d13f-412e-a7af-9956ddf00502 service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Refreshing instance network info cache due to event network-changed-903853f8-c5ee-49d4-9896-b50b043842c6. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:48:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-78bcf893-4d30-4740-b054-fa1a91e4c215 req-aaec4aa4-d13f-412e-a7af-9956ddf00502 service nova] Acquiring lock "refresh_cache-971fb41b-7fce-4ffe-b785-5d86f435004a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.network.neutron [req-b119a489-4deb-4bb3-a65d-82c99d4c32c1 req-b56962a4-d887-4e63-bd56-822de8a712b6 service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Updated VIF entry in instance network info cache for port 708d272c-3434-4525-bcbd-3ee50e71eb47. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.network.neutron [req-b119a489-4deb-4bb3-a65d-82c99d4c32c1 req-b56962a4-d887-4e63-bd56-822de8a712b6 service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Updating instance_info_cache with network_info: [{"id": "708d272c-3434-4525-bcbd-3ee50e71eb47", "address": "fa:16:3e:3f:80:75", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708d272c-34", "ovs_interfaceid": "708d272c-3434-4525-bcbd-3ee50e71eb47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b119a489-4deb-4bb3-a65d-82c99d4c32c1 req-b56962a4-d887-4e63-bd56-822de8a712b6 service nova] Releasing lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.network.neutron [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Updating instance_info_cache with network_info: [{"id": "903853f8-c5ee-49d4-9896-b50b043842c6", "address": "fa:16:3e:58:48:ef", "network": {"id": "298357dd-0031-4c33-8c72-269e894c8d86", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-324557364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7efa953a4a4049925485acdb855247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903853f8-c5", "ovs_interfaceid": "903853f8-c5ee-49d4-9896-b50b043842c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Releasing lock "refresh_cache-971fb41b-7fce-4ffe-b785-5d86f435004a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.compute.manager [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Instance network_info: |[{"id": "903853f8-c5ee-49d4-9896-b50b043842c6", "address": "fa:16:3e:58:48:ef", "network": {"id": "298357dd-0031-4c33-8c72-269e894c8d86", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-324557364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7efa953a4a4049925485acdb855247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903853f8-c5", "ovs_interfaceid": "903853f8-c5ee-49d4-9896-b50b043842c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-78bcf893-4d30-4740-b054-fa1a91e4c215 req-aaec4aa4-d13f-412e-a7af-9956ddf00502 service nova] Acquired lock "refresh_cache-971fb41b-7fce-4ffe-b785-5d86f435004a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.network.neutron [req-78bcf893-4d30-4740-b054-fa1a91e4c215 req-aaec4aa4-d13f-412e-a7af-9956ddf00502 service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Refreshing network info cache for port 903853f8-c5ee-49d4-9896-b50b043842c6 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Start _get_guest_xml network_info=[{"id": "903853f8-c5ee-49d4-9896-b50b043842c6", "address": "fa:16:3e:58:48:ef", "network": {"id": "298357dd-0031-4c33-8c72-269e894c8d86", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-324557364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7efa953a4a4049925485acdb855247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903853f8-c5", "ovs_interfaceid": "903853f8-c5ee-49d4-9896-b50b043842c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:48:27 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:48:27 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:48:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-356284458',display_name='tempest-ServerStableDeviceRescueTest-server-356284458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-356284458',id=4,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJT6FK2nhGTdlNkREBn5eMAKyz3qTKNW0EHGg+clbn3CqVv1EVcSfz812n6Was/ZqxpV8bACdIlrFOPm+Iaow1Gv76MgRztK8cKPzP4Gl+n8K2P7JhSfNr1eBo6tooy5Pg==',key_name='tempest-keypair-1573659215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b7efa953a4a4049925485acdb855247',ramdisk_id='',reservation_id='r-la35b7v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-767632424',owner_user_name='tempest-ServerStableDeviceRescueTest-767632424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:48:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09534beb690444d6bf63e532958db714',uuid=971fb41b-7fce-4ffe-b785-5d86f435004a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "903853f8-c5ee-49d4-9896-b50b043842c6", "address": "fa:16:3e:58:48:ef", "network": {"id": "298357dd-0031-4c33-8c72-269e894c8d86", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-324557364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7efa953a4a4049925485acdb855247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903853f8-c5", "ovs_interfaceid": "903853f8-c5ee-49d4-9896-b50b043842c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Converting VIF {"id": "903853f8-c5ee-49d4-9896-b50b043842c6", "address": "fa:16:3e:58:48:ef", "network": {"id": "298357dd-0031-4c33-8c72-269e894c8d86", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-324557364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7efa953a4a4049925485acdb855247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903853f8-c5", "ovs_interfaceid": "903853f8-c5ee-49d4-9896-b50b043842c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:48:ef,bridge_name='br-int',has_traffic_filtering=True,id=903853f8-c5ee-49d4-9896-b50b043842c6,network=Network(298357dd-0031-4c33-8c72-269e894c8d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903853f8-c5') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.objects.instance [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lazy-loading 'pci_devices' on Instance uuid 971fb41b-7fce-4ffe-b785-5d86f435004a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:48:27 user nova-compute[74039]:   <uuid>971fb41b-7fce-4ffe-b785-5d86f435004a</uuid>
Oct 20 08:48:27 user nova-compute[74039]:   <name>instance-00000004</name>
Oct 20 08:48:27 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:48:27 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:48:27 user nova-compute[74039]:   <metadata>
Oct 20 08:48:27 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:48:27 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:48:27 user nova-compute[74039]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-356284458</nova:name>
Oct 20 08:48:27 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:48:27</nova:creationTime>
Oct 20 08:48:27 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:48:27 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:48:27 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:48:27 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:48:27 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:48:27 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:48:27 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:48:27 user nova-compute[74039]:       <nova:owner>
Oct 20 08:48:27 user nova-compute[74039]:         <nova:user uuid="09534beb690444d6bf63e532958db714">tempest-ServerStableDeviceRescueTest-767632424-project-member</nova:user>
Oct 20 08:48:27 user nova-compute[74039]:         <nova:project uuid="8b7efa953a4a4049925485acdb855247">tempest-ServerStableDeviceRescueTest-767632424</nova:project>
Oct 20 08:48:27 user nova-compute[74039]:       </nova:owner>
Oct 20 08:48:27 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:48:27 user nova-compute[74039]:       <nova:ports>
Oct 20 08:48:27 user nova-compute[74039]:         <nova:port uuid="903853f8-c5ee-49d4-9896-b50b043842c6">
Oct 20 08:48:27 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 08:48:27 user nova-compute[74039]:         </nova:port>
Oct 20 08:48:27 user nova-compute[74039]:       </nova:ports>
Oct 20 08:48:27 user nova-compute[74039]:     </nova:instance>
Oct 20 08:48:27 user nova-compute[74039]:   </metadata>
Oct 20 08:48:27 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:48:27 user nova-compute[74039]:     <system>
Oct 20 08:48:27 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:48:27 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:48:27 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:48:27 user nova-compute[74039]:       <entry name="serial">971fb41b-7fce-4ffe-b785-5d86f435004a</entry>
Oct 20 08:48:27 user nova-compute[74039]:       <entry name="uuid">971fb41b-7fce-4ffe-b785-5d86f435004a</entry>
Oct 20 08:48:27 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:48:27 user nova-compute[74039]:     </system>
Oct 20 08:48:27 user nova-compute[74039]:   </sysinfo>
Oct 20 08:48:27 user nova-compute[74039]:   <os>
Oct 20 08:48:27 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:48:27 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:48:27 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:48:27 user nova-compute[74039]:   </os>
Oct 20 08:48:27 user nova-compute[74039]:   <features>
Oct 20 08:48:27 user nova-compute[74039]:     <acpi/>
Oct 20 08:48:27 user nova-compute[74039]:     <apic/>
Oct 20 08:48:27 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:48:27 user nova-compute[74039]:   </features>
Oct 20 08:48:27 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:48:27 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:48:27 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:48:27 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:48:27 user nova-compute[74039]:   </clock>
Oct 20 08:48:27 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:48:27 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:48:27 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:48:27 user nova-compute[74039]:   </cpu>
Oct 20 08:48:27 user nova-compute[74039]:   <devices>
Oct 20 08:48:27 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:48:27 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:48:27 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk"/>
Oct 20 08:48:27 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:48:27 user nova-compute[74039]:     </disk>
Oct 20 08:48:27 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:48:27 user nova-compute[74039]:       <mac address="fa:16:3e:58:48:ef"/>
Oct 20 08:48:27 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:48:27 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:48:27 user nova-compute[74039]:       <target dev="tap903853f8-c5"/>
Oct 20 08:48:27 user nova-compute[74039]:     </interface>
Oct 20 08:48:27 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:48:27 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/console.log" append="off"/>
Oct 20 08:48:27 user nova-compute[74039]:     </serial>
Oct 20 08:48:27 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:48:27 user nova-compute[74039]:     <video>
Oct 20 08:48:27 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:48:27 user nova-compute[74039]:     </video>
Oct 20 08:48:27 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:48:27 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:48:27 user nova-compute[74039]:     </rng>
Oct 20 08:48:27 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:48:27 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:48:27 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:48:27 user nova-compute[74039]:     </memballoon>
Oct 20 08:48:27 user nova-compute[74039]:   </devices>
Oct 20 08:48:27 user nova-compute[74039]: </domain>
Oct 20 08:48:27 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:48:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-356284458',display_name='tempest-ServerStableDeviceRescueTest-server-356284458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-356284458',id=4,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJT6FK2nhGTdlNkREBn5eMAKyz3qTKNW0EHGg+clbn3CqVv1EVcSfz812n6Was/ZqxpV8bACdIlrFOPm+Iaow1Gv76MgRztK8cKPzP4Gl+n8K2P7JhSfNr1eBo6tooy5Pg==',key_name='tempest-keypair-1573659215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b7efa953a4a4049925485acdb855247',ramdisk_id='',reservation_id='r-la35b7v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-767632424',owner_user_name='tempest-ServerStableDeviceRescueTest-767632424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:48:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09534beb690444d6bf63e532958db714',uuid=971fb41b-7fce-4ffe-b785-5d86f435004a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "903853f8-c5ee-49d4-9896-b50b043842c6", "address": "fa:16:3e:58:48:ef", "network": {"id": "298357dd-0031-4c33-8c72-269e894c8d86", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-324557364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7efa953a4a4049925485acdb855247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903853f8-c5", "ovs_interfaceid": "903853f8-c5ee-49d4-9896-b50b043842c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Converting VIF {"id": "903853f8-c5ee-49d4-9896-b50b043842c6", "address": "fa:16:3e:58:48:ef", "network": {"id": "298357dd-0031-4c33-8c72-269e894c8d86", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-324557364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7efa953a4a4049925485acdb855247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903853f8-c5", "ovs_interfaceid": "903853f8-c5ee-49d4-9896-b50b043842c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:48:ef,bridge_name='br-int',has_traffic_filtering=True,id=903853f8-c5ee-49d4-9896-b50b043842c6,network=Network(298357dd-0031-4c33-8c72-269e894c8d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903853f8-c5') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG os_vif [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:48:ef,bridge_name='br-int',has_traffic_filtering=True,id=903853f8-c5ee-49d4-9896-b50b043842c6,network=Network(298357dd-0031-4c33-8c72-269e894c8d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903853f8-c5') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ab78c48-8523-5f71-b1b8-588b244b0ed6', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap903853f8-c5, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap903853f8-c5, col_values=(('qos', UUID('a4baa333-0ee7-4794-8499-16a943dffbb5')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap903853f8-c5, col_values=(('external_ids', {'iface-id': '903853f8-c5ee-49d4-9896-b50b043842c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:48:ef', 'vm-uuid': '971fb41b-7fce-4ffe-b785-5d86f435004a'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:27 user nova-compute[74039]: INFO os_vif [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:48:ef,bridge_name='br-int',has_traffic_filtering=True,id=903853f8-c5ee-49d4-9896-b50b043842c6,network=Network(298357dd-0031-4c33-8c72-269e894c8d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903853f8-c5')
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:48:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] No VIF found with MAC fa:16:3e:58:48:ef, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:48:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:28 user nova-compute[74039]: DEBUG nova.network.neutron [req-78bcf893-4d30-4740-b054-fa1a91e4c215 req-aaec4aa4-d13f-412e-a7af-9956ddf00502 service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Updated VIF entry in instance network info cache for port 903853f8-c5ee-49d4-9896-b50b043842c6. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:48:28 user nova-compute[74039]: DEBUG nova.network.neutron [req-78bcf893-4d30-4740-b054-fa1a91e4c215 req-aaec4aa4-d13f-412e-a7af-9956ddf00502 service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Updating instance_info_cache with network_info: [{"id": "903853f8-c5ee-49d4-9896-b50b043842c6", "address": "fa:16:3e:58:48:ef", "network": {"id": "298357dd-0031-4c33-8c72-269e894c8d86", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-324557364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7efa953a4a4049925485acdb855247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903853f8-c5", "ovs_interfaceid": "903853f8-c5ee-49d4-9896-b50b043842c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:48:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-78bcf893-4d30-4740-b054-fa1a91e4c215 req-aaec4aa4-d13f-412e-a7af-9956ddf00502 service nova] Releasing lock "refresh_cache-971fb41b-7fce-4ffe-b785-5d86f435004a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:48:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.compute.manager [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:48:33 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Instance spawned successfully.
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:48:33 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Instance spawned successfully.
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:48:33 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Instance spawned successfully.
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.compute.manager [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Instance spawned successfully.
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:33 user nova-compute[74039]: INFO nova.compute.manager [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Took 14.81 seconds to spawn the instance on the hypervisor.
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:48:33 user nova-compute[74039]: INFO nova.compute.manager [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Took 14.26 seconds to spawn the instance on the hypervisor.
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:48:33 user nova-compute[74039]: INFO nova.compute.manager [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Took 13.03 seconds to spawn the instance on the hypervisor.
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.compute.manager [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:48:33 user nova-compute[74039]: INFO nova.compute.manager [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Took 17.20 seconds to spawn the instance on the hypervisor.
Oct 20 08:48:33 user nova-compute[74039]: DEBUG nova.compute.manager [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:48:33 user nova-compute[74039]: INFO nova.compute.manager [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Took 15.16 seconds to build instance.
Oct 20 08:48:34 user nova-compute[74039]: INFO nova.compute.manager [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Took 15.78 seconds to build instance.
Oct 20 08:48:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b227056b-8a01-4a66-8c7c-600321512236 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.316s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:34 user nova-compute[74039]: INFO nova.compute.manager [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Took 18.28 seconds to build instance.
Oct 20 08:48:34 user nova-compute[74039]: INFO nova.compute.manager [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Took 14.46 seconds to build instance.
Oct 20 08:48:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d799d021-0905-4e91-88af-dd698b455439 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.055s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6498c068-ea6a-4843-8343-148ae1aa5581 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.551s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a126e0ea-77a1-4164-b90e-6c7a7d8beff9 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lock "971fb41b-7fce-4ffe-b785-5d86f435004a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.603s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Acquiring lock "ff1bca5e-9337-466c-866d-e9c91cf9200c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "ff1bca5e-9337-466c-866d-e9c91cf9200c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:38 user nova-compute[74039]: DEBUG nova.compute.manager [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 08:48:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:39 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:48:39 user nova-compute[74039]: INFO nova.compute.claims [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Claim successful on node user
Oct 20 08:48:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:39 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:48:39 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:48:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.915s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:39 user nova-compute[74039]: DEBUG nova.compute.manager [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 08:48:40 user nova-compute[74039]: DEBUG nova.compute.manager [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 08:48:40 user nova-compute[74039]: DEBUG nova.network.neutron [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:48:40 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 20 08:48:40 user nova-compute[74039]: DEBUG nova.compute.manager [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 08:48:40 user nova-compute[74039]: DEBUG nova.policy [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55453231169b4a2596ede6152645b252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de66876449e146b797bf3d5d95086a55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:48:40 user nova-compute[74039]: DEBUG nova.compute.manager [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 08:48:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:48:40 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Creating image(s)
Oct 20 08:48:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "/opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "/opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Acquiring lock "e17ca3b8a40e70597257dbe645f83d904004d426" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "e17ca3b8a40e70597257dbe645f83d904004d426" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e17ca3b8a40e70597257dbe645f83d904004d426.part --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e17ca3b8a40e70597257dbe645f83d904004d426.part --force-share --output=json" returned: 0 in 0.224s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:41 user nova-compute[74039]: DEBUG nova.virt.images [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] e30bed4e-9f69-44ae-8c79-3669982fa069 was qcow2, converting to raw {{(pid=74039) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 08:48:41 user nova-compute[74039]: DEBUG nova.privsep.utils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74039) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 08:48:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e17ca3b8a40e70597257dbe645f83d904004d426.part /opt/stack/data/nova/instances/_base/e17ca3b8a40e70597257dbe645f83d904004d426.converted {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e17ca3b8a40e70597257dbe645f83d904004d426.part /opt/stack/data/nova/instances/_base/e17ca3b8a40e70597257dbe645f83d904004d426.converted" returned: 0 in 0.197s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e17ca3b8a40e70597257dbe645f83d904004d426.converted --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e17ca3b8a40e70597257dbe645f83d904004d426.converted --force-share --output=json" returned: 0 in 0.249s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "e17ca3b8a40e70597257dbe645f83d904004d426" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.273s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e17ca3b8a40e70597257dbe645f83d904004d426 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e17ca3b8a40e70597257dbe645f83d904004d426 --force-share --output=json" returned: 0 in 0.234s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Acquiring lock "e17ca3b8a40e70597257dbe645f83d904004d426" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "e17ca3b8a40e70597257dbe645f83d904004d426" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e17ca3b8a40e70597257dbe645f83d904004d426 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG nova.network.neutron [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Successfully created port: ca5407cc-32fc-44c3-a80d-ff65f007eeb8 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e17ca3b8a40e70597257dbe645f83d904004d426 --force-share --output=json" returned: 0 in 0.221s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e17ca3b8a40e70597257dbe645f83d904004d426,backing_fmt=raw /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e17ca3b8a40e70597257dbe645f83d904004d426,backing_fmt=raw /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk 1073741824" returned: 0 in 0.064s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "e17ca3b8a40e70597257dbe645f83d904004d426" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e17ca3b8a40e70597257dbe645f83d904004d426 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e17ca3b8a40e70597257dbe645f83d904004d426 --force-share --output=json" returned: 0 in 0.281s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Cannot resize image /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Ensure instance console log exists: /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG nova.network.neutron [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Successfully updated port: ca5407cc-32fc-44c3-a80d-ff65f007eeb8 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Acquiring lock "refresh_cache-ff1bca5e-9337-466c-866d-e9c91cf9200c" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Acquired lock "refresh_cache-ff1bca5e-9337-466c-866d-e9c91cf9200c" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:48:42 user nova-compute[74039]: DEBUG nova.network.neutron [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.compute.manager [req-ca4747a2-da14-4f41-b1c3-f4937d0c55c8 req-90512b45-d975-4d3a-90a8-536680c92272 service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Received event network-changed-ca5407cc-32fc-44c3-a80d-ff65f007eeb8 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.compute.manager [req-ca4747a2-da14-4f41-b1c3-f4937d0c55c8 req-90512b45-d975-4d3a-90a8-536680c92272 service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Refreshing instance network info cache due to event network-changed-ca5407cc-32fc-44c3-a80d-ff65f007eeb8. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ca4747a2-da14-4f41-b1c3-f4937d0c55c8 req-90512b45-d975-4d3a-90a8-536680c92272 service nova] Acquiring lock "refresh_cache-ff1bca5e-9337-466c-866d-e9c91cf9200c" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.network.neutron [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.network.neutron [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Updating instance_info_cache with network_info: [{"id": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "address": "fa:16:3e:41:ce:3e", "network": {"id": "66bd8b72-b934-4e08-b441-7b206e30191f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-800457541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de66876449e146b797bf3d5d95086a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5407cc-32", "ovs_interfaceid": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Releasing lock "refresh_cache-ff1bca5e-9337-466c-866d-e9c91cf9200c" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.compute.manager [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Instance network_info: |[{"id": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "address": "fa:16:3e:41:ce:3e", "network": {"id": "66bd8b72-b934-4e08-b441-7b206e30191f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-800457541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de66876449e146b797bf3d5d95086a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5407cc-32", "ovs_interfaceid": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ca4747a2-da14-4f41-b1c3-f4937d0c55c8 req-90512b45-d975-4d3a-90a8-536680c92272 service nova] Acquired lock "refresh_cache-ff1bca5e-9337-466c-866d-e9c91cf9200c" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.network.neutron [req-ca4747a2-da14-4f41-b1c3-f4937d0c55c8 req-90512b45-d975-4d3a-90a8-536680c92272 service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Refreshing network info cache for port ca5407cc-32fc-44c3-a80d-ff65f007eeb8 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Start _get_guest_xml network_info=[{"id": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "address": "fa:16:3e:41:ce:3e", "network": {"id": "66bd8b72-b934-4e08-b441-7b206e30191f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-800457541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de66876449e146b797bf3d5d95086a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5407cc-32", "ovs_interfaceid": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:48:31Z,direct_url=<?>,disk_format='qcow2',id=e30bed4e-9f69-44ae-8c79-3669982fa069,min_disk=0,min_ram=0,name='',owner='d6d76388758446a3ac0ba75099e61385',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:48:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'scsi', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/sda', 'image_id': 'e30bed4e-9f69-44ae-8c79-3669982fa069'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:48:43 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:48:43 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:48:31Z,direct_url=<?>,disk_format='qcow2',id=e30bed4e-9f69-44ae-8c79-3669982fa069,min_disk=0,min_ram=0,name='',owner='d6d76388758446a3ac0ba75099e61385',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:48:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-107806836',display_name='tempest-AttachSCSIVolumeTestJSON-server-107806836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-107806836',id=5,image_ref='e30bed4e-9f69-44ae-8c79-3669982fa069',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1eJZpjJcKITE4MnIUSLiKCtuUN9PQRHqIp3FF1Y6JPo7l5wHvh1Txjy6yPkArIu0YeSYOTZvf5Nxw9bCro4Cq91Z9fs5bFmQSewWaTR7HjS4BnX+lLR+1JMONO+H3I6A==',key_name='tempest-keypair-479173428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de66876449e146b797bf3d5d95086a55',ramdisk_id='',reservation_id='r-8fjcchyd',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e30bed4e-9f69-44ae-8c79-3669982fa069',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-993810269',owner_user_name='tempest-AttachSCSIVolumeTestJSON-993810269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:48:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55453231169b4a2596ede6152645b252',uuid=ff1bca5e-9337-466c-866d-e9c91cf9200c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "address": "fa:16:3e:41:ce:3e", "network": {"id": "66bd8b72-b934-4e08-b441-7b206e30191f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-800457541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de66876449e146b797bf3d5d95086a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5407cc-32", "ovs_interfaceid": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Converting VIF {"id": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "address": "fa:16:3e:41:ce:3e", "network": {"id": "66bd8b72-b934-4e08-b441-7b206e30191f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-800457541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de66876449e146b797bf3d5d95086a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5407cc-32", "ovs_interfaceid": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:ce:3e,bridge_name='br-int',has_traffic_filtering=True,id=ca5407cc-32fc-44c3-a80d-ff65f007eeb8,network=Network(66bd8b72-b934-4e08-b441-7b206e30191f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5407cc-32') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.objects.instance [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lazy-loading 'pci_devices' on Instance uuid ff1bca5e-9337-466c-866d-e9c91cf9200c {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:48:43 user nova-compute[74039]:   <uuid>ff1bca5e-9337-466c-866d-e9c91cf9200c</uuid>
Oct 20 08:48:43 user nova-compute[74039]:   <name>instance-00000005</name>
Oct 20 08:48:43 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:48:43 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:48:43 user nova-compute[74039]:   <metadata>
Oct 20 08:48:43 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:48:43 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:48:43 user nova-compute[74039]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-107806836</nova:name>
Oct 20 08:48:43 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:48:43</nova:creationTime>
Oct 20 08:48:43 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:48:43 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:48:43 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:48:43 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:48:43 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:48:43 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:48:43 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:48:43 user nova-compute[74039]:       <nova:owner>
Oct 20 08:48:43 user nova-compute[74039]:         <nova:user uuid="55453231169b4a2596ede6152645b252">tempest-AttachSCSIVolumeTestJSON-993810269-project-member</nova:user>
Oct 20 08:48:43 user nova-compute[74039]:         <nova:project uuid="de66876449e146b797bf3d5d95086a55">tempest-AttachSCSIVolumeTestJSON-993810269</nova:project>
Oct 20 08:48:43 user nova-compute[74039]:       </nova:owner>
Oct 20 08:48:43 user nova-compute[74039]:       <nova:root type="image" uuid="e30bed4e-9f69-44ae-8c79-3669982fa069"/>
Oct 20 08:48:43 user nova-compute[74039]:       <nova:ports>
Oct 20 08:48:43 user nova-compute[74039]:         <nova:port uuid="ca5407cc-32fc-44c3-a80d-ff65f007eeb8">
Oct 20 08:48:43 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 08:48:43 user nova-compute[74039]:         </nova:port>
Oct 20 08:48:43 user nova-compute[74039]:       </nova:ports>
Oct 20 08:48:43 user nova-compute[74039]:     </nova:instance>
Oct 20 08:48:43 user nova-compute[74039]:   </metadata>
Oct 20 08:48:43 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:48:43 user nova-compute[74039]:     <system>
Oct 20 08:48:43 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:48:43 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:48:43 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:48:43 user nova-compute[74039]:       <entry name="serial">ff1bca5e-9337-466c-866d-e9c91cf9200c</entry>
Oct 20 08:48:43 user nova-compute[74039]:       <entry name="uuid">ff1bca5e-9337-466c-866d-e9c91cf9200c</entry>
Oct 20 08:48:43 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:48:43 user nova-compute[74039]:     </system>
Oct 20 08:48:43 user nova-compute[74039]:   </sysinfo>
Oct 20 08:48:43 user nova-compute[74039]:   <os>
Oct 20 08:48:43 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:48:43 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:48:43 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:48:43 user nova-compute[74039]:   </os>
Oct 20 08:48:43 user nova-compute[74039]:   <features>
Oct 20 08:48:43 user nova-compute[74039]:     <acpi/>
Oct 20 08:48:43 user nova-compute[74039]:     <apic/>
Oct 20 08:48:43 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:48:43 user nova-compute[74039]:   </features>
Oct 20 08:48:43 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:48:43 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:48:43 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:48:43 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:48:43 user nova-compute[74039]:   </clock>
Oct 20 08:48:43 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:48:43 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:48:43 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:48:43 user nova-compute[74039]:   </cpu>
Oct 20 08:48:43 user nova-compute[74039]:   <devices>
Oct 20 08:48:43 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:48:43 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:48:43 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk"/>
Oct 20 08:48:43 user nova-compute[74039]:       <target dev="sda" bus="scsi"/>
Oct 20 08:48:43 user nova-compute[74039]:       <address type="drive" controller="0" unit="0"/>
Oct 20 08:48:43 user nova-compute[74039]:     </disk>
Oct 20 08:48:43 user nova-compute[74039]:     <disk type="file" device="cdrom">
Oct 20 08:48:43 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 08:48:43 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk.config"/>
Oct 20 08:48:43 user nova-compute[74039]:       <target dev="sdb" bus="scsi"/>
Oct 20 08:48:43 user nova-compute[74039]:       <address type="drive" controller="0" unit="1"/>
Oct 20 08:48:43 user nova-compute[74039]:     </disk>
Oct 20 08:48:43 user nova-compute[74039]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 20 08:48:43 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:48:43 user nova-compute[74039]:       <mac address="fa:16:3e:41:ce:3e"/>
Oct 20 08:48:43 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:48:43 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:48:43 user nova-compute[74039]:       <target dev="tapca5407cc-32"/>
Oct 20 08:48:43 user nova-compute[74039]:     </interface>
Oct 20 08:48:43 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:48:43 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/console.log" append="off"/>
Oct 20 08:48:43 user nova-compute[74039]:     </serial>
Oct 20 08:48:43 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:48:43 user nova-compute[74039]:     <video>
Oct 20 08:48:43 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:48:43 user nova-compute[74039]:     </video>
Oct 20 08:48:43 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:48:43 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:48:43 user nova-compute[74039]:     </rng>
Oct 20 08:48:43 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:48:43 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:48:43 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:48:43 user nova-compute[74039]:     </memballoon>
Oct 20 08:48:43 user nova-compute[74039]:   </devices>
Oct 20 08:48:43 user nova-compute[74039]: </domain>
Oct 20 08:48:43 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-107806836',display_name='tempest-AttachSCSIVolumeTestJSON-server-107806836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-107806836',id=5,image_ref='e30bed4e-9f69-44ae-8c79-3669982fa069',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1eJZpjJcKITE4MnIUSLiKCtuUN9PQRHqIp3FF1Y6JPo7l5wHvh1Txjy6yPkArIu0YeSYOTZvf5Nxw9bCro4Cq91Z9fs5bFmQSewWaTR7HjS4BnX+lLR+1JMONO+H3I6A==',key_name='tempest-keypair-479173428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de66876449e146b797bf3d5d95086a55',ramdisk_id='',reservation_id='r-8fjcchyd',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e30bed4e-9f69-44ae-8c79-3669982fa069',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-993810269',owner_user_name='tempest-AttachSCSIVolumeTestJSON-993810269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:48:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55453231169b4a2596ede6152645b252',uuid=ff1bca5e-9337-466c-866d-e9c91cf9200c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "address": "fa:16:3e:41:ce:3e", "network": {"id": "66bd8b72-b934-4e08-b441-7b206e30191f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-800457541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de66876449e146b797bf3d5d95086a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5407cc-32", "ovs_interfaceid": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Converting VIF {"id": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "address": "fa:16:3e:41:ce:3e", "network": {"id": "66bd8b72-b934-4e08-b441-7b206e30191f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-800457541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de66876449e146b797bf3d5d95086a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5407cc-32", "ovs_interfaceid": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:ce:3e,bridge_name='br-int',has_traffic_filtering=True,id=ca5407cc-32fc-44c3-a80d-ff65f007eeb8,network=Network(66bd8b72-b934-4e08-b441-7b206e30191f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5407cc-32') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG os_vif [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:ce:3e,bridge_name='br-int',has_traffic_filtering=True,id=ca5407cc-32fc-44c3-a80d-ff65f007eeb8,network=Network(66bd8b72-b934-4e08-b441-7b206e30191f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5407cc-32') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b365ea26-c06b-5ec9-8675-1d38a98a8eba', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca5407cc-32, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca5407cc-32, col_values=(('qos', UUID('8e067dcb-6086-440d-a7a6-820946ff7db7')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca5407cc-32, col_values=(('external_ids', {'iface-id': 'ca5407cc-32fc-44c3-a80d-ff65f007eeb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:ce:3e', 'vm-uuid': 'ff1bca5e-9337-466c-866d-e9c91cf9200c'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:43 user nova-compute[74039]: INFO os_vif [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:ce:3e,bridge_name='br-int',has_traffic_filtering=True,id=ca5407cc-32fc-44c3-a80d-ff65f007eeb8,network=Network(66bd8b72-b934-4e08-b441-7b206e30191f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5407cc-32')
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] No BDM found with device name sda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] No VIF found with MAC fa:16:3e:41:ce:3e, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:48:43 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Using config drive
Oct 20 08:48:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Acquiring lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:44 user nova-compute[74039]: DEBUG nova.compute.manager [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 08:48:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:44 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:48:44 user nova-compute[74039]: INFO nova.compute.claims [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Claim successful on node user
Oct 20 08:48:44 user nova-compute[74039]: DEBUG nova.network.neutron [req-ca4747a2-da14-4f41-b1c3-f4937d0c55c8 req-90512b45-d975-4d3a-90a8-536680c92272 service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Updated VIF entry in instance network info cache for port ca5407cc-32fc-44c3-a80d-ff65f007eeb8. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:48:44 user nova-compute[74039]: DEBUG nova.network.neutron [req-ca4747a2-da14-4f41-b1c3-f4937d0c55c8 req-90512b45-d975-4d3a-90a8-536680c92272 service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Updating instance_info_cache with network_info: [{"id": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "address": "fa:16:3e:41:ce:3e", "network": {"id": "66bd8b72-b934-4e08-b441-7b206e30191f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-800457541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de66876449e146b797bf3d5d95086a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5407cc-32", "ovs_interfaceid": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:48:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ca4747a2-da14-4f41-b1c3-f4937d0c55c8 req-90512b45-d975-4d3a-90a8-536680c92272 service nova] Releasing lock "refresh_cache-ff1bca5e-9337-466c-866d-e9c91cf9200c" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:48:44 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Creating config drive at /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk.config
Oct 20 08:48:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpttudzuhh {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpttudzuhh" returned: 0 in 0.066s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:44 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:48:44 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:48:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:44 user nova-compute[74039]: DEBUG nova.compute.manager [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 08:48:44 user nova-compute[74039]: DEBUG nova.compute.manager [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 08:48:44 user nova-compute[74039]: DEBUG nova.network.neutron [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:48:44 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 08:48:45 user nova-compute[74039]: DEBUG nova.compute.manager [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 08:48:45 user nova-compute[74039]: DEBUG nova.policy [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4558306dac14220ab1b0006eda962de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96471e080e8d4674aadc99f0892074a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:48:45 user nova-compute[74039]: DEBUG nova.compute.manager [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 08:48:45 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:48:45 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Creating image(s)
Oct 20 08:48:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Acquiring lock "/opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "/opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "/opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.193s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk 1073741824" returned: 0 in 0.062s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:45 user nova-compute[74039]: DEBUG nova.network.neutron [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Successfully created port: 32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:48:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.310s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:46 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Checking if we can resize image /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 08:48:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json" returned: 0 in 0.358s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:46 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Cannot resize image /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 08:48:46 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:48:46 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Ensure instance console log exists: /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:48:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.network.neutron [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Successfully updated port: 32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Acquiring lock "refresh_cache-500a0ed6-ac37-4274-a8f2-2545c270e24b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Acquired lock "refresh_cache-500a0ed6-ac37-4274-a8f2-2545c270e24b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.network.neutron [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.compute.manager [req-ec164e86-7b32-4add-9f98-1f09fed29626 req-77d72926-6e20-4df7-9e00-f3e8ac510400 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Received event network-changed-32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.compute.manager [req-ec164e86-7b32-4add-9f98-1f09fed29626 req-77d72926-6e20-4df7-9e00-f3e8ac510400 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Refreshing instance network info cache due to event network-changed-32230627-2f50-465b-a608-a88969f6408e. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ec164e86-7b32-4add-9f98-1f09fed29626 req-77d72926-6e20-4df7-9e00-f3e8ac510400 service nova] Acquiring lock "refresh_cache-500a0ed6-ac37-4274-a8f2-2545c270e24b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.network.neutron [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.network.neutron [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Updating instance_info_cache with network_info: [{"id": "32230627-2f50-465b-a608-a88969f6408e", "address": "fa:16:3e:d0:00:0b", "network": {"id": "0e446eb7-aecd-4543-8e09-3b3805b2a25c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-708280870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96471e080e8d4674aadc99f0892074a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32230627-2f", "ovs_interfaceid": "32230627-2f50-465b-a608-a88969f6408e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Releasing lock "refresh_cache-500a0ed6-ac37-4274-a8f2-2545c270e24b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.compute.manager [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Instance network_info: |[{"id": "32230627-2f50-465b-a608-a88969f6408e", "address": "fa:16:3e:d0:00:0b", "network": {"id": "0e446eb7-aecd-4543-8e09-3b3805b2a25c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-708280870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96471e080e8d4674aadc99f0892074a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32230627-2f", "ovs_interfaceid": "32230627-2f50-465b-a608-a88969f6408e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ec164e86-7b32-4add-9f98-1f09fed29626 req-77d72926-6e20-4df7-9e00-f3e8ac510400 service nova] Acquired lock "refresh_cache-500a0ed6-ac37-4274-a8f2-2545c270e24b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.network.neutron [req-ec164e86-7b32-4add-9f98-1f09fed29626 req-77d72926-6e20-4df7-9e00-f3e8ac510400 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Refreshing network info cache for port 32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Start _get_guest_xml network_info=[{"id": "32230627-2f50-465b-a608-a88969f6408e", "address": "fa:16:3e:d0:00:0b", "network": {"id": "0e446eb7-aecd-4543-8e09-3b3805b2a25c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-708280870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96471e080e8d4674aadc99f0892074a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32230627-2f", "ovs_interfaceid": "32230627-2f50-465b-a608-a88969f6408e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:48:47 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:48:47 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:48:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1172293144',display_name='tempest-TestVolumeSwap-server-1172293144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1172293144',id=6,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRToobScdUtb7+3jcjSVHCJFxZqv94QJIssqH90Y7pl1sV4pKMkmRJsjji0AWhgMeZy/foe0zo/uxuGWroHhJGC83k5pE7k23SX95ebtFtmvCGOnEFWukNkghf9brY2SQ==',key_name='tempest-keypair-1350799647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96471e080e8d4674aadc99f0892074a0',ramdisk_id='',reservation_id='r-vqd97vzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2141757371',owner_user_name='tempest-TestVolumeSwap-2141757371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:48:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4558306dac14220ab1b0006eda962de',uuid=500a0ed6-ac37-4274-a8f2-2545c270e24b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32230627-2f50-465b-a608-a88969f6408e", "address": "fa:16:3e:d0:00:0b", "network": {"id": "0e446eb7-aecd-4543-8e09-3b3805b2a25c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-708280870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96471e080e8d4674aadc99f0892074a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32230627-2f", "ovs_interfaceid": "32230627-2f50-465b-a608-a88969f6408e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Converting VIF {"id": "32230627-2f50-465b-a608-a88969f6408e", "address": "fa:16:3e:d0:00:0b", "network": {"id": "0e446eb7-aecd-4543-8e09-3b3805b2a25c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-708280870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96471e080e8d4674aadc99f0892074a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32230627-2f", "ovs_interfaceid": "32230627-2f50-465b-a608-a88969f6408e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:00:0b,bridge_name='br-int',has_traffic_filtering=True,id=32230627-2f50-465b-a608-a88969f6408e,network=Network(0e446eb7-aecd-4543-8e09-3b3805b2a25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32230627-2f') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.objects.instance [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lazy-loading 'pci_devices' on Instance uuid 500a0ed6-ac37-4274-a8f2-2545c270e24b {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:48:47 user nova-compute[74039]:   <uuid>500a0ed6-ac37-4274-a8f2-2545c270e24b</uuid>
Oct 20 08:48:47 user nova-compute[74039]:   <name>instance-00000006</name>
Oct 20 08:48:47 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:48:47 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:48:47 user nova-compute[74039]:   <metadata>
Oct 20 08:48:47 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:48:47 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:48:47 user nova-compute[74039]:       <nova:name>tempest-TestVolumeSwap-server-1172293144</nova:name>
Oct 20 08:48:47 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:48:47</nova:creationTime>
Oct 20 08:48:47 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:48:47 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:48:47 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:48:47 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:48:47 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:48:47 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:48:47 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:48:47 user nova-compute[74039]:       <nova:owner>
Oct 20 08:48:47 user nova-compute[74039]:         <nova:user uuid="f4558306dac14220ab1b0006eda962de">tempest-TestVolumeSwap-2141757371-project-member</nova:user>
Oct 20 08:48:47 user nova-compute[74039]:         <nova:project uuid="96471e080e8d4674aadc99f0892074a0">tempest-TestVolumeSwap-2141757371</nova:project>
Oct 20 08:48:47 user nova-compute[74039]:       </nova:owner>
Oct 20 08:48:47 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:48:47 user nova-compute[74039]:       <nova:ports>
Oct 20 08:48:47 user nova-compute[74039]:         <nova:port uuid="32230627-2f50-465b-a608-a88969f6408e">
Oct 20 08:48:47 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 08:48:47 user nova-compute[74039]:         </nova:port>
Oct 20 08:48:47 user nova-compute[74039]:       </nova:ports>
Oct 20 08:48:47 user nova-compute[74039]:     </nova:instance>
Oct 20 08:48:47 user nova-compute[74039]:   </metadata>
Oct 20 08:48:47 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:48:47 user nova-compute[74039]:     <system>
Oct 20 08:48:47 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:48:47 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:48:47 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:48:47 user nova-compute[74039]:       <entry name="serial">500a0ed6-ac37-4274-a8f2-2545c270e24b</entry>
Oct 20 08:48:47 user nova-compute[74039]:       <entry name="uuid">500a0ed6-ac37-4274-a8f2-2545c270e24b</entry>
Oct 20 08:48:47 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:48:47 user nova-compute[74039]:     </system>
Oct 20 08:48:47 user nova-compute[74039]:   </sysinfo>
Oct 20 08:48:47 user nova-compute[74039]:   <os>
Oct 20 08:48:47 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:48:47 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:48:47 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:48:47 user nova-compute[74039]:   </os>
Oct 20 08:48:47 user nova-compute[74039]:   <features>
Oct 20 08:48:47 user nova-compute[74039]:     <acpi/>
Oct 20 08:48:47 user nova-compute[74039]:     <apic/>
Oct 20 08:48:47 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:48:47 user nova-compute[74039]:   </features>
Oct 20 08:48:47 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:48:47 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:48:47 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:48:47 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:48:47 user nova-compute[74039]:   </clock>
Oct 20 08:48:47 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:48:47 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:48:47 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:48:47 user nova-compute[74039]:   </cpu>
Oct 20 08:48:47 user nova-compute[74039]:   <devices>
Oct 20 08:48:47 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:48:47 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:48:47 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk"/>
Oct 20 08:48:47 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:48:47 user nova-compute[74039]:     </disk>
Oct 20 08:48:47 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:48:47 user nova-compute[74039]:       <mac address="fa:16:3e:d0:00:0b"/>
Oct 20 08:48:47 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:48:47 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:48:47 user nova-compute[74039]:       <target dev="tap32230627-2f"/>
Oct 20 08:48:47 user nova-compute[74039]:     </interface>
Oct 20 08:48:47 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:48:47 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/console.log" append="off"/>
Oct 20 08:48:47 user nova-compute[74039]:     </serial>
Oct 20 08:48:47 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:48:47 user nova-compute[74039]:     <video>
Oct 20 08:48:47 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:48:47 user nova-compute[74039]:     </video>
Oct 20 08:48:47 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:48:47 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:48:47 user nova-compute[74039]:     </rng>
Oct 20 08:48:47 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:48:47 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:48:47 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:48:47 user nova-compute[74039]:     </memballoon>
Oct 20 08:48:47 user nova-compute[74039]:   </devices>
Oct 20 08:48:47 user nova-compute[74039]: </domain>
Oct 20 08:48:47 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:48:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1172293144',display_name='tempest-TestVolumeSwap-server-1172293144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1172293144',id=6,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRToobScdUtb7+3jcjSVHCJFxZqv94QJIssqH90Y7pl1sV4pKMkmRJsjji0AWhgMeZy/foe0zo/uxuGWroHhJGC83k5pE7k23SX95ebtFtmvCGOnEFWukNkghf9brY2SQ==',key_name='tempest-keypair-1350799647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96471e080e8d4674aadc99f0892074a0',ramdisk_id='',reservation_id='r-vqd97vzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2141757371',owner_user_name='tempest-TestVolumeSwap-2141757371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:48:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4558306dac14220ab1b0006eda962de',uuid=500a0ed6-ac37-4274-a8f2-2545c270e24b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32230627-2f50-465b-a608-a88969f6408e", "address": "fa:16:3e:d0:00:0b", "network": {"id": "0e446eb7-aecd-4543-8e09-3b3805b2a25c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-708280870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96471e080e8d4674aadc99f0892074a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32230627-2f", "ovs_interfaceid": "32230627-2f50-465b-a608-a88969f6408e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Converting VIF {"id": "32230627-2f50-465b-a608-a88969f6408e", "address": "fa:16:3e:d0:00:0b", "network": {"id": "0e446eb7-aecd-4543-8e09-3b3805b2a25c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-708280870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96471e080e8d4674aadc99f0892074a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32230627-2f", "ovs_interfaceid": "32230627-2f50-465b-a608-a88969f6408e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:00:0b,bridge_name='br-int',has_traffic_filtering=True,id=32230627-2f50-465b-a608-a88969f6408e,network=Network(0e446eb7-aecd-4543-8e09-3b3805b2a25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32230627-2f') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG os_vif [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:00:0b,bridge_name='br-int',has_traffic_filtering=True,id=32230627-2f50-465b-a608-a88969f6408e,network=Network(0e446eb7-aecd-4543-8e09-3b3805b2a25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32230627-2f') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '416d6c85-5135-50a3-a37e-817995759340', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32230627-2f, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32230627-2f, col_values=(('qos', UUID('6f2b0849-aa36-41f2-8c31-c48f9ebe9cfd')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32230627-2f, col_values=(('external_ids', {'iface-id': '32230627-2f50-465b-a608-a88969f6408e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:00:0b', 'vm-uuid': '500a0ed6-ac37-4274-a8f2-2545c270e24b'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:47 user nova-compute[74039]: INFO os_vif [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:00:0b,bridge_name='br-int',has_traffic_filtering=True,id=32230627-2f50-465b-a608-a88969f6408e,network=Network(0e446eb7-aecd-4543-8e09-3b3805b2a25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32230627-2f')
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:48:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] No VIF found with MAC fa:16:3e:d0:00:0b, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:48:48 user nova-compute[74039]: DEBUG nova.network.neutron [req-ec164e86-7b32-4add-9f98-1f09fed29626 req-77d72926-6e20-4df7-9e00-f3e8ac510400 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Updated VIF entry in instance network info cache for port 32230627-2f50-465b-a608-a88969f6408e. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:48:48 user nova-compute[74039]: DEBUG nova.network.neutron [req-ec164e86-7b32-4add-9f98-1f09fed29626 req-77d72926-6e20-4df7-9e00-f3e8ac510400 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Updating instance_info_cache with network_info: [{"id": "32230627-2f50-465b-a608-a88969f6408e", "address": "fa:16:3e:d0:00:0b", "network": {"id": "0e446eb7-aecd-4543-8e09-3b3805b2a25c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-708280870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96471e080e8d4674aadc99f0892074a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32230627-2f", "ovs_interfaceid": "32230627-2f50-465b-a608-a88969f6408e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:48:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ec164e86-7b32-4add-9f98-1f09fed29626 req-77d72926-6e20-4df7-9e00-f3e8ac510400 service nova] Releasing lock "refresh_cache-500a0ed6-ac37-4274-a8f2-2545c270e24b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:48:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:48:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:48:48 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Instance spawned successfully.
Oct 20 08:48:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:48:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:48 user nova-compute[74039]: INFO nova.compute.manager [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Took 8.51 seconds to spawn the instance on the hypervisor.
Oct 20 08:48:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:48:49 user nova-compute[74039]: INFO nova.compute.manager [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Took 10.16 seconds to build instance.
Oct 20 08:48:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fef747d8-72e8-4f56-9d1b-3eda56b79979 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "ff1bca5e-9337-466c-866d-e9c91cf9200c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.304s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:50 user nova-compute[74039]: DEBUG nova.compute.manager [req-99dfd9dc-93d7-4702-9bf6-c24ecdbcbb24 req-ff868682-3f58-4145-922c-5b8b8e430d1b service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Received event network-vif-plugged-32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:48:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-99dfd9dc-93d7-4702-9bf6-c24ecdbcbb24 req-ff868682-3f58-4145-922c-5b8b8e430d1b service nova] Acquiring lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-99dfd9dc-93d7-4702-9bf6-c24ecdbcbb24 req-ff868682-3f58-4145-922c-5b8b8e430d1b service nova] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-99dfd9dc-93d7-4702-9bf6-c24ecdbcbb24 req-ff868682-3f58-4145-922c-5b8b8e430d1b service nova] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:50 user nova-compute[74039]: DEBUG nova.compute.manager [req-99dfd9dc-93d7-4702-9bf6-c24ecdbcbb24 req-ff868682-3f58-4145-922c-5b8b8e430d1b service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] No waiting events found dispatching network-vif-plugged-32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:48:50 user nova-compute[74039]: WARNING nova.compute.manager [req-99dfd9dc-93d7-4702-9bf6-c24ecdbcbb24 req-ff868682-3f58-4145-922c-5b8b8e430d1b service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Received unexpected event network-vif-plugged-32230627-2f50-465b-a608-a88969f6408e for instance with vm_state building and task_state spawning.
Oct 20 08:48:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG nova.compute.manager [req-56617c9f-c675-4255-8207-c1132d580796 req-92c67492-4a93-430c-997c-2bb9568bcfbe service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Received event network-vif-plugged-32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-56617c9f-c675-4255-8207-c1132d580796 req-92c67492-4a93-430c-997c-2bb9568bcfbe service nova] Acquiring lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-56617c9f-c675-4255-8207-c1132d580796 req-92c67492-4a93-430c-997c-2bb9568bcfbe service nova] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-56617c9f-c675-4255-8207-c1132d580796 req-92c67492-4a93-430c-997c-2bb9568bcfbe service nova] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG nova.compute.manager [req-56617c9f-c675-4255-8207-c1132d580796 req-92c67492-4a93-430c-997c-2bb9568bcfbe service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] No waiting events found dispatching network-vif-plugged-32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:48:52 user nova-compute[74039]: WARNING nova.compute.manager [req-56617c9f-c675-4255-8207-c1132d580796 req-92c67492-4a93-430c-997c-2bb9568bcfbe service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Received unexpected event network-vif-plugged-32230627-2f50-465b-a608-a88969f6408e for instance with vm_state building and task_state spawning.
Oct 20 08:48:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Acquiring lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG nova.compute.manager [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:48:52 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Instance spawned successfully.
Oct 20 08:48:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG nova.compute.manager [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:48:52 user nova-compute[74039]: INFO nova.compute.claims [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Claim successful on node user
Oct 20 08:48:52 user nova-compute[74039]: INFO nova.compute.manager [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Took 7.20 seconds to spawn the instance on the hypervisor.
Oct 20 08:48:52 user nova-compute[74039]: DEBUG nova.compute.manager [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:48:52 user nova-compute[74039]: INFO nova.compute.manager [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Took 8.40 seconds to build instance.
Oct 20 08:48:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e265c583-237f-48b6-a11b-990b24ac7bf2 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.596s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG nova.compute.manager [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG nova.compute.manager [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 08:48:52 user nova-compute[74039]: DEBUG nova.network.neutron [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:48:52 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 08:48:53 user nova-compute[74039]: DEBUG nova.compute.manager [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 08:48:53 user nova-compute[74039]: DEBUG nova.policy [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f279e153daba4202b3b5ba4c63b68a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44db9563c584bb482055ddb6ac19447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:48:53 user nova-compute[74039]: DEBUG nova.compute.manager [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 08:48:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:48:53 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Creating image(s)
Oct 20 08:48:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Acquiring lock "/opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Lock "/opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Lock "/opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.333s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.205s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk 1073741824" returned: 0 in 0.061s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:53 user nova-compute[74039]: DEBUG nova.network.neutron [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Successfully created port: 64d1e940-638e-4992-83cc-4c3d515d7d7c {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:48:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.207s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:54 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 08:48:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:54 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Cannot resize image /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 08:48:54 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:48:54 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Ensure instance console log exists: /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:48:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:54 user nova-compute[74039]: DEBUG nova.network.neutron [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Successfully updated port: 64d1e940-638e-4992-83cc-4c3d515d7d7c {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:48:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Acquiring lock "refresh_cache-7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:48:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Acquired lock "refresh_cache-7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:48:54 user nova-compute[74039]: DEBUG nova.network.neutron [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:48:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-08c09248-8525-42f4-808f-d08285fd5575 req-e0355b0f-a6cc-47af-b59d-a9265ef495d8 service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Received event network-changed-64d1e940-638e-4992-83cc-4c3d515d7d7c {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:48:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-08c09248-8525-42f4-808f-d08285fd5575 req-e0355b0f-a6cc-47af-b59d-a9265ef495d8 service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Refreshing instance network info cache due to event network-changed-64d1e940-638e-4992-83cc-4c3d515d7d7c. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:48:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-08c09248-8525-42f4-808f-d08285fd5575 req-e0355b0f-a6cc-47af-b59d-a9265ef495d8 service nova] Acquiring lock "refresh_cache-7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:48:54 user nova-compute[74039]: DEBUG nova.network.neutron [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.network.neutron [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Updating instance_info_cache with network_info: [{"id": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "address": "fa:16:3e:1d:51:19", "network": {"id": "81514bfa-76db-4527-832f-f0214a1b0501", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2103077624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44db9563c584bb482055ddb6ac19447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1e940-63", "ovs_interfaceid": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Releasing lock "refresh_cache-7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.compute.manager [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Instance network_info: |[{"id": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "address": "fa:16:3e:1d:51:19", "network": {"id": "81514bfa-76db-4527-832f-f0214a1b0501", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2103077624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44db9563c584bb482055ddb6ac19447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1e940-63", "ovs_interfaceid": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-08c09248-8525-42f4-808f-d08285fd5575 req-e0355b0f-a6cc-47af-b59d-a9265ef495d8 service nova] Acquired lock "refresh_cache-7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.network.neutron [req-08c09248-8525-42f4-808f-d08285fd5575 req-e0355b0f-a6cc-47af-b59d-a9265ef495d8 service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Refreshing network info cache for port 64d1e940-638e-4992-83cc-4c3d515d7d7c {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Start _get_guest_xml network_info=[{"id": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "address": "fa:16:3e:1d:51:19", "network": {"id": "81514bfa-76db-4527-832f-f0214a1b0501", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2103077624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44db9563c584bb482055ddb6ac19447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1e940-63", "ovs_interfaceid": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:48:55 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:48:55 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:48:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-7828159',display_name='tempest-VolumesAssistedSnapshotsTest-server-7828159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-7828159',id=7,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFrwWQBbYYwls8N09mOUayZKRVnw2WDpqhd57eHGSJhkp42g3CzJkSFj+sP8U7nqyxF6+rcTijOFho8kNWH6RwjXUAXV5uFEuvZwgK2pcwTyA6WsxuWbh6fGiwrVPbwYw==',key_name='tempest-keypair-1005654622',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d44db9563c584bb482055ddb6ac19447',ramdisk_id='',reservation_id='r-0kffnd1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1126553144',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1126553144-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f279e153daba4202b3b5ba4c63b68a23',uuid=7daab27d-f8f5-437e-9ed5-8ea1e72c8e74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "address": "fa:16:3e:1d:51:19", "network": {"id": "81514bfa-76db-4527-832f-f0214a1b0501", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2103077624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44db9563c584bb482055ddb6ac19447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1e940-63", "ovs_interfaceid": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Converting VIF {"id": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "address": "fa:16:3e:1d:51:19", "network": {"id": "81514bfa-76db-4527-832f-f0214a1b0501", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2103077624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44db9563c584bb482055ddb6ac19447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1e940-63", "ovs_interfaceid": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:51:19,bridge_name='br-int',has_traffic_filtering=True,id=64d1e940-638e-4992-83cc-4c3d515d7d7c,network=Network(81514bfa-76db-4527-832f-f0214a1b0501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d1e940-63') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.objects.instance [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Lazy-loading 'pci_devices' on Instance uuid 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:48:55 user nova-compute[74039]:   <uuid>7daab27d-f8f5-437e-9ed5-8ea1e72c8e74</uuid>
Oct 20 08:48:55 user nova-compute[74039]:   <name>instance-00000007</name>
Oct 20 08:48:55 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:48:55 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:48:55 user nova-compute[74039]:   <metadata>
Oct 20 08:48:55 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:48:55 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:48:55 user nova-compute[74039]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-7828159</nova:name>
Oct 20 08:48:55 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:48:55</nova:creationTime>
Oct 20 08:48:55 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:48:55 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:48:55 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:48:55 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:48:55 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:48:55 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:48:55 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:48:55 user nova-compute[74039]:       <nova:owner>
Oct 20 08:48:55 user nova-compute[74039]:         <nova:user uuid="f279e153daba4202b3b5ba4c63b68a23">tempest-VolumesAssistedSnapshotsTest-1126553144-project-member</nova:user>
Oct 20 08:48:55 user nova-compute[74039]:         <nova:project uuid="d44db9563c584bb482055ddb6ac19447">tempest-VolumesAssistedSnapshotsTest-1126553144</nova:project>
Oct 20 08:48:55 user nova-compute[74039]:       </nova:owner>
Oct 20 08:48:55 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:48:55 user nova-compute[74039]:       <nova:ports>
Oct 20 08:48:55 user nova-compute[74039]:         <nova:port uuid="64d1e940-638e-4992-83cc-4c3d515d7d7c">
Oct 20 08:48:55 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 08:48:55 user nova-compute[74039]:         </nova:port>
Oct 20 08:48:55 user nova-compute[74039]:       </nova:ports>
Oct 20 08:48:55 user nova-compute[74039]:     </nova:instance>
Oct 20 08:48:55 user nova-compute[74039]:   </metadata>
Oct 20 08:48:55 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:48:55 user nova-compute[74039]:     <system>
Oct 20 08:48:55 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:48:55 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:48:55 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:48:55 user nova-compute[74039]:       <entry name="serial">7daab27d-f8f5-437e-9ed5-8ea1e72c8e74</entry>
Oct 20 08:48:55 user nova-compute[74039]:       <entry name="uuid">7daab27d-f8f5-437e-9ed5-8ea1e72c8e74</entry>
Oct 20 08:48:55 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:48:55 user nova-compute[74039]:     </system>
Oct 20 08:48:55 user nova-compute[74039]:   </sysinfo>
Oct 20 08:48:55 user nova-compute[74039]:   <os>
Oct 20 08:48:55 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:48:55 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:48:55 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:48:55 user nova-compute[74039]:   </os>
Oct 20 08:48:55 user nova-compute[74039]:   <features>
Oct 20 08:48:55 user nova-compute[74039]:     <acpi/>
Oct 20 08:48:55 user nova-compute[74039]:     <apic/>
Oct 20 08:48:55 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:48:55 user nova-compute[74039]:   </features>
Oct 20 08:48:55 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:48:55 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:48:55 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:48:55 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:48:55 user nova-compute[74039]:   </clock>
Oct 20 08:48:55 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:48:55 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:48:55 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:48:55 user nova-compute[74039]:   </cpu>
Oct 20 08:48:55 user nova-compute[74039]:   <devices>
Oct 20 08:48:55 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:48:55 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:48:55 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk"/>
Oct 20 08:48:55 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:48:55 user nova-compute[74039]:     </disk>
Oct 20 08:48:55 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:48:55 user nova-compute[74039]:       <mac address="fa:16:3e:1d:51:19"/>
Oct 20 08:48:55 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:48:55 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:48:55 user nova-compute[74039]:       <target dev="tap64d1e940-63"/>
Oct 20 08:48:55 user nova-compute[74039]:     </interface>
Oct 20 08:48:55 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:48:55 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/console.log" append="off"/>
Oct 20 08:48:55 user nova-compute[74039]:     </serial>
Oct 20 08:48:55 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:48:55 user nova-compute[74039]:     <video>
Oct 20 08:48:55 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:48:55 user nova-compute[74039]:     </video>
Oct 20 08:48:55 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:48:55 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:48:55 user nova-compute[74039]:     </rng>
Oct 20 08:48:55 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:48:55 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:48:55 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:48:55 user nova-compute[74039]:     </memballoon>
Oct 20 08:48:55 user nova-compute[74039]:   </devices>
Oct 20 08:48:55 user nova-compute[74039]: </domain>
Oct 20 08:48:55 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:48:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-7828159',display_name='tempest-VolumesAssistedSnapshotsTest-server-7828159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-7828159',id=7,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFrwWQBbYYwls8N09mOUayZKRVnw2WDpqhd57eHGSJhkp42g3CzJkSFj+sP8U7nqyxF6+rcTijOFho8kNWH6RwjXUAXV5uFEuvZwgK2pcwTyA6WsxuWbh6fGiwrVPbwYw==',key_name='tempest-keypair-1005654622',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d44db9563c584bb482055ddb6ac19447',ramdisk_id='',reservation_id='r-0kffnd1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1126553144',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1126553144-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f279e153daba4202b3b5ba4c63b68a23',uuid=7daab27d-f8f5-437e-9ed5-8ea1e72c8e74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "address": "fa:16:3e:1d:51:19", "network": {"id": "81514bfa-76db-4527-832f-f0214a1b0501", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2103077624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44db9563c584bb482055ddb6ac19447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1e940-63", "ovs_interfaceid": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Converting VIF {"id": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "address": "fa:16:3e:1d:51:19", "network": {"id": "81514bfa-76db-4527-832f-f0214a1b0501", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2103077624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44db9563c584bb482055ddb6ac19447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1e940-63", "ovs_interfaceid": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:51:19,bridge_name='br-int',has_traffic_filtering=True,id=64d1e940-638e-4992-83cc-4c3d515d7d7c,network=Network(81514bfa-76db-4527-832f-f0214a1b0501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d1e940-63') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG os_vif [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:51:19,bridge_name='br-int',has_traffic_filtering=True,id=64d1e940-638e-4992-83cc-4c3d515d7d7c,network=Network(81514bfa-76db-4527-832f-f0214a1b0501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d1e940-63') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c01e5dcf-03bb-55ac-b267-92cc5a4a97c6', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64d1e940-63, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64d1e940-63, col_values=(('qos', UUID('2ff1d3f1-4c04-445c-ae75-ac4120068eeb')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64d1e940-63, col_values=(('external_ids', {'iface-id': '64d1e940-638e-4992-83cc-4c3d515d7d7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:51:19', 'vm-uuid': '7daab27d-f8f5-437e-9ed5-8ea1e72c8e74'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:55 user nova-compute[74039]: INFO os_vif [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:51:19,bridge_name='br-int',has_traffic_filtering=True,id=64d1e940-638e-4992-83cc-4c3d515d7d7c,network=Network(81514bfa-76db-4527-832f-f0214a1b0501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d1e940-63')
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] No VIF found with MAC fa:16:3e:1d:51:19, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.network.neutron [req-08c09248-8525-42f4-808f-d08285fd5575 req-e0355b0f-a6cc-47af-b59d-a9265ef495d8 service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Updated VIF entry in instance network info cache for port 64d1e940-638e-4992-83cc-4c3d515d7d7c. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG nova.network.neutron [req-08c09248-8525-42f4-808f-d08285fd5575 req-e0355b0f-a6cc-47af-b59d-a9265ef495d8 service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Updating instance_info_cache with network_info: [{"id": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "address": "fa:16:3e:1d:51:19", "network": {"id": "81514bfa-76db-4527-832f-f0214a1b0501", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2103077624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44db9563c584bb482055ddb6ac19447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1e940-63", "ovs_interfaceid": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:48:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-08c09248-8525-42f4-808f-d08285fd5575 req-e0355b0f-a6cc-47af-b59d-a9265ef495d8 service nova] Releasing lock "refresh_cache-7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:48:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquiring lock "365da377-4031-4e1b-bc85-6dcaf721548e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "365da377-4031-4e1b-bc85-6dcaf721548e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:56 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 08:48:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:56 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:48:56 user nova-compute[74039]: INFO nova.compute.claims [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Claim successful on node user
Oct 20 08:48:56 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:48:56 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:48:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:56 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 08:48:56 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 08:48:56 user nova-compute[74039]: DEBUG nova.network.neutron [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:48:56 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 08:48:56 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 08:48:56 user nova-compute[74039]: DEBUG nova.policy [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29ca829a96484751876ead6f2b094e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f437448d494f75838a2c7b2b6a973f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:48:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:48:57 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Creating image(s)
Oct 20 08:48:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquiring lock "/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.344s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.216s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk 1073741824" returned: 0 in 0.068s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG nova.network.neutron [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Successfully created port: 8c246ad5-f489-4486-b930-9d4a1cb60c41 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.198s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 08:48:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:58 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Cannot resize image /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 08:48:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:48:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Ensure instance console log exists: /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:48:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:48:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:48:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:48:58 user nova-compute[74039]: DEBUG nova.network.neutron [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Successfully updated port: 8c246ad5-f489-4486-b930-9d4a1cb60c41 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:48:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquiring lock "refresh_cache-365da377-4031-4e1b-bc85-6dcaf721548e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:48:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquired lock "refresh_cache-365da377-4031-4e1b-bc85-6dcaf721548e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:48:58 user nova-compute[74039]: DEBUG nova.network.neutron [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:48:58 user nova-compute[74039]: DEBUG nova.compute.manager [req-765ac0ae-9b8c-4d0b-8d8c-de15797af967 req-f4db3e07-cb30-4bd1-a539-11bbca60f2dc service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received event network-changed-8c246ad5-f489-4486-b930-9d4a1cb60c41 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:48:58 user nova-compute[74039]: DEBUG nova.compute.manager [req-765ac0ae-9b8c-4d0b-8d8c-de15797af967 req-f4db3e07-cb30-4bd1-a539-11bbca60f2dc service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Refreshing instance network info cache due to event network-changed-8c246ad5-f489-4486-b930-9d4a1cb60c41. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:48:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-765ac0ae-9b8c-4d0b-8d8c-de15797af967 req-f4db3e07-cb30-4bd1-a539-11bbca60f2dc service nova] Acquiring lock "refresh_cache-365da377-4031-4e1b-bc85-6dcaf721548e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:48:58 user nova-compute[74039]: DEBUG nova.network.neutron [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.network.neutron [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Updating instance_info_cache with network_info: [{"id": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "address": "fa:16:3e:8e:e7:14", "network": {"id": "48788255-d08e-4361-9b44-b6554c28bc6b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-33959125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c246ad5-f4", "ovs_interfaceid": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Releasing lock "refresh_cache-365da377-4031-4e1b-bc85-6dcaf721548e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Instance network_info: |[{"id": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "address": "fa:16:3e:8e:e7:14", "network": {"id": "48788255-d08e-4361-9b44-b6554c28bc6b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-33959125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c246ad5-f4", "ovs_interfaceid": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-765ac0ae-9b8c-4d0b-8d8c-de15797af967 req-f4db3e07-cb30-4bd1-a539-11bbca60f2dc service nova] Acquired lock "refresh_cache-365da377-4031-4e1b-bc85-6dcaf721548e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.network.neutron [req-765ac0ae-9b8c-4d0b-8d8c-de15797af967 req-f4db3e07-cb30-4bd1-a539-11bbca60f2dc service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Refreshing network info cache for port 8c246ad5-f489-4486-b930-9d4a1cb60c41 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Start _get_guest_xml network_info=[{"id": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "address": "fa:16:3e:8e:e7:14", "network": {"id": "48788255-d08e-4361-9b44-b6554c28bc6b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-33959125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c246ad5-f4", "ovs_interfaceid": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:48:59 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:48:59 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:48:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2124112502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2124112502',id=8,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADEixoB6QWWhTLuwL+7Z2fkKKWHkyf3tVdnf4752CWzbdJ5lz/PbSjwRzike1kbeQLqKQLtsajre3rrJlFKfvXx6m1o9pCXfJmA6Y4TeaBnPAeS7YpGXhczqHT/lsYEnw==',key_name='tempest-keypair-1295832388',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40f437448d494f75838a2c7b2b6a973f',ramdisk_id='',reservation_id='r-d06qmgd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-92531413',owner_user_name='tempest-TaggedAttachmentsTest-92531413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:48:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29ca829a96484751876ead6f2b094e54',uuid=365da377-4031-4e1b-bc85-6dcaf721548e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "address": "fa:16:3e:8e:e7:14", "network": {"id": "48788255-d08e-4361-9b44-b6554c28bc6b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-33959125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c246ad5-f4", "ovs_interfaceid": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Converting VIF {"id": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "address": "fa:16:3e:8e:e7:14", "network": {"id": "48788255-d08e-4361-9b44-b6554c28bc6b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-33959125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c246ad5-f4", "ovs_interfaceid": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:e7:14,bridge_name='br-int',has_traffic_filtering=True,id=8c246ad5-f489-4486-b930-9d4a1cb60c41,network=Network(48788255-d08e-4361-9b44-b6554c28bc6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c246ad5-f4') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.objects.instance [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lazy-loading 'pci_devices' on Instance uuid 365da377-4031-4e1b-bc85-6dcaf721548e {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:48:59 user nova-compute[74039]:   <uuid>365da377-4031-4e1b-bc85-6dcaf721548e</uuid>
Oct 20 08:48:59 user nova-compute[74039]:   <name>instance-00000008</name>
Oct 20 08:48:59 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:48:59 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:48:59 user nova-compute[74039]:   <metadata>
Oct 20 08:48:59 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:48:59 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:48:59 user nova-compute[74039]:       <nova:name>tempest-device-tagging-server-2124112502</nova:name>
Oct 20 08:48:59 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:48:59</nova:creationTime>
Oct 20 08:48:59 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:48:59 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:48:59 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:48:59 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:48:59 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:48:59 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:48:59 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:48:59 user nova-compute[74039]:       <nova:owner>
Oct 20 08:48:59 user nova-compute[74039]:         <nova:user uuid="29ca829a96484751876ead6f2b094e54">tempest-TaggedAttachmentsTest-92531413-project-member</nova:user>
Oct 20 08:48:59 user nova-compute[74039]:         <nova:project uuid="40f437448d494f75838a2c7b2b6a973f">tempest-TaggedAttachmentsTest-92531413</nova:project>
Oct 20 08:48:59 user nova-compute[74039]:       </nova:owner>
Oct 20 08:48:59 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:48:59 user nova-compute[74039]:       <nova:ports>
Oct 20 08:48:59 user nova-compute[74039]:         <nova:port uuid="8c246ad5-f489-4486-b930-9d4a1cb60c41">
Oct 20 08:48:59 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 08:48:59 user nova-compute[74039]:         </nova:port>
Oct 20 08:48:59 user nova-compute[74039]:       </nova:ports>
Oct 20 08:48:59 user nova-compute[74039]:     </nova:instance>
Oct 20 08:48:59 user nova-compute[74039]:   </metadata>
Oct 20 08:48:59 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:48:59 user nova-compute[74039]:     <system>
Oct 20 08:48:59 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:48:59 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:48:59 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:48:59 user nova-compute[74039]:       <entry name="serial">365da377-4031-4e1b-bc85-6dcaf721548e</entry>
Oct 20 08:48:59 user nova-compute[74039]:       <entry name="uuid">365da377-4031-4e1b-bc85-6dcaf721548e</entry>
Oct 20 08:48:59 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:48:59 user nova-compute[74039]:     </system>
Oct 20 08:48:59 user nova-compute[74039]:   </sysinfo>
Oct 20 08:48:59 user nova-compute[74039]:   <os>
Oct 20 08:48:59 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:48:59 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:48:59 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:48:59 user nova-compute[74039]:   </os>
Oct 20 08:48:59 user nova-compute[74039]:   <features>
Oct 20 08:48:59 user nova-compute[74039]:     <acpi/>
Oct 20 08:48:59 user nova-compute[74039]:     <apic/>
Oct 20 08:48:59 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:48:59 user nova-compute[74039]:   </features>
Oct 20 08:48:59 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:48:59 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:48:59 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:48:59 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:48:59 user nova-compute[74039]:   </clock>
Oct 20 08:48:59 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:48:59 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:48:59 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:48:59 user nova-compute[74039]:   </cpu>
Oct 20 08:48:59 user nova-compute[74039]:   <devices>
Oct 20 08:48:59 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:48:59 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:48:59 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk"/>
Oct 20 08:48:59 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:48:59 user nova-compute[74039]:     </disk>
Oct 20 08:48:59 user nova-compute[74039]:     <disk type="file" device="cdrom">
Oct 20 08:48:59 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 08:48:59 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk.config"/>
Oct 20 08:48:59 user nova-compute[74039]:       <target dev="hda" bus="ide"/>
Oct 20 08:48:59 user nova-compute[74039]:     </disk>
Oct 20 08:48:59 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:48:59 user nova-compute[74039]:       <mac address="fa:16:3e:8e:e7:14"/>
Oct 20 08:48:59 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:48:59 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:48:59 user nova-compute[74039]:       <target dev="tap8c246ad5-f4"/>
Oct 20 08:48:59 user nova-compute[74039]:     </interface>
Oct 20 08:48:59 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:48:59 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/console.log" append="off"/>
Oct 20 08:48:59 user nova-compute[74039]:     </serial>
Oct 20 08:48:59 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:48:59 user nova-compute[74039]:     <video>
Oct 20 08:48:59 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:48:59 user nova-compute[74039]:     </video>
Oct 20 08:48:59 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:48:59 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:48:59 user nova-compute[74039]:     </rng>
Oct 20 08:48:59 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:48:59 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:48:59 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:48:59 user nova-compute[74039]:     </memballoon>
Oct 20 08:48:59 user nova-compute[74039]:   </devices>
Oct 20 08:48:59 user nova-compute[74039]: </domain>
Oct 20 08:48:59 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:48:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2124112502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2124112502',id=8,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADEixoB6QWWhTLuwL+7Z2fkKKWHkyf3tVdnf4752CWzbdJ5lz/PbSjwRzike1kbeQLqKQLtsajre3rrJlFKfvXx6m1o9pCXfJmA6Y4TeaBnPAeS7YpGXhczqHT/lsYEnw==',key_name='tempest-keypair-1295832388',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40f437448d494f75838a2c7b2b6a973f',ramdisk_id='',reservation_id='r-d06qmgd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-92531413',owner_user_name='tempest-TaggedAttachmentsTest-92531413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:48:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29ca829a96484751876ead6f2b094e54',uuid=365da377-4031-4e1b-bc85-6dcaf721548e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "address": "fa:16:3e:8e:e7:14", "network": {"id": "48788255-d08e-4361-9b44-b6554c28bc6b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-33959125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c246ad5-f4", "ovs_interfaceid": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Converting VIF {"id": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "address": "fa:16:3e:8e:e7:14", "network": {"id": "48788255-d08e-4361-9b44-b6554c28bc6b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-33959125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c246ad5-f4", "ovs_interfaceid": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:e7:14,bridge_name='br-int',has_traffic_filtering=True,id=8c246ad5-f489-4486-b930-9d4a1cb60c41,network=Network(48788255-d08e-4361-9b44-b6554c28bc6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c246ad5-f4') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG os_vif [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:e7:14,bridge_name='br-int',has_traffic_filtering=True,id=8c246ad5-f489-4486-b930-9d4a1cb60c41,network=Network(48788255-d08e-4361-9b44-b6554c28bc6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c246ad5-f4') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6430d31d-5f99-5951-af6e-175aab9427e5', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c246ad5-f4, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c246ad5-f4, col_values=(('qos', UUID('be5fcd26-33bd-4376-a27b-62af62ee4aa5')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c246ad5-f4, col_values=(('external_ids', {'iface-id': '8c246ad5-f489-4486-b930-9d4a1cb60c41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:e7:14', 'vm-uuid': '365da377-4031-4e1b-bc85-6dcaf721548e'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:48:59 user nova-compute[74039]: INFO os_vif [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:e7:14,bridge_name='br-int',has_traffic_filtering=True,id=8c246ad5-f489-4486-b930-9d4a1cb60c41,network=Network(48788255-d08e-4361-9b44-b6554c28bc6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c246ad5-f4')
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] No BDM found with device name hda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] No VIF found with MAC fa:16:3e:8e:e7:14, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:48:59 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Using config drive
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.compute.manager [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:48:59 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Instance spawned successfully.
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:48:59 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Creating config drive at /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk.config
Oct 20 08:48:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfofoo2kx {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfofoo2kx" returned: 0 in 0.086s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:48:59 user nova-compute[74039]: INFO nova.compute.manager [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Took 6.62 seconds to spawn the instance on the hypervisor.
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.compute.manager [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.network.neutron [req-765ac0ae-9b8c-4d0b-8d8c-de15797af967 req-f4db3e07-cb30-4bd1-a539-11bbca60f2dc service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Updated VIF entry in instance network info cache for port 8c246ad5-f489-4486-b930-9d4a1cb60c41. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG nova.network.neutron [req-765ac0ae-9b8c-4d0b-8d8c-de15797af967 req-f4db3e07-cb30-4bd1-a539-11bbca60f2dc service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Updating instance_info_cache with network_info: [{"id": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "address": "fa:16:3e:8e:e7:14", "network": {"id": "48788255-d08e-4361-9b44-b6554c28bc6b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-33959125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c246ad5-f4", "ovs_interfaceid": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:48:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-765ac0ae-9b8c-4d0b-8d8c-de15797af967 req-f4db3e07-cb30-4bd1-a539-11bbca60f2dc service nova] Releasing lock "refresh_cache-365da377-4031-4e1b-bc85-6dcaf721548e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:48:59 user nova-compute[74039]: INFO nova.compute.manager [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Took 7.59 seconds to build instance.
Oct 20 08:49:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-874c9059-ffbc-4ae2-a471-89b386ca6e5a tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.766s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:49:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:04 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:49:04 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:49:04 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Instance spawned successfully.
Oct 20 08:49:04 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:49:04 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:49:04 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:49:04 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:49:04 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:49:04 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:49:04 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:49:04 user nova-compute[74039]: INFO nova.compute.manager [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Took 7.07 seconds to spawn the instance on the hypervisor.
Oct 20 08:49:04 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:49:04 user nova-compute[74039]: INFO nova.compute.manager [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Took 8.00 seconds to build instance.
Oct 20 08:49:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b5072ca0-3018-463b-8970-34e8cba40c62 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "365da377-4031-4e1b-bc85-6dcaf721548e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.183s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:49:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:05 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:49:05 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Cleaning up deleted instances {{(pid=74039) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 08:49:05 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] There are 0 instances to clean {{(pid=74039) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 08:49:05 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:49:05 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74039) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 08:49:05 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:49:06 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:49:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:07 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:49:07 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:49:07 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:49:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 08:49:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:09 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:49:09 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:49:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:49:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:49:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:49:09 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 08:49:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:49:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json" returned: 0 in 0.362s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:49:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:49:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:49:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:49:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:49:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:49:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:49:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:49:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:49:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:49:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:49:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:49:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:49:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:49:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:49:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:49:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:49:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:49:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:49:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:49:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:49:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:49:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:49:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:49:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:49:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:49:12 user nova-compute[74039]: DEBUG nova.compute.manager [req-79f4d3c8-9ded-46dd-acfb-02aa729964e4 req-26260cb6-cb98-4db6-889c-76f8ff8a63a4 service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Received event network-vif-plugged-24716055-5932-4507-8742-840afce654a2 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:49:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-79f4d3c8-9ded-46dd-acfb-02aa729964e4 req-26260cb6-cb98-4db6-889c-76f8ff8a63a4 service nova] Acquiring lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:49:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-79f4d3c8-9ded-46dd-acfb-02aa729964e4 req-26260cb6-cb98-4db6-889c-76f8ff8a63a4 service nova] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:49:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-79f4d3c8-9ded-46dd-acfb-02aa729964e4 req-26260cb6-cb98-4db6-889c-76f8ff8a63a4 service nova] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:49:12 user nova-compute[74039]: DEBUG nova.compute.manager [req-79f4d3c8-9ded-46dd-acfb-02aa729964e4 req-26260cb6-cb98-4db6-889c-76f8ff8a63a4 service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] No waiting events found dispatching network-vif-plugged-24716055-5932-4507-8742-840afce654a2 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:49:12 user nova-compute[74039]: WARNING nova.compute.manager [req-79f4d3c8-9ded-46dd-acfb-02aa729964e4 req-26260cb6-cb98-4db6-889c-76f8ff8a63a4 service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Received unexpected event network-vif-plugged-24716055-5932-4507-8742-840afce654a2 for instance with vm_state active and task_state None.
Oct 20 08:49:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:49:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:49:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:49:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:49:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:49:13 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:49:13 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:49:13 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7686MB free_disk=25.824615478515625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 08:49:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:49:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:49:14 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 9fe77a96-fcb5-4410-85cc-58d925548e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:49:14 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c8054dbd-c0ae-45d2-af95-dae7d05f8c69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:49:14 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:49:14 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 971fb41b-7fce-4ffe-b785-5d86f435004a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:49:14 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance ff1bca5e-9337-466c-866d-e9c91cf9200c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:49:14 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 500a0ed6-ac37-4274-a8f2-2545c270e24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:49:14 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:49:14 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 365da377-4031-4e1b-bc85-6dcaf721548e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:49:14 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 08:49:14 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 08:49:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:14 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:49:14 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:49:14 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 08:49:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.740s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:49:14 user nova-compute[74039]: DEBUG nova.compute.manager [req-7678ec42-aea8-492a-9bcd-eb6a45595692 req-519f2729-52f5-481f-a1d5-4447983398b2 service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Received event network-vif-plugged-24716055-5932-4507-8742-840afce654a2 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:49:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7678ec42-aea8-492a-9bcd-eb6a45595692 req-519f2729-52f5-481f-a1d5-4447983398b2 service nova] Acquiring lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:49:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7678ec42-aea8-492a-9bcd-eb6a45595692 req-519f2729-52f5-481f-a1d5-4447983398b2 service nova] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:49:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7678ec42-aea8-492a-9bcd-eb6a45595692 req-519f2729-52f5-481f-a1d5-4447983398b2 service nova] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:49:14 user nova-compute[74039]: DEBUG nova.compute.manager [req-7678ec42-aea8-492a-9bcd-eb6a45595692 req-519f2729-52f5-481f-a1d5-4447983398b2 service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] No waiting events found dispatching network-vif-plugged-24716055-5932-4507-8742-840afce654a2 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:49:14 user nova-compute[74039]: WARNING nova.compute.manager [req-7678ec42-aea8-492a-9bcd-eb6a45595692 req-519f2729-52f5-481f-a1d5-4447983398b2 service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Received unexpected event network-vif-plugged-24716055-5932-4507-8742-840afce654a2 for instance with vm_state active and task_state None.
Oct 20 08:49:15 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:49:15 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:49:15 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 08:49:15 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Rebuilding the list of instances to heal {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 08:49:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:49:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:49:15 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 08:49:15 user nova-compute[74039]: DEBUG nova.objects.instance [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lazy-loading 'info_cache' on Instance uuid 9fe77a96-fcb5-4410-85cc-58d925548e03 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:49:16 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Updating instance_info_cache with network_info: [{"id": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "address": "fa:16:3e:63:75:a3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9fe7711-d5", "ovs_interfaceid": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:49:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:49:16 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 08:49:16 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:49:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:19 user nova-compute[74039]: DEBUG nova.compute.manager [req-7fff5085-1016-41dc-b1c7-5b799971d854 req-c897f881-6c20-4683-90c7-4f2797aef68e service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Received event network-vif-plugged-708d272c-3434-4525-bcbd-3ee50e71eb47 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:49:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7fff5085-1016-41dc-b1c7-5b799971d854 req-c897f881-6c20-4683-90c7-4f2797aef68e service nova] Acquiring lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:49:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7fff5085-1016-41dc-b1c7-5b799971d854 req-c897f881-6c20-4683-90c7-4f2797aef68e service nova] Lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:49:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7fff5085-1016-41dc-b1c7-5b799971d854 req-c897f881-6c20-4683-90c7-4f2797aef68e service nova] Lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:49:19 user nova-compute[74039]: DEBUG nova.compute.manager [req-7fff5085-1016-41dc-b1c7-5b799971d854 req-c897f881-6c20-4683-90c7-4f2797aef68e service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] No waiting events found dispatching network-vif-plugged-708d272c-3434-4525-bcbd-3ee50e71eb47 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:49:19 user nova-compute[74039]: WARNING nova.compute.manager [req-7fff5085-1016-41dc-b1c7-5b799971d854 req-c897f881-6c20-4683-90c7-4f2797aef68e service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Received unexpected event network-vif-plugged-708d272c-3434-4525-bcbd-3ee50e71eb47 for instance with vm_state active and task_state None.
Oct 20 08:49:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Received event network-vif-plugged-708d272c-3434-4525-bcbd-3ee50e71eb47 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] Acquiring lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] Lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] Lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] No waiting events found dispatching network-vif-plugged-708d272c-3434-4525-bcbd-3ee50e71eb47 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:49:21 user nova-compute[74039]: WARNING nova.compute.manager [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Received unexpected event network-vif-plugged-708d272c-3434-4525-bcbd-3ee50e71eb47 for instance with vm_state active and task_state None.
Oct 20 08:49:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] No waiting events found dispatching network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:49:21 user nova-compute[74039]: WARNING nova.compute.manager [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received unexpected event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 for instance with vm_state active and task_state None.
Oct 20 08:49:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] No waiting events found dispatching network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:49:21 user nova-compute[74039]: WARNING nova.compute.manager [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received unexpected event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 for instance with vm_state active and task_state None.
Oct 20 08:49:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Received event network-vif-plugged-903853f8-c5ee-49d4-9896-b50b043842c6 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] Acquiring lock "971fb41b-7fce-4ffe-b785-5d86f435004a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] Lock "971fb41b-7fce-4ffe-b785-5d86f435004a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] Lock "971fb41b-7fce-4ffe-b785-5d86f435004a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] No waiting events found dispatching network-vif-plugged-903853f8-c5ee-49d4-9896-b50b043842c6 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:49:21 user nova-compute[74039]: WARNING nova.compute.manager [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Received unexpected event network-vif-plugged-903853f8-c5ee-49d4-9896-b50b043842c6 for instance with vm_state active and task_state None.
Oct 20 08:49:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Received event network-vif-plugged-903853f8-c5ee-49d4-9896-b50b043842c6 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] Acquiring lock "971fb41b-7fce-4ffe-b785-5d86f435004a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] Lock "971fb41b-7fce-4ffe-b785-5d86f435004a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] Lock "971fb41b-7fce-4ffe-b785-5d86f435004a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:49:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] No waiting events found dispatching network-vif-plugged-903853f8-c5ee-49d4-9896-b50b043842c6 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:49:21 user nova-compute[74039]: WARNING nova.compute.manager [req-4a6f6eb5-af79-4dda-a415-5e1bff33d9d2 req-bab445a5-c204-4a37-ae97-98c3520fc49a service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Received unexpected event network-vif-plugged-903853f8-c5ee-49d4-9896-b50b043842c6 for instance with vm_state active and task_state None.
Oct 20 08:49:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-328a3136-a8eb-4970-9d19-e012b2d806a3 req-82495b79-7d46-4f8e-b7e2-68bdbdadc4c3 service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Received event network-vif-plugged-ca5407cc-32fc-44c3-a80d-ff65f007eeb8 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:49:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-328a3136-a8eb-4970-9d19-e012b2d806a3 req-82495b79-7d46-4f8e-b7e2-68bdbdadc4c3 service nova] Acquiring lock "ff1bca5e-9337-466c-866d-e9c91cf9200c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:49:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-328a3136-a8eb-4970-9d19-e012b2d806a3 req-82495b79-7d46-4f8e-b7e2-68bdbdadc4c3 service nova] Lock "ff1bca5e-9337-466c-866d-e9c91cf9200c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:49:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-328a3136-a8eb-4970-9d19-e012b2d806a3 req-82495b79-7d46-4f8e-b7e2-68bdbdadc4c3 service nova] Lock "ff1bca5e-9337-466c-866d-e9c91cf9200c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:49:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-328a3136-a8eb-4970-9d19-e012b2d806a3 req-82495b79-7d46-4f8e-b7e2-68bdbdadc4c3 service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] No waiting events found dispatching network-vif-plugged-ca5407cc-32fc-44c3-a80d-ff65f007eeb8 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:49:26 user nova-compute[74039]: WARNING nova.compute.manager [req-328a3136-a8eb-4970-9d19-e012b2d806a3 req-82495b79-7d46-4f8e-b7e2-68bdbdadc4c3 service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Received unexpected event network-vif-plugged-ca5407cc-32fc-44c3-a80d-ff65f007eeb8 for instance with vm_state active and task_state None.
Oct 20 08:49:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Received event network-vif-plugged-ca5407cc-32fc-44c3-a80d-ff65f007eeb8 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] Acquiring lock "ff1bca5e-9337-466c-866d-e9c91cf9200c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] Lock "ff1bca5e-9337-466c-866d-e9c91cf9200c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] Lock "ff1bca5e-9337-466c-866d-e9c91cf9200c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] No waiting events found dispatching network-vif-plugged-ca5407cc-32fc-44c3-a80d-ff65f007eeb8 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:49:28 user nova-compute[74039]: WARNING nova.compute.manager [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Received unexpected event network-vif-plugged-ca5407cc-32fc-44c3-a80d-ff65f007eeb8 for instance with vm_state active and task_state None.
Oct 20 08:49:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Received event network-vif-plugged-64d1e940-638e-4992-83cc-4c3d515d7d7c {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] Acquiring lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] Lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] Lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] No waiting events found dispatching network-vif-plugged-64d1e940-638e-4992-83cc-4c3d515d7d7c {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:49:28 user nova-compute[74039]: WARNING nova.compute.manager [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Received unexpected event network-vif-plugged-64d1e940-638e-4992-83cc-4c3d515d7d7c for instance with vm_state active and task_state None.
Oct 20 08:49:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Received event network-vif-plugged-64d1e940-638e-4992-83cc-4c3d515d7d7c {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] Acquiring lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] Lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] Lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] No waiting events found dispatching network-vif-plugged-64d1e940-638e-4992-83cc-4c3d515d7d7c {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:49:28 user nova-compute[74039]: WARNING nova.compute.manager [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Received unexpected event network-vif-plugged-64d1e940-638e-4992-83cc-4c3d515d7d7c for instance with vm_state active and task_state None.
Oct 20 08:49:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received event network-vif-plugged-8c246ad5-f489-4486-b930-9d4a1cb60c41 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] Acquiring lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] Lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] Lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] No waiting events found dispatching network-vif-plugged-8c246ad5-f489-4486-b930-9d4a1cb60c41 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:49:28 user nova-compute[74039]: WARNING nova.compute.manager [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received unexpected event network-vif-plugged-8c246ad5-f489-4486-b930-9d4a1cb60c41 for instance with vm_state active and task_state None.
Oct 20 08:49:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received event network-vif-plugged-8c246ad5-f489-4486-b930-9d4a1cb60c41 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] Acquiring lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] Lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] Lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:49:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] No waiting events found dispatching network-vif-plugged-8c246ad5-f489-4486-b930-9d4a1cb60c41 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:49:28 user nova-compute[74039]: WARNING nova.compute.manager [req-df928a68-80ff-42fe-9c2a-30e304503a3b req-b5642132-8d96-4f0e-86d5-9799b9a7b787 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received unexpected event network-vif-plugged-8c246ad5-f489-4486-b930-9d4a1cb60c41 for instance with vm_state active and task_state None.
Oct 20 08:49:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:49:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:49:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:50:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:50:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 08:50:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 08:50:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 08:50:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:07 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:50:07 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:50:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 08:50:08 user nova-compute[74039]: INFO nova.compute.manager [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Rescuing
Oct 20 08:50:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "refresh_cache-c8054dbd-c0ae-45d2-af95-dae7d05f8c69" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:50:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquired lock "refresh_cache-c8054dbd-c0ae-45d2-af95-dae7d05f8c69" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:50:08 user nova-compute[74039]: DEBUG nova.network.neutron [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:50:08 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:50:09 user nova-compute[74039]: DEBUG nova.network.neutron [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Updating instance_info_cache with network_info: [{"id": "24716055-5932-4507-8742-840afce654a2", "address": "fa:16:3e:3e:2e:b3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24716055-59", "ovs_interfaceid": "24716055-5932-4507-8742-840afce654a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:50:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Releasing lock "refresh_cache-c8054dbd-c0ae-45d2-af95-dae7d05f8c69" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:50:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:09 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:50:09 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:50:10 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Instance destroyed successfully.
Oct 20 08:50:10 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Attempting rescue
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74039) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Instance directory exists: not creating {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 08:50:10 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Creating image(s)
Oct 20 08:50:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "/opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "/opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.objects.instance [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'trusted_certs' on Instance uuid c8054dbd-c0ae-45d2-af95-dae7d05f8c69 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-4bc6c1de-cb8f-48b5-8ac2-c021115ed919 req-73f802a8-adf2-4ae5-8bb7-0387c00a179d service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Received event network-vif-unplugged-24716055-5932-4507-8742-840afce654a2 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4bc6c1de-cb8f-48b5-8ac2-c021115ed919 req-73f802a8-adf2-4ae5-8bb7-0387c00a179d service nova] Acquiring lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4bc6c1de-cb8f-48b5-8ac2-c021115ed919 req-73f802a8-adf2-4ae5-8bb7-0387c00a179d service nova] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4bc6c1de-cb8f-48b5-8ac2-c021115ed919 req-73f802a8-adf2-4ae5-8bb7-0387c00a179d service nova] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-4bc6c1de-cb8f-48b5-8ac2-c021115ed919 req-73f802a8-adf2-4ae5-8bb7-0387c00a179d service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] No waiting events found dispatching network-vif-unplugged-24716055-5932-4507-8742-840afce654a2 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:50:10 user nova-compute[74039]: WARNING nova.compute.manager [req-4bc6c1de-cb8f-48b5-8ac2-c021115ed919 req-73f802a8-adf2-4ae5-8bb7-0387c00a179d service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Received unexpected event network-vif-unplugged-24716055-5932-4507-8742-840afce654a2 for instance with vm_state active and task_state rescuing.
Oct 20 08:50:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.227s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue" returned: 0 in 0.054s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.objects.instance [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'migration_context' on Instance uuid c8054dbd-c0ae-45d2-af95-dae7d05f8c69 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.objects.base [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Object Instance<c8054dbd-c0ae-45d2-af95-dae7d05f8c69> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Start _get_guest_xml network_info=[{"id": "24716055-5932-4507-8742-840afce654a2", "address": "fa:16:3e:3e:2e:b3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "vif_mac": "fa:16:3e:3e:2e:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24716055-59", "ovs_interfaceid": "24716055-5932-4507-8742-840afce654a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f58b9629-4790-4951-9492-6447e1485638', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.objects.instance [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'resources' on Instance uuid c8054dbd-c0ae-45d2-af95-dae7d05f8c69 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.objects.base [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Object Instance<c8054dbd-c0ae-45d2-af95-dae7d05f8c69> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.objects.instance [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'numa_topology' on Instance uuid c8054dbd-c0ae-45d2-af95-dae7d05f8c69 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.objects.base [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Object Instance<c8054dbd-c0ae-45d2-af95-dae7d05f8c69> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 08:50:10 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:50:10 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.objects.instance [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'vcpu_model' on Instance uuid c8054dbd-c0ae-45d2-af95-dae7d05f8c69 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.objects.base [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Object Instance<c8054dbd-c0ae-45d2-af95-dae7d05f8c69> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1005459278',display_name='tempest-ServerRescueNegativeTestJSON-server-1005459278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1005459278',id=2,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:48:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d74bb65080a343afb5cbcea1b5481938',ramdisk_id='',reservation_id='r-xijpimll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1580334620',owner_user_name='tempest-ServerRescueNegativeTestJSON-1580334620-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:48:34Z,user_data=None,user_id='4024fa0ccfda49e0a070b9e6166e37ed',uuid=c8054dbd-c0ae-45d2-af95-dae7d05f8c69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24716055-5932-4507-8742-840afce654a2", "address": "fa:16:3e:3e:2e:b3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "vif_mac": "fa:16:3e:3e:2e:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24716055-59", "ovs_interfaceid": "24716055-5932-4507-8742-840afce654a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converting VIF {"id": "24716055-5932-4507-8742-840afce654a2", "address": "fa:16:3e:3e:2e:b3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "vif_mac": "fa:16:3e:3e:2e:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24716055-59", "ovs_interfaceid": "24716055-5932-4507-8742-840afce654a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:2e:b3,bridge_name='br-int',has_traffic_filtering=True,id=24716055-5932-4507-8742-840afce654a2,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24716055-59') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.objects.instance [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'pci_devices' on Instance uuid c8054dbd-c0ae-45d2-af95-dae7d05f8c69 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.objects.base [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Object Instance<c8054dbd-c0ae-45d2-af95-dae7d05f8c69> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:50:10 user nova-compute[74039]:   <uuid>c8054dbd-c0ae-45d2-af95-dae7d05f8c69</uuid>
Oct 20 08:50:10 user nova-compute[74039]:   <name>instance-00000002</name>
Oct 20 08:50:10 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:50:10 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:50:10 user nova-compute[74039]:   <metadata>
Oct 20 08:50:10 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:50:10 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:50:10 user nova-compute[74039]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1005459278</nova:name>
Oct 20 08:50:10 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:50:10</nova:creationTime>
Oct 20 08:50:10 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:50:10 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:50:10 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:50:10 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:50:10 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:50:10 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:50:10 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:50:10 user nova-compute[74039]:       <nova:owner>
Oct 20 08:50:10 user nova-compute[74039]:         <nova:user uuid="4024fa0ccfda49e0a070b9e6166e37ed">tempest-ServerRescueNegativeTestJSON-1580334620-project-member</nova:user>
Oct 20 08:50:10 user nova-compute[74039]:         <nova:project uuid="d74bb65080a343afb5cbcea1b5481938">tempest-ServerRescueNegativeTestJSON-1580334620</nova:project>
Oct 20 08:50:10 user nova-compute[74039]:       </nova:owner>
Oct 20 08:50:10 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:50:10 user nova-compute[74039]:       <nova:ports>
Oct 20 08:50:10 user nova-compute[74039]:         <nova:port uuid="24716055-5932-4507-8742-840afce654a2">
Oct 20 08:50:10 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 08:50:10 user nova-compute[74039]:         </nova:port>
Oct 20 08:50:10 user nova-compute[74039]:       </nova:ports>
Oct 20 08:50:10 user nova-compute[74039]:     </nova:instance>
Oct 20 08:50:10 user nova-compute[74039]:   </metadata>
Oct 20 08:50:10 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:50:10 user nova-compute[74039]:     <system>
Oct 20 08:50:10 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:50:10 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:50:10 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:50:10 user nova-compute[74039]:       <entry name="serial">c8054dbd-c0ae-45d2-af95-dae7d05f8c69</entry>
Oct 20 08:50:10 user nova-compute[74039]:       <entry name="uuid">c8054dbd-c0ae-45d2-af95-dae7d05f8c69</entry>
Oct 20 08:50:10 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:50:10 user nova-compute[74039]:     </system>
Oct 20 08:50:10 user nova-compute[74039]:   </sysinfo>
Oct 20 08:50:10 user nova-compute[74039]:   <os>
Oct 20 08:50:10 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:50:10 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:50:10 user nova-compute[74039]:   </os>
Oct 20 08:50:10 user nova-compute[74039]:   <features>
Oct 20 08:50:10 user nova-compute[74039]:     <acpi/>
Oct 20 08:50:10 user nova-compute[74039]:     <apic/>
Oct 20 08:50:10 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:50:10 user nova-compute[74039]:   </features>
Oct 20 08:50:10 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:50:10 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:50:10 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:50:10 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:50:10 user nova-compute[74039]:   </clock>
Oct 20 08:50:10 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:50:10 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:50:10 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:50:10 user nova-compute[74039]:   </cpu>
Oct 20 08:50:10 user nova-compute[74039]:   <devices>
Oct 20 08:50:10 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:50:10 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:50:10 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue"/>
Oct 20 08:50:10 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:50:10 user nova-compute[74039]:     </disk>
Oct 20 08:50:10 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:50:10 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:50:10 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk"/>
Oct 20 08:50:10 user nova-compute[74039]:       <target dev="vdb" bus="virtio"/>
Oct 20 08:50:10 user nova-compute[74039]:     </disk>
Oct 20 08:50:10 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:50:10 user nova-compute[74039]:       <mac address="fa:16:3e:3e:2e:b3"/>
Oct 20 08:50:10 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:50:10 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:50:10 user nova-compute[74039]:       <target dev="tap24716055-59"/>
Oct 20 08:50:10 user nova-compute[74039]:     </interface>
Oct 20 08:50:10 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:50:10 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/console.log" append="off"/>
Oct 20 08:50:10 user nova-compute[74039]:     </serial>
Oct 20 08:50:10 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:50:10 user nova-compute[74039]:     <video>
Oct 20 08:50:10 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:50:10 user nova-compute[74039]:     </video>
Oct 20 08:50:10 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:50:10 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:50:10 user nova-compute[74039]:     </rng>
Oct 20 08:50:10 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:50:10 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:50:10 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:50:10 user nova-compute[74039]:     </memballoon>
Oct 20 08:50:10 user nova-compute[74039]:   </devices>
Oct 20 08:50:10 user nova-compute[74039]: </domain>
Oct 20 08:50:10 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:50:10 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Instance destroyed successfully.
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] No VIF found with MAC fa:16:3e:3e:2e:b3, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-5a3b6cc0-66c2-49c0-9ce6-aab44ddc9965 req-3b16923f-424d-493a-b2cf-68fdb6b9c51d service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Received event network-changed-708d272c-3434-4525-bcbd-3ee50e71eb47 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-5a3b6cc0-66c2-49c0-9ce6-aab44ddc9965 req-3b16923f-424d-493a-b2cf-68fdb6b9c51d service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Refreshing instance network info cache due to event network-changed-708d272c-3434-4525-bcbd-3ee50e71eb47. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5a3b6cc0-66c2-49c0-9ce6-aab44ddc9965 req-3b16923f-424d-493a-b2cf-68fdb6b9c51d service nova] Acquiring lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5a3b6cc0-66c2-49c0-9ce6-aab44ddc9965 req-3b16923f-424d-493a-b2cf-68fdb6b9c51d service nova] Acquired lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:50:10 user nova-compute[74039]: DEBUG nova.network.neutron [req-5a3b6cc0-66c2-49c0-9ce6-aab44ddc9965 req-3b16923f-424d-493a-b2cf-68fdb6b9c51d service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Refreshing network info cache for port 708d272c-3434-4525-bcbd-3ee50e71eb47 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:50:11 user nova-compute[74039]: DEBUG nova.network.neutron [req-5a3b6cc0-66c2-49c0-9ce6-aab44ddc9965 req-3b16923f-424d-493a-b2cf-68fdb6b9c51d service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Updated VIF entry in instance network info cache for port 708d272c-3434-4525-bcbd-3ee50e71eb47. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:50:11 user nova-compute[74039]: DEBUG nova.network.neutron [req-5a3b6cc0-66c2-49c0-9ce6-aab44ddc9965 req-3b16923f-424d-493a-b2cf-68fdb6b9c51d service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Updating instance_info_cache with network_info: [{"id": "708d272c-3434-4525-bcbd-3ee50e71eb47", "address": "fa:16:3e:3f:80:75", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708d272c-34", "ovs_interfaceid": "708d272c-3434-4525-bcbd-3ee50e71eb47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:50:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5a3b6cc0-66c2-49c0-9ce6-aab44ddc9965 req-3b16923f-424d-493a-b2cf-68fdb6b9c51d service nova] Releasing lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:50:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:12 user nova-compute[74039]: DEBUG nova.compute.manager [req-08d7f5a0-59da-472b-aeba-33f141402bcc req-96c95847-2145-4f67-a8cc-a51c5a6b6131 service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Received event network-vif-plugged-24716055-5932-4507-8742-840afce654a2 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:50:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-08d7f5a0-59da-472b-aeba-33f141402bcc req-96c95847-2145-4f67-a8cc-a51c5a6b6131 service nova] Acquiring lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-08d7f5a0-59da-472b-aeba-33f141402bcc req-96c95847-2145-4f67-a8cc-a51c5a6b6131 service nova] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-08d7f5a0-59da-472b-aeba-33f141402bcc req-96c95847-2145-4f67-a8cc-a51c5a6b6131 service nova] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:50:12 user nova-compute[74039]: DEBUG nova.compute.manager [req-08d7f5a0-59da-472b-aeba-33f141402bcc req-96c95847-2145-4f67-a8cc-a51c5a6b6131 service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] No waiting events found dispatching network-vif-plugged-24716055-5932-4507-8742-840afce654a2 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:50:12 user nova-compute[74039]: WARNING nova.compute.manager [req-08d7f5a0-59da-472b-aeba-33f141402bcc req-96c95847-2145-4f67-a8cc-a51c5a6b6131 service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Received unexpected event network-vif-plugged-24716055-5932-4507-8742-840afce654a2 for instance with vm_state active and task_state rescuing.
Oct 20 08:50:12 user nova-compute[74039]: DEBUG nova.compute.manager [req-08d7f5a0-59da-472b-aeba-33f141402bcc req-96c95847-2145-4f67-a8cc-a51c5a6b6131 service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Received event network-changed-903853f8-c5ee-49d4-9896-b50b043842c6 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:50:12 user nova-compute[74039]: DEBUG nova.compute.manager [req-08d7f5a0-59da-472b-aeba-33f141402bcc req-96c95847-2145-4f67-a8cc-a51c5a6b6131 service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Refreshing instance network info cache due to event network-changed-903853f8-c5ee-49d4-9896-b50b043842c6. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:50:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-08d7f5a0-59da-472b-aeba-33f141402bcc req-96c95847-2145-4f67-a8cc-a51c5a6b6131 service nova] Acquiring lock "refresh_cache-971fb41b-7fce-4ffe-b785-5d86f435004a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:50:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-08d7f5a0-59da-472b-aeba-33f141402bcc req-96c95847-2145-4f67-a8cc-a51c5a6b6131 service nova] Acquired lock "refresh_cache-971fb41b-7fce-4ffe-b785-5d86f435004a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:50:12 user nova-compute[74039]: DEBUG nova.network.neutron [req-08d7f5a0-59da-472b-aeba-33f141402bcc req-96c95847-2145-4f67-a8cc-a51c5a6b6131 service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Refreshing network info cache for port 903853f8-c5ee-49d4-9896-b50b043842c6 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:50:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:12 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:50:12 user nova-compute[74039]: INFO nova.compute.manager [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] instance snapshotting
Oct 20 08:50:12 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Beginning live snapshot process
Oct 20 08:50:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG nova.network.neutron [req-08d7f5a0-59da-472b-aeba-33f141402bcc req-96c95847-2145-4f67-a8cc-a51c5a6b6131 service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Updated VIF entry in instance network info cache for port 903853f8-c5ee-49d4-9896-b50b043842c6. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG nova.network.neutron [req-08d7f5a0-59da-472b-aeba-33f141402bcc req-96c95847-2145-4f67-a8cc-a51c5a6b6131 service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Updating instance_info_cache with network_info: [{"id": "903853f8-c5ee-49d4-9896-b50b043842c6", "address": "fa:16:3e:58:48:ef", "network": {"id": "298357dd-0031-4c33-8c72-269e894c8d86", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-324557364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7efa953a4a4049925485acdb855247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903853f8-c5", "ovs_interfaceid": "903853f8-c5ee-49d4-9896-b50b043842c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-08d7f5a0-59da-472b-aeba-33f141402bcc req-96c95847-2145-4f67-a8cc-a51c5a6b6131 service nova] Releasing lock "refresh_cache-971fb41b-7fce-4ffe-b785-5d86f435004a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-08d7f5a0-59da-472b-aeba-33f141402bcc req-96c95847-2145-4f67-a8cc-a51c5a6b6131 service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Received event network-vif-plugged-24716055-5932-4507-8742-840afce654a2 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-08d7f5a0-59da-472b-aeba-33f141402bcc req-96c95847-2145-4f67-a8cc-a51c5a6b6131 service nova] Acquiring lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-08d7f5a0-59da-472b-aeba-33f141402bcc req-96c95847-2145-4f67-a8cc-a51c5a6b6131 service nova] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-08d7f5a0-59da-472b-aeba-33f141402bcc req-96c95847-2145-4f67-a8cc-a51c5a6b6131 service nova] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-08d7f5a0-59da-472b-aeba-33f141402bcc req-96c95847-2145-4f67-a8cc-a51c5a6b6131 service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] No waiting events found dispatching network-vif-plugged-24716055-5932-4507-8742-840afce654a2 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:50:13 user nova-compute[74039]: WARNING nova.compute.manager [req-08d7f5a0-59da-472b-aeba-33f141402bcc req-96c95847-2145-4f67-a8cc-a51c5a6b6131 service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Received unexpected event network-vif-plugged-24716055-5932-4507-8742-840afce654a2 for instance with vm_state active and task_state rescuing.
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json -f qcow2 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json -f qcow2 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.245s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplhxmo2rn/c0b67f6091a84eb5aa1240a6045b218d.delta 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplhxmo2rn/c0b67f6091a84eb5aa1240a6045b218d.delta 1073741824" returned: 0 in 0.057s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:13 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 08:50:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74039) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 20 08:50:13 user nova-compute[74039]: INFO nova.virt.libvirt.host [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] UEFI support detected
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:14 user nova-compute[74039]: DEBUG nova.compute.manager [req-c567f972-872d-45bd-93e7-b439344a6d1a req-a3911097-22ad-46ce-bf64-d91735f6af6b service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Received event network-vif-plugged-24716055-5932-4507-8742-840afce654a2 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:50:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c567f972-872d-45bd-93e7-b439344a6d1a req-a3911097-22ad-46ce-bf64-d91735f6af6b service nova] Acquiring lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c567f972-872d-45bd-93e7-b439344a6d1a req-a3911097-22ad-46ce-bf64-d91735f6af6b service nova] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c567f972-872d-45bd-93e7-b439344a6d1a req-a3911097-22ad-46ce-bf64-d91735f6af6b service nova] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:50:14 user nova-compute[74039]: DEBUG nova.compute.manager [req-c567f972-872d-45bd-93e7-b439344a6d1a req-a3911097-22ad-46ce-bf64-d91735f6af6b service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] No waiting events found dispatching network-vif-plugged-24716055-5932-4507-8742-840afce654a2 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:50:14 user nova-compute[74039]: WARNING nova.compute.manager [req-c567f972-872d-45bd-93e7-b439344a6d1a req-a3911097-22ad-46ce-bf64-d91735f6af6b service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Received unexpected event network-vif-plugged-24716055-5932-4507-8742-840afce654a2 for instance with vm_state active and task_state rescuing.
Oct 20 08:50:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:14 user nova-compute[74039]: DEBUG nova.compute.manager [None req-e165af29-0e26-4e98-b827-4fa34f6a514c tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:50:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:50:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:50:15 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 08:50:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:15 user nova-compute[74039]: DEBUG nova.privsep.utils [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74039) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 08:50:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplhxmo2rn/c0b67f6091a84eb5aa1240a6045b218d.delta /opt/stack/data/nova/instances/snapshots/tmplhxmo2rn/c0b67f6091a84eb5aa1240a6045b218d {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplhxmo2rn/c0b67f6091a84eb5aa1240a6045b218d.delta /opt/stack/data/nova/instances/snapshots/tmplhxmo2rn/c0b67f6091a84eb5aa1240a6045b218d" returned: 0 in 0.724s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:16 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Snapshot extracted, beginning image upload
Oct 20 08:50:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:17 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:50:17 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:50:17 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7629MB free_disk=25.781822204589844GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 08:50:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:17 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 9fe77a96-fcb5-4410-85cc-58d925548e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:50:17 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c8054dbd-c0ae-45d2-af95-dae7d05f8c69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:50:17 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:50:17 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 971fb41b-7fce-4ffe-b785-5d86f435004a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:50:17 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance ff1bca5e-9337-466c-866d-e9c91cf9200c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:50:17 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 500a0ed6-ac37-4274-a8f2-2545c270e24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:50:17 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:50:17 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 365da377-4031-4e1b-bc85-6dcaf721548e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:50:17 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 08:50:17 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 08:50:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:17 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing inventories for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 08:50:17 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Updating ProviderTree inventory for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 08:50:17 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Updating inventory in ProviderTree for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 08:50:17 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing aggregate associations for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb, aggregates: None {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 08:50:17 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing trait associations for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 08:50:18 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:50:18 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:50:18 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 08:50:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.722s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:50:19 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:50:19 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:50:19 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 08:50:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-c8054dbd-c0ae-45d2-af95-dae7d05f8c69" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:50:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-c8054dbd-c0ae-45d2-af95-dae7d05f8c69" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:50:19 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 08:50:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:19 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Updating instance_info_cache with network_info: [{"id": "24716055-5932-4507-8742-840afce654a2", "address": "fa:16:3e:3e:2e:b3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24716055-59", "ovs_interfaceid": "24716055-5932-4507-8742-840afce654a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:50:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-c8054dbd-c0ae-45d2-af95-dae7d05f8c69" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:50:19 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 08:50:19 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:50:19 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:50:19 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Snapshot image upload complete
Oct 20 08:50:19 user nova-compute[74039]: INFO nova.compute.manager [None req-b33a8700-3af5-4fbf-aeab-3bbfd41dae6d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Took 7.15 seconds to snapshot the instance on the hypervisor.
Oct 20 08:50:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:50:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-bf9be48f-5755-452f-be8b-e19c0dd596ae req-db0b47d0-adfd-4e39-b198-c89f3d4eed82 service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Received event network-changed-ca5407cc-32fc-44c3-a80d-ff65f007eeb8 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:50:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-bf9be48f-5755-452f-be8b-e19c0dd596ae req-db0b47d0-adfd-4e39-b198-c89f3d4eed82 service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Refreshing instance network info cache due to event network-changed-ca5407cc-32fc-44c3-a80d-ff65f007eeb8. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:50:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bf9be48f-5755-452f-be8b-e19c0dd596ae req-db0b47d0-adfd-4e39-b198-c89f3d4eed82 service nova] Acquiring lock "refresh_cache-ff1bca5e-9337-466c-866d-e9c91cf9200c" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:50:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bf9be48f-5755-452f-be8b-e19c0dd596ae req-db0b47d0-adfd-4e39-b198-c89f3d4eed82 service nova] Acquired lock "refresh_cache-ff1bca5e-9337-466c-866d-e9c91cf9200c" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:50:29 user nova-compute[74039]: DEBUG nova.network.neutron [req-bf9be48f-5755-452f-be8b-e19c0dd596ae req-db0b47d0-adfd-4e39-b198-c89f3d4eed82 service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Refreshing network info cache for port ca5407cc-32fc-44c3-a80d-ff65f007eeb8 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:50:30 user nova-compute[74039]: DEBUG nova.network.neutron [req-bf9be48f-5755-452f-be8b-e19c0dd596ae req-db0b47d0-adfd-4e39-b198-c89f3d4eed82 service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Updated VIF entry in instance network info cache for port ca5407cc-32fc-44c3-a80d-ff65f007eeb8. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:50:30 user nova-compute[74039]: DEBUG nova.network.neutron [req-bf9be48f-5755-452f-be8b-e19c0dd596ae req-db0b47d0-adfd-4e39-b198-c89f3d4eed82 service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Updating instance_info_cache with network_info: [{"id": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "address": "fa:16:3e:41:ce:3e", "network": {"id": "66bd8b72-b934-4e08-b441-7b206e30191f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-800457541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de66876449e146b797bf3d5d95086a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5407cc-32", "ovs_interfaceid": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:50:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bf9be48f-5755-452f-be8b-e19c0dd596ae req-db0b47d0-adfd-4e39-b198-c89f3d4eed82 service nova] Releasing lock "refresh_cache-ff1bca5e-9337-466c-866d-e9c91cf9200c" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:50:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:34 user nova-compute[74039]: DEBUG nova.compute.manager [req-70838b5d-e639-4e68-80b9-a5d06f2d0b11 req-60e1ffc7-ebcf-4ae2-852e-f39e3dc36645 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Received event network-changed-32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:50:34 user nova-compute[74039]: DEBUG nova.compute.manager [req-70838b5d-e639-4e68-80b9-a5d06f2d0b11 req-60e1ffc7-ebcf-4ae2-852e-f39e3dc36645 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Refreshing instance network info cache due to event network-changed-32230627-2f50-465b-a608-a88969f6408e. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:50:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-70838b5d-e639-4e68-80b9-a5d06f2d0b11 req-60e1ffc7-ebcf-4ae2-852e-f39e3dc36645 service nova] Acquiring lock "refresh_cache-500a0ed6-ac37-4274-a8f2-2545c270e24b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:50:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-70838b5d-e639-4e68-80b9-a5d06f2d0b11 req-60e1ffc7-ebcf-4ae2-852e-f39e3dc36645 service nova] Acquired lock "refresh_cache-500a0ed6-ac37-4274-a8f2-2545c270e24b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:50:34 user nova-compute[74039]: DEBUG nova.network.neutron [req-70838b5d-e639-4e68-80b9-a5d06f2d0b11 req-60e1ffc7-ebcf-4ae2-852e-f39e3dc36645 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Refreshing network info cache for port 32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:50:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Acquiring lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:35 user nova-compute[74039]: DEBUG nova.objects.instance [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lazy-loading 'flavor' on Instance uuid 500a0ed6-ac37-4274-a8f2-2545c270e24b {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:50:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:50:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Acquiring lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:35 user nova-compute[74039]: INFO nova.compute.manager [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Attaching volume e60bbfa7-eab8-4fc5-a82e-16fbe709c040 to /dev/vdb
Oct 20 08:50:35 user nova-compute[74039]: DEBUG nova.network.neutron [req-70838b5d-e639-4e68-80b9-a5d06f2d0b11 req-60e1ffc7-ebcf-4ae2-852e-f39e3dc36645 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Updated VIF entry in instance network info cache for port 32230627-2f50-465b-a608-a88969f6408e. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:50:35 user nova-compute[74039]: DEBUG nova.network.neutron [req-70838b5d-e639-4e68-80b9-a5d06f2d0b11 req-60e1ffc7-ebcf-4ae2-852e-f39e3dc36645 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Updating instance_info_cache with network_info: [{"id": "32230627-2f50-465b-a608-a88969f6408e", "address": "fa:16:3e:d0:00:0b", "network": {"id": "0e446eb7-aecd-4543-8e09-3b3805b2a25c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-708280870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96471e080e8d4674aadc99f0892074a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32230627-2f", "ovs_interfaceid": "32230627-2f50-465b-a608-a88969f6408e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:50:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Acquiring lock "ff1bca5e-9337-466c-866d-e9c91cf9200c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "ff1bca5e-9337-466c-866d-e9c91cf9200c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-70838b5d-e639-4e68-80b9-a5d06f2d0b11 req-60e1ffc7-ebcf-4ae2-852e-f39e3dc36645 service nova] Releasing lock "refresh_cache-500a0ed6-ac37-4274-a8f2-2545c270e24b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:50:35 user nova-compute[74039]: DEBUG nova.objects.instance [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lazy-loading 'flavor' on Instance uuid ff1bca5e-9337-466c-866d-e9c91cf9200c {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:50:35 user nova-compute[74039]: DEBUG os_brick.utils [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:50:35 user nova-compute[74039]: INFO oslo.privsep.daemon [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpillvtg0h/privsep.sock']
Oct 20 08:50:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "ff1bca5e-9337-466c-866d-e9c91cf9200c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:50:35 user sudo[85463]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpillvtg0h/privsep.sock
Oct 20 08:50:35 user sudo[85463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 08:50:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Acquiring lock "ff1bca5e-9337-466c-866d-e9c91cf9200c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "ff1bca5e-9337-466c-866d-e9c91cf9200c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:35 user nova-compute[74039]: INFO nova.compute.manager [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Attaching volume 98431df8-ae6c-4284-a16c-fb2b5ef08a5d to /dev/sdc
Oct 20 08:50:36 user nova-compute[74039]: DEBUG os_brick.utils [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:50:37 user sudo[85463]: pam_unix(sudo:session): session closed for user root
Oct 20 08:50:37 user nova-compute[74039]: INFO oslo.privsep.daemon [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Spawned new privsep daemon via rootwrap
Oct 20 08:50:37 user nova-compute[74039]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 08:50:37 user nova-compute[74039]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 08:50:37 user nova-compute[74039]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 20 08:50:37 user nova-compute[74039]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85466
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd716606-1d3b-4440-a5fe-bd0105a04928]: (2,) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:37 user nova-compute[74039]: WARNING oslo_privsep.priv_context [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] privsep daemon already running
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f5df6b-36b9-46a5-b779-33a6588c39ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:37 user nova-compute[74039]: WARNING os_brick.initiator.connectors.nvmeof [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9515fb-b74b-4c05-9814-e3eb17c214ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[12018513-15e0-42c3-a7c7-b2106e8d97f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.031s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9226c26c-2524-4790-a087-09cafa2f21a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[25583281-5bdf-4d79-bec1-7beb8b345905]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8f10dc-1d41-45fe-a79b-7b9093deb165]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0381ee-62ea-4a03-8bbe-3e9f9f7176a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aa0157-ece4-40f8-867c-d8fdf3a3b802]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:50:37 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3f9888-8f8a-4bf3-a3b5-abc197d947a4]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:50:37 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:50:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0eed1e5-6689-4b56-9ad3-0d990cdb2c42]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG os_brick.utils [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] <== get_connector_properties: return (2077ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Updating existing volume attachment record: e0f2fd49-e243-43bf-ab3b-6f15ab2fe23a {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG os_brick.utils [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] <== get_connector_properties: return (1772ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:50:37 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Updating existing volume attachment record: bb2710ad-9b41-431d-89ec-190537646318 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 08:50:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "70e52f06-4f2a-4431-8149-2228565072e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:41 user nova-compute[74039]: DEBUG nova.compute.manager [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 08:50:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:41 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:50:41 user nova-compute[74039]: INFO nova.compute.claims [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Claim successful on node user
Oct 20 08:50:41 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:50:41 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG nova.compute.manager [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG nova.compute.manager [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG nova.network.neutron [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:50:42 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 08:50:42 user nova-compute[74039]: DEBUG nova.compute.manager [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 08:50:42 user nova-compute[74039]: INFO nova.virt.block_device [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Booting with volume 5ddf3a93-eecd-4682-8412-6209c4c708aa at /dev/vda
Oct 20 08:50:42 user nova-compute[74039]: DEBUG nova.policy [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dabfaebbed414fe1bddedb1b4e02d358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b602fae310894282bb68869684db4965', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG os_brick.utils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6554935e-60b8-45be-ba40-14e5e2eb2b2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad8ae55-d6ab-4a31-974d-e35c5f0b33d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d88c456-9a6c-4395-acfb-d87ee84a4a2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c7d505-1ab6-4f9c-8c22-c0774d8d9ea5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:50:42 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:50:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0e6804-7860-4449-8f78-6fbbcbc89326]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG os_brick.utils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Updating existing volume attachment record: 9edf32e8-923b-4e1f-a649-d3471f0f4b8f {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 08:50:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:43 user nova-compute[74039]: DEBUG nova.network.neutron [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Successfully created port: 559c1e42-8d19-4a1a-b6e9-385cb497a7df {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:50:43 user nova-compute[74039]: DEBUG nova.compute.manager [req-1d37e7ea-8dc8-4d27-83e3-dfb937f28cb5 req-9044afdd-99de-46bb-b2db-b5cfa66ad38d service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Received event network-changed-64d1e940-638e-4992-83cc-4c3d515d7d7c {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:50:43 user nova-compute[74039]: DEBUG nova.compute.manager [req-1d37e7ea-8dc8-4d27-83e3-dfb937f28cb5 req-9044afdd-99de-46bb-b2db-b5cfa66ad38d service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Refreshing instance network info cache due to event network-changed-64d1e940-638e-4992-83cc-4c3d515d7d7c. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:50:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1d37e7ea-8dc8-4d27-83e3-dfb937f28cb5 req-9044afdd-99de-46bb-b2db-b5cfa66ad38d service nova] Acquiring lock "refresh_cache-7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:50:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1d37e7ea-8dc8-4d27-83e3-dfb937f28cb5 req-9044afdd-99de-46bb-b2db-b5cfa66ad38d service nova] Acquired lock "refresh_cache-7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:50:43 user nova-compute[74039]: DEBUG nova.network.neutron [req-1d37e7ea-8dc8-4d27-83e3-dfb937f28cb5 req-9044afdd-99de-46bb-b2db-b5cfa66ad38d service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Refreshing network info cache for port 64d1e940-638e-4992-83cc-4c3d515d7d7c {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:50:43 user nova-compute[74039]: DEBUG nova.network.neutron [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Successfully created port: ea5ca163-f56a-49dc-ba70-a18ab6e4cd11 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:50:44 user nova-compute[74039]: DEBUG nova.network.neutron [req-1d37e7ea-8dc8-4d27-83e3-dfb937f28cb5 req-9044afdd-99de-46bb-b2db-b5cfa66ad38d service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Updated VIF entry in instance network info cache for port 64d1e940-638e-4992-83cc-4c3d515d7d7c. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:50:44 user nova-compute[74039]: DEBUG nova.network.neutron [req-1d37e7ea-8dc8-4d27-83e3-dfb937f28cb5 req-9044afdd-99de-46bb-b2db-b5cfa66ad38d service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Updating instance_info_cache with network_info: [{"id": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "address": "fa:16:3e:1d:51:19", "network": {"id": "81514bfa-76db-4527-832f-f0214a1b0501", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2103077624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44db9563c584bb482055ddb6ac19447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1e940-63", "ovs_interfaceid": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:50:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1d37e7ea-8dc8-4d27-83e3-dfb937f28cb5 req-9044afdd-99de-46bb-b2db-b5cfa66ad38d service nova] Releasing lock "refresh_cache-7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:50:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:44 user nova-compute[74039]: DEBUG nova.network.neutron [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Successfully created port: 7c0a6d7c-1f14-4014-baf3-784dd0f5ef18 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:50:45 user nova-compute[74039]: DEBUG nova.network.neutron [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Successfully created port: 90bf8dcb-50f9-4f4b-a743-07754de5bddf {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:50:45 user nova-compute[74039]: DEBUG nova.network.neutron [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Successfully created port: a2ec0b8d-c5ed-4f71-9b28-76b48949f029 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:50:46 user nova-compute[74039]: DEBUG nova.network.neutron [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Successfully updated port: 559c1e42-8d19-4a1a-b6e9-385cb497a7df {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:50:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-15cdba51-9bb9-4000-8fc6-79257e21ce9b req-50a12f0f-e140-4acb-9899-36c52379d9c1 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-changed-559c1e42-8d19-4a1a-b6e9-385cb497a7df {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:50:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-15cdba51-9bb9-4000-8fc6-79257e21ce9b req-50a12f0f-e140-4acb-9899-36c52379d9c1 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Refreshing instance network info cache due to event network-changed-559c1e42-8d19-4a1a-b6e9-385cb497a7df. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:50:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-15cdba51-9bb9-4000-8fc6-79257e21ce9b req-50a12f0f-e140-4acb-9899-36c52379d9c1 service nova] Acquiring lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:50:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-15cdba51-9bb9-4000-8fc6-79257e21ce9b req-50a12f0f-e140-4acb-9899-36c52379d9c1 service nova] Acquired lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:50:46 user nova-compute[74039]: DEBUG nova.network.neutron [req-15cdba51-9bb9-4000-8fc6-79257e21ce9b req-50a12f0f-e140-4acb-9899-36c52379d9c1 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Refreshing network info cache for port 559c1e42-8d19-4a1a-b6e9-385cb497a7df {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:50:46 user nova-compute[74039]: DEBUG nova.network.neutron [req-15cdba51-9bb9-4000-8fc6-79257e21ce9b req-50a12f0f-e140-4acb-9899-36c52379d9c1 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:50:46 user nova-compute[74039]: DEBUG nova.network.neutron [req-15cdba51-9bb9-4000-8fc6-79257e21ce9b req-50a12f0f-e140-4acb-9899-36c52379d9c1 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:50:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-15cdba51-9bb9-4000-8fc6-79257e21ce9b req-50a12f0f-e140-4acb-9899-36c52379d9c1 service nova] Releasing lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:50:47 user nova-compute[74039]: DEBUG nova.network.neutron [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Successfully updated port: 1e9c8977-ca97-4285-b762-d5ceb5f701ef {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:50:47 user nova-compute[74039]: DEBUG nova.compute.manager [req-66633f4e-0db9-4085-920f-d27374aecf68 req-4a7a397f-f409-4cf3-81d1-a89a4617095b service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received event network-changed-8c246ad5-f489-4486-b930-9d4a1cb60c41 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:50:47 user nova-compute[74039]: DEBUG nova.compute.manager [req-66633f4e-0db9-4085-920f-d27374aecf68 req-4a7a397f-f409-4cf3-81d1-a89a4617095b service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Refreshing instance network info cache due to event network-changed-8c246ad5-f489-4486-b930-9d4a1cb60c41. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:50:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-66633f4e-0db9-4085-920f-d27374aecf68 req-4a7a397f-f409-4cf3-81d1-a89a4617095b service nova] Acquiring lock "refresh_cache-365da377-4031-4e1b-bc85-6dcaf721548e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:50:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-66633f4e-0db9-4085-920f-d27374aecf68 req-4a7a397f-f409-4cf3-81d1-a89a4617095b service nova] Acquired lock "refresh_cache-365da377-4031-4e1b-bc85-6dcaf721548e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:50:47 user nova-compute[74039]: DEBUG nova.network.neutron [req-66633f4e-0db9-4085-920f-d27374aecf68 req-4a7a397f-f409-4cf3-81d1-a89a4617095b service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Refreshing network info cache for port 8c246ad5-f489-4486-b930-9d4a1cb60c41 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:50:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquiring lock "interface-365da377-4031-4e1b-bc85-6dcaf721548e-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "interface-365da377-4031-4e1b-bc85-6dcaf721548e-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:47 user nova-compute[74039]: DEBUG nova.objects.instance [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lazy-loading 'flavor' on Instance uuid 365da377-4031-4e1b-bc85-6dcaf721548e {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:50:48 user nova-compute[74039]: DEBUG nova.network.neutron [req-66633f4e-0db9-4085-920f-d27374aecf68 req-4a7a397f-f409-4cf3-81d1-a89a4617095b service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Updated VIF entry in instance network info cache for port 8c246ad5-f489-4486-b930-9d4a1cb60c41. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:50:48 user nova-compute[74039]: DEBUG nova.network.neutron [req-66633f4e-0db9-4085-920f-d27374aecf68 req-4a7a397f-f409-4cf3-81d1-a89a4617095b service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Updating instance_info_cache with network_info: [{"id": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "address": "fa:16:3e:8e:e7:14", "network": {"id": "48788255-d08e-4361-9b44-b6554c28bc6b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-33959125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c246ad5-f4", "ovs_interfaceid": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:50:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-66633f4e-0db9-4085-920f-d27374aecf68 req-4a7a397f-f409-4cf3-81d1-a89a4617095b service nova] Releasing lock "refresh_cache-365da377-4031-4e1b-bc85-6dcaf721548e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:50:48 user nova-compute[74039]: DEBUG nova.objects.instance [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lazy-loading 'pci_requests' on Instance uuid 365da377-4031-4e1b-bc85-6dcaf721548e {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:50:48 user nova-compute[74039]: DEBUG nova.objects.base [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Object Instance<365da377-4031-4e1b-bc85-6dcaf721548e> lazy-loaded attributes: flavor,pci_requests {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 08:50:48 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:50:48 user nova-compute[74039]: DEBUG nova.compute.manager [req-9f8061d2-993f-4df2-94d6-85e21e102f71 req-ed017cda-0a99-4d18-833f-b9442d2fa60d service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-changed-1e9c8977-ca97-4285-b762-d5ceb5f701ef {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:50:48 user nova-compute[74039]: DEBUG nova.compute.manager [req-9f8061d2-993f-4df2-94d6-85e21e102f71 req-ed017cda-0a99-4d18-833f-b9442d2fa60d service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Refreshing instance network info cache due to event network-changed-1e9c8977-ca97-4285-b762-d5ceb5f701ef. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:50:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9f8061d2-993f-4df2-94d6-85e21e102f71 req-ed017cda-0a99-4d18-833f-b9442d2fa60d service nova] Acquiring lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:50:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9f8061d2-993f-4df2-94d6-85e21e102f71 req-ed017cda-0a99-4d18-833f-b9442d2fa60d service nova] Acquired lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:50:48 user nova-compute[74039]: DEBUG nova.network.neutron [req-9f8061d2-993f-4df2-94d6-85e21e102f71 req-ed017cda-0a99-4d18-833f-b9442d2fa60d service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Refreshing network info cache for port 1e9c8977-ca97-4285-b762-d5ceb5f701ef {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:50:48 user nova-compute[74039]: DEBUG nova.policy [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29ca829a96484751876ead6f2b094e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f437448d494f75838a2c7b2b6a973f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:50:48 user nova-compute[74039]: DEBUG nova.network.neutron [req-9f8061d2-993f-4df2-94d6-85e21e102f71 req-ed017cda-0a99-4d18-833f-b9442d2fa60d service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:50:48 user nova-compute[74039]: DEBUG nova.network.neutron [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Successfully updated port: aa5d3f5c-ff64-4554-9ecb-b9e14730d29a {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:50:48 user nova-compute[74039]: DEBUG nova.network.neutron [req-9f8061d2-993f-4df2-94d6-85e21e102f71 req-ed017cda-0a99-4d18-833f-b9442d2fa60d service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:50:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9f8061d2-993f-4df2-94d6-85e21e102f71 req-ed017cda-0a99-4d18-833f-b9442d2fa60d service nova] Releasing lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:50:48 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Successfully created port: dd29358a-8456-4b27-8a8c-38206751a25c {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:50:49 user nova-compute[74039]: DEBUG nova.network.neutron [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Successfully updated port: ea5ca163-f56a-49dc-ba70-a18ab6e4cd11 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:50:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:49 user nova-compute[74039]: DEBUG nova.network.neutron [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Successfully updated port: 7c0a6d7c-1f14-4014-baf3-784dd0f5ef18 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:50:49 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Successfully updated port: dd29358a-8456-4b27-8a8c-38206751a25c {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:50:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquiring lock "refresh_cache-365da377-4031-4e1b-bc85-6dcaf721548e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:50:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquired lock "refresh_cache-365da377-4031-4e1b-bc85-6dcaf721548e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:50:49 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:50:49 user nova-compute[74039]: DEBUG nova.compute.manager [req-94234b91-d613-41ad-8ce8-d12f433544b5 req-17c1e435-288d-47df-94d7-e33499264f9c service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received event network-changed-dd29358a-8456-4b27-8a8c-38206751a25c {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:50:49 user nova-compute[74039]: DEBUG nova.compute.manager [req-94234b91-d613-41ad-8ce8-d12f433544b5 req-17c1e435-288d-47df-94d7-e33499264f9c service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Refreshing instance network info cache due to event network-changed-dd29358a-8456-4b27-8a8c-38206751a25c. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:50:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-94234b91-d613-41ad-8ce8-d12f433544b5 req-17c1e435-288d-47df-94d7-e33499264f9c service nova] Acquiring lock "refresh_cache-365da377-4031-4e1b-bc85-6dcaf721548e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG nova.compute.manager [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-changed-aa5d3f5c-ff64-4554-9ecb-b9e14730d29a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG nova.compute.manager [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Refreshing instance network info cache due to event network-changed-aa5d3f5c-ff64-4554-9ecb-b9e14730d29a. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] Acquiring lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] Acquired lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG nova.network.neutron [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Refreshing network info cache for port aa5d3f5c-ff64-4554-9ecb-b9e14730d29a {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG nova.network.neutron [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG nova.network.neutron [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Successfully updated port: 90bf8dcb-50f9-4f4b-a743-07754de5bddf {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Updating instance_info_cache with network_info: [{"id": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "address": "fa:16:3e:8e:e7:14", "network": {"id": "48788255-d08e-4361-9b44-b6554c28bc6b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-33959125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c246ad5-f4", "ovs_interfaceid": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd29358a-8456-4b27-8a8c-38206751a25c", "address": "fa:16:3e:60:45:3e", "network": {"id": "3774a21d-147a-442f-a2c8-b94306649d95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-954620919", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29358a-84", "ovs_interfaceid": "dd29358a-8456-4b27-8a8c-38206751a25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Releasing lock "refresh_cache-365da377-4031-4e1b-bc85-6dcaf721548e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-94234b91-d613-41ad-8ce8-d12f433544b5 req-17c1e435-288d-47df-94d7-e33499264f9c service nova] Acquired lock "refresh_cache-365da377-4031-4e1b-bc85-6dcaf721548e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG nova.network.neutron [req-94234b91-d613-41ad-8ce8-d12f433544b5 req-17c1e435-288d-47df-94d7-e33499264f9c service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Refreshing network info cache for port dd29358a-8456-4b27-8a8c-38206751a25c {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:48:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2124112502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2124112502',id=8,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADEixoB6QWWhTLuwL+7Z2fkKKWHkyf3tVdnf4752CWzbdJ5lz/PbSjwRzike1kbeQLqKQLtsajre3rrJlFKfvXx6m1o9pCXfJmA6Y4TeaBnPAeS7YpGXhczqHT/lsYEnw==',key_name='tempest-keypair-1295832388',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:49:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='40f437448d494f75838a2c7b2b6a973f',ramdisk_id='',reservation_id='r-d06qmgd5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-92531413',owner_user_name='tempest-TaggedAttachmentsTest-92531413-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:49:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29ca829a96484751876ead6f2b094e54',uuid=365da377-4031-4e1b-bc85-6dcaf721548e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd29358a-8456-4b27-8a8c-38206751a25c", "address": "fa:16:3e:60:45:3e", "network": {"id": "3774a21d-147a-442f-a2c8-b94306649d95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-954620919", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29358a-84", "ovs_interfaceid": "dd29358a-8456-4b27-8a8c-38206751a25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Converting VIF {"id": "dd29358a-8456-4b27-8a8c-38206751a25c", "address": "fa:16:3e:60:45:3e", "network": {"id": "3774a21d-147a-442f-a2c8-b94306649d95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-954620919", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29358a-84", "ovs_interfaceid": "dd29358a-8456-4b27-8a8c-38206751a25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:45:3e,bridge_name='br-int',has_traffic_filtering=True,id=dd29358a-8456-4b27-8a8c-38206751a25c,network=Network(3774a21d-147a-442f-a2c8-b94306649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd29358a-84') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG os_vif [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:45:3e,bridge_name='br-int',has_traffic_filtering=True,id=dd29358a-8456-4b27-8a8c-38206751a25c,network=Network(3774a21d-147a-442f-a2c8-b94306649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd29358a-84') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c828d432-fb10-52fc-a4aa-ac1e463e7642', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd29358a-84, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd29358a-84, col_values=(('qos', UUID('aa856901-957e-4963-8eb1-5a4877155d7e')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd29358a-84, col_values=(('external_ids', {'iface-id': 'dd29358a-8456-4b27-8a8c-38206751a25c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:45:3e', 'vm-uuid': '365da377-4031-4e1b-bc85-6dcaf721548e'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG nova.network.neutron [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:50 user nova-compute[74039]: INFO os_vif [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:45:3e,bridge_name='br-int',has_traffic_filtering=True,id=dd29358a-8456-4b27-8a8c-38206751a25c,network=Network(3774a21d-147a-442f-a2c8-b94306649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd29358a-84')
Oct 20 08:50:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:48:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2124112502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2124112502',id=8,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADEixoB6QWWhTLuwL+7Z2fkKKWHkyf3tVdnf4752CWzbdJ5lz/PbSjwRzike1kbeQLqKQLtsajre3rrJlFKfvXx6m1o9pCXfJmA6Y4TeaBnPAeS7YpGXhczqHT/lsYEnw==',key_name='tempest-keypair-1295832388',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:49:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='40f437448d494f75838a2c7b2b6a973f',ramdisk_id='',reservation_id='r-d06qmgd5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-92531413',owner_user_name='tempest-TaggedAttachmentsTest-92531413-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:49:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29ca829a96484751876ead6f2b094e54',uuid=365da377-4031-4e1b-bc85-6dcaf721548e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd29358a-8456-4b27-8a8c-38206751a25c", "address": "fa:16:3e:60:45:3e", "network": {"id": "3774a21d-147a-442f-a2c8-b94306649d95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-954620919", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29358a-84", "ovs_interfaceid": "dd29358a-8456-4b27-8a8c-38206751a25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Converting VIF {"id": "dd29358a-8456-4b27-8a8c-38206751a25c", "address": "fa:16:3e:60:45:3e", "network": {"id": "3774a21d-147a-442f-a2c8-b94306649d95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-954620919", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29358a-84", "ovs_interfaceid": "dd29358a-8456-4b27-8a8c-38206751a25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:45:3e,bridge_name='br-int',has_traffic_filtering=True,id=dd29358a-8456-4b27-8a8c-38206751a25c,network=Network(3774a21d-147a-442f-a2c8-b94306649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd29358a-84') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] Releasing lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG nova.compute.manager [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-changed-ea5ca163-f56a-49dc-ba70-a18ab6e4cd11 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG nova.compute.manager [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Refreshing instance network info cache due to event network-changed-ea5ca163-f56a-49dc-ba70-a18ab6e4cd11. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] Acquiring lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] Acquired lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG nova.network.neutron [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Refreshing network info cache for port ea5ca163-f56a-49dc-ba70-a18ab6e4cd11 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] attach device xml: <interface type="ethernet">
Oct 20 08:50:50 user nova-compute[74039]:   <mac address="fa:16:3e:60:45:3e"/>
Oct 20 08:50:50 user nova-compute[74039]:   <model type="virtio"/>
Oct 20 08:50:50 user nova-compute[74039]:   <mtu size="1442"/>
Oct 20 08:50:50 user nova-compute[74039]:   <target dev="tapdd29358a-84"/>
Oct 20 08:50:50 user nova-compute[74039]: </interface>
Oct 20 08:50:50 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG nova.network.neutron [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG nova.network.neutron [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] Releasing lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-changed-7c0a6d7c-1f14-4014-baf3-784dd0f5ef18 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Refreshing instance network info cache due to event network-changed-7c0a6d7c-1f14-4014-baf3-784dd0f5ef18. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] Acquiring lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] Acquired lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG nova.network.neutron [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Refreshing network info cache for port 7c0a6d7c-1f14-4014-baf3-784dd0f5ef18 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] No BDM found with device name hda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] No VIF found with MAC fa:16:3e:8e:e7:14, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG nova.network.neutron [req-94234b91-d613-41ad-8ce8-d12f433544b5 req-17c1e435-288d-47df-94d7-e33499264f9c service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Updated VIF entry in instance network info cache for port dd29358a-8456-4b27-8a8c-38206751a25c. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG nova.network.neutron [req-94234b91-d613-41ad-8ce8-d12f433544b5 req-17c1e435-288d-47df-94d7-e33499264f9c service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Updating instance_info_cache with network_info: [{"id": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "address": "fa:16:3e:8e:e7:14", "network": {"id": "48788255-d08e-4361-9b44-b6554c28bc6b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-33959125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c246ad5-f4", "ovs_interfaceid": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd29358a-8456-4b27-8a8c-38206751a25c", "address": "fa:16:3e:60:45:3e", "network": {"id": "3774a21d-147a-442f-a2c8-b94306649d95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-954620919", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29358a-84", "ovs_interfaceid": "dd29358a-8456-4b27-8a8c-38206751a25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-94234b91-d613-41ad-8ce8-d12f433544b5 req-17c1e435-288d-47df-94d7-e33499264f9c service nova] Releasing lock "refresh_cache-365da377-4031-4e1b-bc85-6dcaf721548e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:50:51 user nova-compute[74039]:   <nova:package version="0.0.0"/>
Oct 20 08:50:51 user nova-compute[74039]:   <nova:name>tempest-device-tagging-server-2124112502</nova:name>
Oct 20 08:50:51 user nova-compute[74039]:   <nova:creationTime>2023-10-20 08:50:51</nova:creationTime>
Oct 20 08:50:51 user nova-compute[74039]:   <nova:flavor name="m1.tiny">
Oct 20 08:50:51 user nova-compute[74039]:     <nova:memory>512</nova:memory>
Oct 20 08:50:51 user nova-compute[74039]:     <nova:disk>1</nova:disk>
Oct 20 08:50:51 user nova-compute[74039]:     <nova:swap>0</nova:swap>
Oct 20 08:50:51 user nova-compute[74039]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:50:51 user nova-compute[74039]:     <nova:vcpus>1</nova:vcpus>
Oct 20 08:50:51 user nova-compute[74039]:   </nova:flavor>
Oct 20 08:50:51 user nova-compute[74039]:   <nova:owner>
Oct 20 08:50:51 user nova-compute[74039]:     <nova:user uuid="29ca829a96484751876ead6f2b094e54">tempest-TaggedAttachmentsTest-92531413-project-member</nova:user>
Oct 20 08:50:51 user nova-compute[74039]:     <nova:project uuid="40f437448d494f75838a2c7b2b6a973f">tempest-TaggedAttachmentsTest-92531413</nova:project>
Oct 20 08:50:51 user nova-compute[74039]:   </nova:owner>
Oct 20 08:50:51 user nova-compute[74039]:   <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:50:51 user nova-compute[74039]:   <nova:ports>
Oct 20 08:50:51 user nova-compute[74039]:     <nova:port uuid="8c246ad5-f489-4486-b930-9d4a1cb60c41">
Oct 20 08:50:51 user nova-compute[74039]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 08:50:51 user nova-compute[74039]:     </nova:port>
Oct 20 08:50:51 user nova-compute[74039]:     <nova:port uuid="dd29358a-8456-4b27-8a8c-38206751a25c">
Oct 20 08:50:51 user nova-compute[74039]:       <nova:ip type="fixed" address="10.10.10.210" ipVersion="4"/>
Oct 20 08:50:51 user nova-compute[74039]:     </nova:port>
Oct 20 08:50:51 user nova-compute[74039]:   </nova:ports>
Oct 20 08:50:51 user nova-compute[74039]: </nova:instance>
Oct 20 08:50:51 user nova-compute[74039]:  {{(pid=74039) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG nova.network.neutron [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f6d73a45-6b0d-4574-8843-8fea3b5d4557 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "interface-365da377-4031-4e1b-bc85-6dcaf721548e-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.267s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG nova.network.neutron [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:50:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c4dace4a-c4c4-4e38-a761-e2edc0550f9d req-ead37dcb-a001-4d84-90ed-05c5139fdf34 service nova] Releasing lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:50:52 user nova-compute[74039]: DEBUG nova.network.neutron [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Successfully updated port: a2ec0b8d-c5ed-4f71-9b28-76b48949f029 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:50:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Acquiring lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:50:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Acquired lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:50:52 user nova-compute[74039]: DEBUG nova.network.neutron [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:50:52 user nova-compute[74039]: DEBUG nova.network.neutron [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:50:52 user nova-compute[74039]: DEBUG nova.compute.manager [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-changed-90bf8dcb-50f9-4f4b-a743-07754de5bddf {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:50:52 user nova-compute[74039]: DEBUG nova.compute.manager [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Refreshing instance network info cache due to event network-changed-90bf8dcb-50f9-4f4b-a743-07754de5bddf. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:50:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] Acquiring lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:50:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:53 user nova-compute[74039]: DEBUG nova.network.neutron [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Updating instance_info_cache with network_info: [{"id": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "address": "fa:16:3e:63:9f:0c", "network": {"id": "b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-648216651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559c1e42-8d", "ovs_interfaceid": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "address": "fa:16:3e:36:b9:ef", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9c8977-ca", "ovs_interfaceid": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "address": "fa:16:3e:36:6e:69", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5d3f5c-ff", "ovs_interfaceid": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "address": "fa:16:3e:ec:24:89", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ca163-f5", "ovs_interfaceid": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "address": "fa:16:3e:7d:de:76", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0a6d7c-1f", "ovs_interfaceid": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "address": "fa:16:3e:14:f4:6b", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bf8dcb-50", "ovs_interfaceid": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "address": "fa:16:3e:b7:1c:11", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ec0b8d-c5", "ovs_interfaceid": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:50:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Releasing lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:50:53 user nova-compute[74039]: DEBUG nova.compute.manager [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Instance network_info: |[{"id": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "address": "fa:16:3e:63:9f:0c", "network": {"id": "b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-648216651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559c1e42-8d", "ovs_interfaceid": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "address": "fa:16:3e:36:b9:ef", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9c8977-ca", "ovs_interfaceid": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "address": "fa:16:3e:36:6e:69", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5d3f5c-ff", "ovs_interfaceid": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "address": "fa:16:3e:ec:24:89", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ca163-f5", "ovs_interfaceid": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "address": "fa:16:3e:7d:de:76", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0a6d7c-1f", "ovs_interfaceid": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "address": "fa:16:3e:14:f4:6b", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bf8dcb-50", "ovs_interfaceid": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "address": "fa:16:3e:b7:1c:11", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ec0b8d-c5", "ovs_interfaceid": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 08:50:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] Acquired lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:50:53 user nova-compute[74039]: DEBUG nova.network.neutron [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Refreshing network info cache for port 90bf8dcb-50f9-4f4b-a743-07754de5bddf {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:50:54 user nova-compute[74039]: DEBUG nova.network.neutron [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Updated VIF entry in instance network info cache for port 90bf8dcb-50f9-4f4b-a743-07754de5bddf. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:50:54 user nova-compute[74039]: DEBUG nova.network.neutron [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Updating instance_info_cache with network_info: [{"id": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "address": "fa:16:3e:63:9f:0c", "network": {"id": "b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-648216651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559c1e42-8d", "ovs_interfaceid": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "address": "fa:16:3e:36:b9:ef", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9c8977-ca", "ovs_interfaceid": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "address": "fa:16:3e:36:6e:69", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5d3f5c-ff", "ovs_interfaceid": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "address": "fa:16:3e:ec:24:89", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ca163-f5", "ovs_interfaceid": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "address": "fa:16:3e:7d:de:76", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0a6d7c-1f", "ovs_interfaceid": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "address": "fa:16:3e:14:f4:6b", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bf8dcb-50", "ovs_interfaceid": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "address": "fa:16:3e:b7:1c:11", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ec0b8d-c5", "ovs_interfaceid": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:50:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] Releasing lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:50:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received event network-vif-plugged-dd29358a-8456-4b27-8a8c-38206751a25c {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:50:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] Acquiring lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] Lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] Lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:50:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] No waiting events found dispatching network-vif-plugged-dd29358a-8456-4b27-8a8c-38206751a25c {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:50:54 user nova-compute[74039]: WARNING nova.compute.manager [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received unexpected event network-vif-plugged-dd29358a-8456-4b27-8a8c-38206751a25c for instance with vm_state active and task_state None.
Oct 20 08:50:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received event network-vif-plugged-dd29358a-8456-4b27-8a8c-38206751a25c {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:50:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] Acquiring lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] Lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] Lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:50:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] No waiting events found dispatching network-vif-plugged-dd29358a-8456-4b27-8a8c-38206751a25c {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:50:54 user nova-compute[74039]: WARNING nova.compute.manager [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received unexpected event network-vif-plugged-dd29358a-8456-4b27-8a8c-38206751a25c for instance with vm_state active and task_state None.
Oct 20 08:50:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-changed-a2ec0b8d-c5ed-4f71-9b28-76b48949f029 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:50:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Refreshing instance network info cache due to event network-changed-a2ec0b8d-c5ed-4f71-9b28-76b48949f029. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:50:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] Acquiring lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:50:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] Acquired lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:50:54 user nova-compute[74039]: DEBUG nova.network.neutron [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Refreshing network info cache for port a2ec0b8d-c5ed-4f71-9b28-76b48949f029 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:50:54 user nova-compute[74039]: DEBUG nova.network.neutron [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Updated VIF entry in instance network info cache for port a2ec0b8d-c5ed-4f71-9b28-76b48949f029. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:50:54 user nova-compute[74039]: DEBUG nova.network.neutron [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Updating instance_info_cache with network_info: [{"id": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "address": "fa:16:3e:63:9f:0c", "network": {"id": "b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-648216651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559c1e42-8d", "ovs_interfaceid": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "address": "fa:16:3e:36:b9:ef", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9c8977-ca", "ovs_interfaceid": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "address": "fa:16:3e:36:6e:69", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5d3f5c-ff", "ovs_interfaceid": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "address": "fa:16:3e:ec:24:89", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ca163-f5", "ovs_interfaceid": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "address": "fa:16:3e:7d:de:76", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0a6d7c-1f", "ovs_interfaceid": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "address": "fa:16:3e:14:f4:6b", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bf8dcb-50", "ovs_interfaceid": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "address": "fa:16:3e:b7:1c:11", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ec0b8d-c5", "ovs_interfaceid": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:50:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bd78f860-1364-41d1-b709-b9cd0e6707a2 req-e48ca26d-fafb-4482-a6a8-fc6fd6df3af4 service nova] Releasing lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connector [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Factory for ISCSI on None {{(pid=74039) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.008s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyrEHPNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:50:55 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:50:55 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:50:55 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f8a6eb-75db-439d-b8e9-6439179fbf6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 08:50:55 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd732fb9-1843-496e-b400-f9a7982b80da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d] added
Oct 20 08:50:55 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[222539ba-642f-4376-8412-24a6b8cd539f]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa25a14f-9a40-40ff-8262-c3defbdc2bad]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jyrEHPNl {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jyrEHPNl" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f94f01a-bb4d-4b6f-bf38-916708e89530]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jyrEHPNl'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[460e9702-1792-4715-94da-8fcdb7cbec29]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ab4c3c-6690-4b7d-bac3-b12927b51fd6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 08:50:55 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 08:50:55 user nova-compute[74039]:  {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:50:55 user nova-compute[74039]: WARNING os_brick.initiator.connectors.iscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 08:50:55 user nova-compute[74039]: 
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a19b97-9b2a-475c-9524-be4925c1b960]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d, portal: 172.16.0.220,3260]
Oct 20 08:50:55 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d, portal: 172.16.0.220,3260] successful.
Oct 20 08:50:55 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b547992-4c79-4655-be0e-979fb030c11c]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Acquiring lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[81836fdd-1400-4628-a39d-ec86cad60b8c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)
Oct 20 08:50:55 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)
Oct 20 08:50:55 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG nova.objects.instance [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Lazy-loading 'flavor' on Instance uuid 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquiring lock "365da377-4031-4e1b-bc85-6dcaf721548e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "365da377-4031-4e1b-bc85-6dcaf721548e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15e5b59-04b6-4a4c-a96d-92b0e882252e]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyrEHPNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG nova.objects.instance [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lazy-loading 'flavor' on Instance uuid 365da377-4031-4e1b-bc85-6dcaf721548e {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:50:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "365da377-4031-4e1b-bc85-6dcaf721548e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:50:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Acquiring lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:56 user nova-compute[74039]: INFO nova.compute.manager [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Attaching volume 20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c to /dev/vdb
Oct 20 08:50:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquiring lock "365da377-4031-4e1b-bc85-6dcaf721548e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:50:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "365da377-4031-4e1b-bc85-6dcaf721548e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:50:56 user nova-compute[74039]: INFO nova.compute.manager [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Attaching volume 23973811-16c5-48ea-932b-84766d5be0a7 to /dev/vdb
Oct 20 08:50:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:50:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23462376533396435', 'path': '/dev/sdb'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:50:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462376533396435', 'path': '/dev/sdb'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 08:50:56 user nova-compute[74039]: DEBUG nova.objects.instance [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lazy-loading 'flavor' on Instance uuid ff1bca5e-9337-466c-866d-e9c91cf9200c {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:50:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 08:50:56 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:50:56 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 08:50:56 user nova-compute[74039]:   <target dev="sdc" bus="scsi"/>
Oct 20 08:50:56 user nova-compute[74039]:   <serial>98431df8-ae6c-4284-a16c-fb2b5ef08a5d</serial>
Oct 20 08:50:56 user nova-compute[74039]:   <address type="drive" controller="0" unit="2"/>
Oct 20 08:50:56 user nova-compute[74039]: </disk>
Oct 20 08:50:56 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG os_brick.utils [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9e12c7-c512-46ee-b87c-5183648ebe69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG os_brick.utils [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefeaef2-455b-4ad3-a395-634ebb1dabb4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf94235f-9db7-4c27-81af-15b02540a18f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daf721d-f0f0-4d61-8736-c3b267ad4336]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a947fbf7-97cd-4010-a26e-0e07bc6ec4b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b743e376-505f-4378-a124-4a08ff85a3c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:50:57 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d2e4e6-d9a8-4e15-8182-196936e12846]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[876ba991-68e5-44ea-9cbd-0ad216ad10dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG os_brick.utils [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Updating existing volume attachment record: 0ffbae0a-f954-475c-8b24-af5c316bcb99 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c30577-2ceb-4d6a-8f8f-7d643774216c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] No BDM found with device name sda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] No VIF found with MAC fa:16:3e:41:ce:3e, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:50:57 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:50:57 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e14ed45-106b-4306-9b26-fa38e3d4bd0f]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG os_brick.utils [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] <== get_connector_properties: return (196ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Updating existing volume attachment record: 188e93d6-b23c-47a1-818c-fca86c575d4d {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 08:50:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:08 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:51:08 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:51:08 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 08:51:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:10 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:51:10 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:51:12 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:51:12 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:51:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:51:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:51:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:51:12 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 08:51:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (sdc) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 08:51:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:51:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:16 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:51:16 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:51:16 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7757MB free_disk=25.717632293701172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 08:51:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:51:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:51:16 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 9fe77a96-fcb5-4410-85cc-58d925548e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:51:16 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c8054dbd-c0ae-45d2-af95-dae7d05f8c69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:51:16 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:51:16 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 971fb41b-7fce-4ffe-b785-5d86f435004a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:51:16 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance ff1bca5e-9337-466c-866d-e9c91cf9200c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:51:16 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 500a0ed6-ac37-4274-a8f2-2545c270e24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:51:16 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:51:16 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 365da377-4031-4e1b-bc85-6dcaf721548e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:51:16 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 70e52f06-4f2a-4431-8149-2228565072e6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:51:16 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 08:51:16 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 08:51:16 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:51:16 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:51:16 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 08:51:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:51:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:17 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:51:17 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:51:17 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Updating instance_info_cache with network_info: [{"id": "708d272c-3434-4525-bcbd-3ee50e71eb47", "address": "fa:16:3e:3f:80:75", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708d272c-34", "ovs_interfaceid": "708d272c-3434-4525-bcbd-3ee50e71eb47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bfjyqgCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:51:18 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:51:18 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:51:18 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c81020d-1ea7-4576-ad3f-fb8ffc6ae0a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 08:51:18 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PniZewAR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:51:18 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96c9942-1af6-4d51-96b6-7df40e8631be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040] added
Oct 20 08:51:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9381e60c-24ff-4719-92ca-cc5c58d9906e]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcfe54d-f94a-4c43-aff6-3e656808f3fc]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bfjyqgCi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-68c336ab-4ae5-466f-8b18-345104e53cad tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "ff1bca5e-9337-466c-866d-e9c91cf9200c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 42.851s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bfjyqgCi" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ece3aa-5519-4b83-acbd-d25467fe7d05]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bfjyqgCi'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c9fb8e-a3d7-425e-9852-86e57ecb8308]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9ff0a1-e917-46a3-8f73-14909ac62968]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)
Oct 20 08:51:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)
Oct 20 08:51:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[663a5e0e-9cc9-428b-873a-00ba3d1aa26e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040, portal: 172.16.0.220,3260]
Oct 20 08:51:18 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040, portal: 172.16.0.220,3260] successful.
Oct 20 08:51:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[34caf678-b9eb-45a4-ba57-8eb196ba982c]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[796c1181-cbf7-445e-8b9c-d62008018364]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)
Oct 20 08:51:18 user nova-compute[74039]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:51:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)
Oct 20 08:51:18 user nova-compute[74039]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:51:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fab45a6-63b6-467c-b3fe-f6b46c36b049]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:51:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bfjyqgCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 08:51:18 user nova-compute[74039]: INFO nova.virt.block_device [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Booting with volume e05c25ad-8992-4e59-9b12-2e99c5129e08 at /dev/vdb
Oct 20 08:51:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EgsXeRcM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:51:19 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:51:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG os_brick.utils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dae07ce-973b-44e9-a392-2a68f8234aef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f42642-f213-49b3-827b-3e156f7556e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d885a4d-cac3-4f6c-898c-47625800fb1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[08060b74-93b4-4430-a0c8-f42a72de8565]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:51:19 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:51:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[97335516-85de-476b-ac4a-8892d9f68cb5]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG os_brick.utils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Updating existing volume attachment record: 88e0b537-9cc9-46bb-8102-0b798af4f011 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Acquiring lock "ff1bca5e-9337-466c-866d-e9c91cf9200c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "ff1bca5e-9337-466c-866d-e9c91cf9200c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:51:19 user nova-compute[74039]: INFO nova.compute.manager [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Detaching volume 98431df8-ae6c-4284-a16c-fb2b5ef08a5d
Oct 20 08:51:19 user nova-compute[74039]: INFO nova.virt.block_device [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Attempting to driver detach volume 98431df8-ae6c-4284-a16c-fb2b5ef08a5d from mountpoint /dev/sdc
Oct 20 08:51:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Attempting to detach device sdc from instance ff1bca5e-9337-466c-866d-e9c91cf9200c from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 08:51:19 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:51:19 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 08:51:19 user nova-compute[74039]:   <target dev="sdc" bus="scsi"/>
Oct 20 08:51:19 user nova-compute[74039]:   <serial>98431df8-ae6c-4284-a16c-fb2b5ef08a5d</serial>
Oct 20 08:51:19 user nova-compute[74039]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 20 08:51:19 user nova-compute[74039]: </disk>
Oct 20 08:51:19 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 08:51:19 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Successfully detached device sdc from instance ff1bca5e-9337-466c-866d-e9c91cf9200c from the persistent domain config.
Oct 20 08:51:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance ff1bca5e-9337-466c-866d-e9c91cf9200c from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 08:51:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 08:51:19 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:51:19 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 08:51:19 user nova-compute[74039]:   <target dev="sdc" bus="scsi"/>
Oct 20 08:51:19 user nova-compute[74039]:   <serial>98431df8-ae6c-4284-a16c-fb2b5ef08a5d</serial>
Oct 20 08:51:19 user nova-compute[74039]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 20 08:51:19 user nova-compute[74039]: </disk>
Oct 20 08:51:19 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26266633734306262', 'path': '/dev/sdc'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266633734306262', 'path': '/dev/sdc'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.299s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:51:20 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:51:20 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG nova.objects.instance [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lazy-loading 'flavor' on Instance uuid 500a0ed6-ac37-4274-a8f2-2545c270e24b {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4005d03-91e0-4ea0-b0db-c645c8f37245]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 08:51:20 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 08:51:20 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:51:20 user nova-compute[74039]:   <source dev="/dev/sdc"/>
Oct 20 08:51:20 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 08:51:20 user nova-compute[74039]:   <serial>e60bbfa7-eab8-4fc5-a82e-16fbe709c040</serial>
Oct 20 08:51:20 user nova-compute[74039]: </disk>
Oct 20 08:51:20 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a5286d-0611-4067-86d4-0fa307a3c7b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7] added
Oct 20 08:51:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8beb19-f6d0-43bc-b1db-dff61abcbfc7]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance ff1bca5e-9337-466c-866d-e9c91cf9200c {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a854918a-37be-45fc-84ca-d8694f2aad5d]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PniZewAR {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PniZewAR" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e807c9b6-63d0-408a-9ef7-dd17b00d286d]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PniZewAR'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f9e74b-6bdb-488e-8815-470be2c79e93]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffd52b6-7754-4068-8522-f8131c606ff6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)
Oct 20 08:51:20 user nova-compute[74039]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:51:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)
Oct 20 08:51:20 user nova-compute[74039]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:51:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[921ec42e-29f2-4fc0-8992-87afb57d0182]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7, portal: 172.16.0.220,3260]
Oct 20 08:51:20 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7, portal: 172.16.0.220,3260] successful.
Oct 20 08:51:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1325683a-8098-4bf8-a4c6-49df1d1d4212]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacdcf01-c769-4462-b910-5fb1d95f9bd4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)
Oct 20 08:51:20 user nova-compute[74039]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:51:20 user nova-compute[74039]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)
Oct 20 08:51:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)
Oct 20 08:51:20 user nova-compute[74039]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:51:20 user nova-compute[74039]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)
Oct 20 08:51:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[280fee03-f93f-4ebb-92f7-7d6f89069061]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PniZewAR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG nova.compute.manager [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] No VIF found with MAC fa:16:3e:d0:00:0b, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:20 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:51:20 user nova-compute[74039]: INFO nova.compute.claims [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Claim successful on node user
Oct 20 08:51:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-622f6ebc-73a7-4b04-ad1e-1f3c9df22f8b tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 45.139s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.624s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG nova.compute.manager [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG nova.compute.manager [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG nova.network.neutron [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] <== connect_volume: return (2664ms) {'type': 'block', 'scsi_wwn': '26464653464383463', 'path': '/dev/sdd'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464653464383463', 'path': '/dev/sdd'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.354s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:51:21 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:51:21 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG nova.objects.instance [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lazy-loading 'flavor' on Instance uuid 365da377-4031-4e1b-bc85-6dcaf721548e {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:51:21 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b94a29-814c-49c9-8396-ce19322392f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 08:51:21 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 08:51:21 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:51:21 user nova-compute[74039]:   <source dev="/dev/sdd"/>
Oct 20 08:51:21 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 08:51:21 user nova-compute[74039]:   <serial>23973811-16c5-48ea-932b-84766d5be0a7</serial>
Oct 20 08:51:21 user nova-compute[74039]: </disk>
Oct 20 08:51:21 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4694344-bbf3-4ec7-b956-7985d6f95230]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c] added
Oct 20 08:51:21 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[06daacb0-744b-421e-96a1-026ed2490277]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51404e6-fa5a-4a52-8c2b-7728415676d4]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EgsXeRcM {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG nova.compute.manager [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EgsXeRcM" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d286a4-f941-4cb9-ab99-a51335f8f801]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EgsXeRcM'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a435c59-c3ef-46ff-abd5-5ecef1daabbe]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b02330-f5a8-46b8-8576-138c2ede9d07]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)
Oct 20 08:51:21 user nova-compute[74039]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:51:21 user nova-compute[74039]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)
Oct 20 08:51:21 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)
Oct 20 08:51:21 user nova-compute[74039]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:51:21 user nova-compute[74039]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)
Oct 20 08:51:21 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:21 user nova-compute[74039]: INFO nova.virt.block_device [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Booting with volume 8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d at /dev/vda
Oct 20 08:51:21 user nova-compute[74039]: DEBUG nova.policy [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf9b8efde2e542e490d56ab047ab1d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a813e975532746078989fb217f969a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f51ea4-f58b-4e71-a77f-b5d06b3bbd6a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c, portal: 172.16.0.220,3260]
Oct 20 08:51:21 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c, portal: 172.16.0.220,3260] successful.
Oct 20 08:51:21 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca343fc-d50c-4b48-a55d-3e373f795d2e]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.utils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc829d61-6598-4ca8-ae25-8d4b155295c4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)
Oct 20 08:51:21 user nova-compute[74039]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:51:21 user nova-compute[74039]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)
Oct 20 08:51:21 user nova-compute[74039]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)
Oct 20 08:51:21 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)
Oct 20 08:51:21 user nova-compute[74039]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:51:21 user nova-compute[74039]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)
Oct 20 08:51:21 user nova-compute[74039]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)
Oct 20 08:51:21 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d83833a-1e7d-4975-91a5-1c83f7adc853]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[95af1e75-2358-4ec0-94a9-7c27b8fc45b5]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a421b7-3fd5-4902-ace8-40352b7669fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EgsXeRcM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2ce7d7-4e11-421b-b7c1-430e56ab5217]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bae631-b768-4b1e-b2f9-f804d4ca3ca2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:51:21 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:51:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b5c7ff-554a-4248-88e0-faffdf0b135f]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG os_brick.utils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:51:21 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Updating existing volume attachment record: be85cfa1-faf6-483d-a063-b1e9ce328289 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] No BDM found with device name hda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] No VIF found with MAC fa:16:3e:8e:e7:14, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Acquiring lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG os_brick.utils [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[645101ae-9e26-4ab3-8027-debc9b508350]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[312ae409-d699-4587-a9d4-09c1462263d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4f9892-5773-4fc9-91b5-2c68926c6fc5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[04554d82-3968-4c6c-a34e-62a8ad6f1a8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:51:22 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:51:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cc1d5a-7fe8-4d3d-8110-a53d9aa668fd]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG os_brick.utils [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4fd68f16-0582-4ebf-a817-e891a4b4d52f tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "365da377-4031-4e1b-bc85-6dcaf721548e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.743s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:51:22 user nova-compute[74039]: INFO nova.compute.manager [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Swapping volume e60bbfa7-eab8-4fc5-a82e-16fbe709c040 for 29263da0-2ddd-416e-98a9-52e451abff13
Oct 20 08:51:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.466s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] <== connect_volume: return (3821ms) {'type': 'block', 'scsi_wwn': '23233666137323935', 'path': '/dev/sde'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233666137323935', 'path': '/dev/sde'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG nova.objects.instance [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Lazy-loading 'flavor' on Instance uuid 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG nova.network.neutron [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Successfully created port: 89a71dec-6bb5-448c-8bc6-81c4c2096518 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:51:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] attach device xml: <disk type="block" device="disk">
Oct 20 08:51:22 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:51:22 user nova-compute[74039]:   <source dev="/dev/sde"/>
Oct 20 08:51:22 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 08:51:22 user nova-compute[74039]:   <serial>20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c</serial>
Oct 20 08:51:22 user nova-compute[74039]: </disk>
Oct 20 08:51:22 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 08:51:23 user nova-compute[74039]: DEBUG nova.network.neutron [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Successfully created port: 4dced799-a2ac-44eb-ac2f-f0f01f78b6c7 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:51:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:51:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:51:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] No VIF found with MAC fa:16:3e:1d:51:19, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:51:24 user nova-compute[74039]: DEBUG nova.network.neutron [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Successfully created port: 154a5063-b927-47c2-b08c-9073addff7ce {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:51:24 user nova-compute[74039]: DEBUG nova.network.neutron [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Successfully created port: 7b722390-36c0-4a62-a055-b8db6a876107 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:51:25 user nova-compute[74039]: DEBUG nova.network.neutron [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Successfully created port: 2ce3df1d-107d-4fd0-9443-d143cd17dfe5 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:51:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:25 user nova-compute[74039]: DEBUG nova.network.neutron [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Successfully updated port: 89a71dec-6bb5-448c-8bc6-81c4c2096518 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:51:25 user nova-compute[74039]: DEBUG nova.compute.manager [req-0b3d1a27-2101-4e4a-90e2-932026f0481c req-ff908af3-18e3-4b2f-9fd7-bc9a7c6ea27a service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-changed-89a71dec-6bb5-448c-8bc6-81c4c2096518 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:51:25 user nova-compute[74039]: DEBUG nova.compute.manager [req-0b3d1a27-2101-4e4a-90e2-932026f0481c req-ff908af3-18e3-4b2f-9fd7-bc9a7c6ea27a service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Refreshing instance network info cache due to event network-changed-89a71dec-6bb5-448c-8bc6-81c4c2096518. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:51:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0b3d1a27-2101-4e4a-90e2-932026f0481c req-ff908af3-18e3-4b2f-9fd7-bc9a7c6ea27a service nova] Acquiring lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:51:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0b3d1a27-2101-4e4a-90e2-932026f0481c req-ff908af3-18e3-4b2f-9fd7-bc9a7c6ea27a service nova] Acquired lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:51:25 user nova-compute[74039]: DEBUG nova.network.neutron [req-0b3d1a27-2101-4e4a-90e2-932026f0481c req-ff908af3-18e3-4b2f-9fd7-bc9a7c6ea27a service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Refreshing network info cache for port 89a71dec-6bb5-448c-8bc6-81c4c2096518 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:51:26 user nova-compute[74039]: DEBUG nova.network.neutron [req-0b3d1a27-2101-4e4a-90e2-932026f0481c req-ff908af3-18e3-4b2f-9fd7-bc9a7c6ea27a service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:51:26 user nova-compute[74039]: DEBUG nova.network.neutron [req-0b3d1a27-2101-4e4a-90e2-932026f0481c req-ff908af3-18e3-4b2f-9fd7-bc9a7c6ea27a service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:51:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0b3d1a27-2101-4e4a-90e2-932026f0481c req-ff908af3-18e3-4b2f-9fd7-bc9a7c6ea27a service nova] Releasing lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:51:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Successfully updated port: 1c8f7b72-7806-406d-9d21-a8193be01c97 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:51:27 user nova-compute[74039]: DEBUG nova.network.neutron [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Successfully updated port: a25aacf0-6498-44b2-aff7-c6aa628dd132 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:51:27 user nova-compute[74039]: DEBUG nova.network.neutron [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Successfully updated port: 4dced799-a2ac-44eb-ac2f-f0f01f78b6c7 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:51:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-changed-1c8f7b72-7806-406d-9d21-a8193be01c97 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:51:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Refreshing instance network info cache due to event network-changed-1c8f7b72-7806-406d-9d21-a8193be01c97. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:51:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] Acquiring lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:51:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] Acquired lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:51:27 user nova-compute[74039]: DEBUG nova.network.neutron [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Refreshing network info cache for port 1c8f7b72-7806-406d-9d21-a8193be01c97 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:51:28 user nova-compute[74039]: DEBUG nova.network.neutron [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:51:28 user nova-compute[74039]: DEBUG nova.network.neutron [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:51:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] Releasing lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:51:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-changed-a25aacf0-6498-44b2-aff7-c6aa628dd132 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:51:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Refreshing instance network info cache due to event network-changed-a25aacf0-6498-44b2-aff7-c6aa628dd132. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:51:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] Acquiring lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:51:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] Acquired lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:51:28 user nova-compute[74039]: DEBUG nova.network.neutron [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Refreshing network info cache for port a25aacf0-6498-44b2-aff7-c6aa628dd132 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:51:28 user nova-compute[74039]: DEBUG nova.network.neutron [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:51:28 user nova-compute[74039]: DEBUG nova.network.neutron [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:51:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] Releasing lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:51:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-changed-4dced799-a2ac-44eb-ac2f-f0f01f78b6c7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:51:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Refreshing instance network info cache due to event network-changed-4dced799-a2ac-44eb-ac2f-f0f01f78b6c7. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:51:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] Acquiring lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:51:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] Acquired lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:51:28 user nova-compute[74039]: DEBUG nova.network.neutron [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Refreshing network info cache for port 4dced799-a2ac-44eb-ac2f-f0f01f78b6c7 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:51:28 user nova-compute[74039]: DEBUG nova.network.neutron [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:51:28 user nova-compute[74039]: DEBUG nova.network.neutron [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Successfully updated port: 154a5063-b927-47c2-b08c-9073addff7ce {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:51:29 user nova-compute[74039]: DEBUG nova.network.neutron [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:51:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e06c2a5c-68a2-4d82-a1a6-a21440230744 req-f77a87f1-e826-43c7-bd3c-c386911ee4b3 service nova] Releasing lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:51:29 user nova-compute[74039]: DEBUG nova.network.neutron [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Successfully updated port: 7b722390-36c0-4a62-a055-b8db6a876107 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-e98fe309-08e9-49c6-b52a-41fcfca16069 req-3ddf3085-c0a3-4ab7-85de-31dc146a39bf service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-changed-154a5063-b927-47c2-b08c-9073addff7ce {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-e98fe309-08e9-49c6-b52a-41fcfca16069 req-3ddf3085-c0a3-4ab7-85de-31dc146a39bf service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Refreshing instance network info cache due to event network-changed-154a5063-b927-47c2-b08c-9073addff7ce. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e98fe309-08e9-49c6-b52a-41fcfca16069 req-3ddf3085-c0a3-4ab7-85de-31dc146a39bf service nova] Acquiring lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e98fe309-08e9-49c6-b52a-41fcfca16069 req-3ddf3085-c0a3-4ab7-85de-31dc146a39bf service nova] Acquired lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG nova.network.neutron [req-e98fe309-08e9-49c6-b52a-41fcfca16069 req-3ddf3085-c0a3-4ab7-85de-31dc146a39bf service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Refreshing network info cache for port 154a5063-b927-47c2-b08c-9073addff7ce {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG nova.network.neutron [req-e98fe309-08e9-49c6-b52a-41fcfca16069 req-3ddf3085-c0a3-4ab7-85de-31dc146a39bf service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG nova.network.neutron [req-e98fe309-08e9-49c6-b52a-41fcfca16069 req-3ddf3085-c0a3-4ab7-85de-31dc146a39bf service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e98fe309-08e9-49c6-b52a-41fcfca16069 req-3ddf3085-c0a3-4ab7-85de-31dc146a39bf service nova] Releasing lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-e98fe309-08e9-49c6-b52a-41fcfca16069 req-3ddf3085-c0a3-4ab7-85de-31dc146a39bf service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-changed-7b722390-36c0-4a62-a055-b8db6a876107 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-e98fe309-08e9-49c6-b52a-41fcfca16069 req-3ddf3085-c0a3-4ab7-85de-31dc146a39bf service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Refreshing instance network info cache due to event network-changed-7b722390-36c0-4a62-a055-b8db6a876107. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e98fe309-08e9-49c6-b52a-41fcfca16069 req-3ddf3085-c0a3-4ab7-85de-31dc146a39bf service nova] Acquiring lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e98fe309-08e9-49c6-b52a-41fcfca16069 req-3ddf3085-c0a3-4ab7-85de-31dc146a39bf service nova] Acquired lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG nova.network.neutron [req-e98fe309-08e9-49c6-b52a-41fcfca16069 req-3ddf3085-c0a3-4ab7-85de-31dc146a39bf service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Refreshing network info cache for port 7b722390-36c0-4a62-a055-b8db6a876107 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG nova.network.neutron [req-e98fe309-08e9-49c6-b52a-41fcfca16069 req-3ddf3085-c0a3-4ab7-85de-31dc146a39bf service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG nova.network.neutron [req-e98fe309-08e9-49c6-b52a-41fcfca16069 req-3ddf3085-c0a3-4ab7-85de-31dc146a39bf service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG nova.network.neutron [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Successfully updated port: 2ce3df1d-107d-4fd0-9443-d143cd17dfe5 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e98fe309-08e9-49c6-b52a-41fcfca16069 req-3ddf3085-c0a3-4ab7-85de-31dc146a39bf service nova] Releasing lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Acquiring lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Acquired lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG nova.network.neutron [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:51:30 user nova-compute[74039]: DEBUG nova.network.neutron [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:51:32 user nova-compute[74039]: DEBUG nova.compute.manager [req-db180e41-24f8-496d-81b1-db1515a9e4ee req-a99e353b-9110-4f50-b6b4-66e953240499 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-changed-2ce3df1d-107d-4fd0-9443-d143cd17dfe5 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:51:32 user nova-compute[74039]: DEBUG nova.compute.manager [req-db180e41-24f8-496d-81b1-db1515a9e4ee req-a99e353b-9110-4f50-b6b4-66e953240499 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Refreshing instance network info cache due to event network-changed-2ce3df1d-107d-4fd0-9443-d143cd17dfe5. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:51:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-db180e41-24f8-496d-81b1-db1515a9e4ee req-a99e353b-9110-4f50-b6b4-66e953240499 service nova] Acquiring lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:51:32 user nova-compute[74039]: DEBUG nova.network.neutron [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Updating instance_info_cache with network_info: [{"id": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "address": "fa:16:3e:27:23:4b", "network": {"id": "723ba7d9-d7fc-4535-a2f6-1b39dc49a17b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915355671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a71dec-6b", "ovs_interfaceid": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1c8f7b72-7806-406d-9d21-a8193be01c97", "address": "fa:16:3e:df:20:46", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8f7b72-78", "ovs_interfaceid": "1c8f7b72-7806-406d-9d21-a8193be01c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "address": "fa:16:3e:7c:fd:34", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25aacf0-64", "ovs_interfaceid": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "address": "fa:16:3e:bf:f8:b5", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dced799-a2", "ovs_interfaceid": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "154a5063-b927-47c2-b08c-9073addff7ce", "address": "fa:16:3e:0b:46:4c", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154a5063-b9", "ovs_interfaceid": "154a5063-b927-47c2-b08c-9073addff7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b722390-36c0-4a62-a055-b8db6a876107", "address": "fa:16:3e:c8:55:48", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b722390-36", "ovs_interfaceid": "7b722390-36c0-4a62-a055-b8db6a876107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "address": "fa:16:3e:8e:3a:c0", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce3df1d-10", "ovs_interfaceid": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:51:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Releasing lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:51:32 user nova-compute[74039]: DEBUG nova.compute.manager [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Instance network_info: |[{"id": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "address": "fa:16:3e:27:23:4b", "network": {"id": "723ba7d9-d7fc-4535-a2f6-1b39dc49a17b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915355671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a71dec-6b", "ovs_interfaceid": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1c8f7b72-7806-406d-9d21-a8193be01c97", "address": "fa:16:3e:df:20:46", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8f7b72-78", "ovs_interfaceid": "1c8f7b72-7806-406d-9d21-a8193be01c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "address": "fa:16:3e:7c:fd:34", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25aacf0-64", "ovs_interfaceid": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "address": "fa:16:3e:bf:f8:b5", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dced799-a2", "ovs_interfaceid": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "154a5063-b927-47c2-b08c-9073addff7ce", "address": "fa:16:3e:0b:46:4c", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154a5063-b9", "ovs_interfaceid": "154a5063-b927-47c2-b08c-9073addff7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b722390-36c0-4a62-a055-b8db6a876107", "address": "fa:16:3e:c8:55:48", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b722390-36", "ovs_interfaceid": "7b722390-36c0-4a62-a055-b8db6a876107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "address": "fa:16:3e:8e:3a:c0", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce3df1d-10", "ovs_interfaceid": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 08:51:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-db180e41-24f8-496d-81b1-db1515a9e4ee req-a99e353b-9110-4f50-b6b4-66e953240499 service nova] Acquired lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:51:32 user nova-compute[74039]: DEBUG nova.network.neutron [req-db180e41-24f8-496d-81b1-db1515a9e4ee req-a99e353b-9110-4f50-b6b4-66e953240499 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Refreshing network info cache for port 2ce3df1d-107d-4fd0-9443-d143cd17dfe5 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:51:32 user nova-compute[74039]: DEBUG nova.network.neutron [req-db180e41-24f8-496d-81b1-db1515a9e4ee req-a99e353b-9110-4f50-b6b4-66e953240499 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Updated VIF entry in instance network info cache for port 2ce3df1d-107d-4fd0-9443-d143cd17dfe5. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:51:32 user nova-compute[74039]: DEBUG nova.network.neutron [req-db180e41-24f8-496d-81b1-db1515a9e4ee req-a99e353b-9110-4f50-b6b4-66e953240499 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Updating instance_info_cache with network_info: [{"id": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "address": "fa:16:3e:27:23:4b", "network": {"id": "723ba7d9-d7fc-4535-a2f6-1b39dc49a17b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915355671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a71dec-6b", "ovs_interfaceid": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1c8f7b72-7806-406d-9d21-a8193be01c97", "address": "fa:16:3e:df:20:46", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8f7b72-78", "ovs_interfaceid": "1c8f7b72-7806-406d-9d21-a8193be01c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "address": "fa:16:3e:7c:fd:34", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25aacf0-64", "ovs_interfaceid": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "address": "fa:16:3e:bf:f8:b5", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dced799-a2", "ovs_interfaceid": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "154a5063-b927-47c2-b08c-9073addff7ce", "address": "fa:16:3e:0b:46:4c", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154a5063-b9", "ovs_interfaceid": "154a5063-b927-47c2-b08c-9073addff7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b722390-36c0-4a62-a055-b8db6a876107", "address": "fa:16:3e:c8:55:48", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b722390-36", "ovs_interfaceid": "7b722390-36c0-4a62-a055-b8db6a876107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "address": "fa:16:3e:8e:3a:c0", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce3df1d-10", "ovs_interfaceid": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:51:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-db180e41-24f8-496d-81b1-db1515a9e4ee req-a99e353b-9110-4f50-b6b4-66e953240499 service nova] Releasing lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:51:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:51:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 08:51:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 08:51:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 08:51:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:40 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance ff1bca5e-9337-466c-866d-e9c91cf9200c is timed out.
Oct 20 08:51:40 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Successfully detached device sdc from instance ff1bca5e-9337-466c-866d-e9c91cf9200c from the live domain config.
Oct 20 08:51:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jyrEHPNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:51:40 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:51:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf0274b-e9fa-49db-af1c-c6631f59740f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 08:51:40 user nova-compute[74039]: No targets found.
Oct 20 08:51:40 user nova-compute[74039]: iSNS:
Oct 20 08:51:40 user nova-compute[74039]: No targets found.
Oct 20 08:51:40 user nova-compute[74039]: STATIC:
Oct 20 08:51:40 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040
Oct 20 08:51:40 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:51:40 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:51:40 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7
Oct 20 08:51:40 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:51:40 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:51:40 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c
Oct 20 08:51:40 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:51:40 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:51:40 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d
Oct 20 08:51:40 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:51:40 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:51:40 user nova-compute[74039]: FIRMWARE:
Oct 20 08:51:40 user nova-compute[74039]: No targets found.
Oct 20 08:51:40 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 08:51:40 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 08:51:40 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4437921d-415d-45e8-9f4e-a73647d452ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[38008aee-cec5-4faf-a01d-6f259ee4fab3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)
Oct 20 08:51:40 user nova-compute[74039]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:51:40 user nova-compute[74039]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)
Oct 20 08:51:40 user nova-compute[74039]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)
Oct 20 08:51:40 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d (non-flash)
Oct 20 08:51:40 user nova-compute[74039]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:51:40 user nova-compute[74039]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)
Oct 20 08:51:40 user nova-compute[74039]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)
Oct 20 08:51:40 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae8445c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d'): ({'sdb'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Removing single pathed devices sdb {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a644118b-503c-4b49-afa4-dbea4177009e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be0b5c2-fe37-41e4-a39b-0ab4a9286151]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Flushing IO for device /dev/sdb {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7186bd5-7bd6-43f8-9da2-6294468486d2]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[93eebb12-0168-4d03-b518-17abf54ce7bb]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf121aac-7369-4a68-a457-9816ef5e4304]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1628db2c-d669-40d2-9c3a-79294ab2e388]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d, portal: 172.16.0.220,3260]
Oct 20 08:51:40 user nova-compute[74039]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d, portal: 172.16.0.220,3260] successful.
Oct 20 08:51:40 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98431df8-ae6c-4284-a16c-fb2b5ef08a5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[394916a4-2c68-428a-aedd-ff2907ceb1cf]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] <== disconnect_volume: return (337ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 08:51:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-240c3153-ea4f-4b36-ac49-236e9c32afb2 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 44.977s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG nova.compute.manager [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jEvGqJnK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '500a0ed6-ac37-4274-a8f2-2545c270e24b', 'attached_at': '', 'detached_at': '', 'volume_id': '29263da0-2ddd-416e-98a9-52e451abff13', 'serial': '29263da0-2ddd-416e-98a9-52e451abff13'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bfjyqgCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '500a0ed6-ac37-4274-a8f2-2545c270e24b', 'attached_at': '', 'detached_at': '', 'volume_id': 'e60bbfa7-eab8-4fc5-a82e-16fbe709c040', 'serial'} {{(pid=74039) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jEvGqJnK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:51:41 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:51:41 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:51:41 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c25d9fe-0aef-43e9-9c3f-486cb84633fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 08:51:41 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8718f251-1f86-4f66-b708-2e5d86a10ba3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13] added
Oct 20 08:51:41 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:41 user nova-compute[74039]: INFO nova.virt.block_device [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Booting with volume d0edc0db-2f45-4846-9357-4aec238a54cf at /dev/vdb
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[97565bd0-d063-442c-bcda-8391c24ae043]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5b83d6-4b6d-40a3-bd62-81790092757f]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jEvGqJnK {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jEvGqJnK" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc122eba-f2f7-43fe-961c-e92cbae01767]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jEvGqJnK'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b8af0d-1dc6-4ae9-9998-3aeff4ef39d3]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0630ea-2a42-454f-93c3-66ebb15ff36e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:51:41 user nova-compute[74039]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)
Oct 20 08:51:41 user nova-compute[74039]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)
Oct 20 08:51:41 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:51:41 user nova-compute[74039]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)
Oct 20 08:51:41 user nova-compute[74039]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)
Oct 20 08:51:41 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d430da-6200-42b5-8d07-b2fe63ef82da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13, portal: 172.16.0.220,3260]
Oct 20 08:51:41 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13, portal: 172.16.0.220,3260] successful.
Oct 20 08:51:41 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[369741e3-aca1-4c98-b21b-a517043f2431]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e745d757-10ad-40ae-babb-95192936bb5d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:51:41 user nova-compute[74039]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)
Oct 20 08:51:41 user nova-compute[74039]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)
Oct 20 08:51:41 user nova-compute[74039]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:51:41 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:51:41 user nova-compute[74039]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)
Oct 20 08:51:41 user nova-compute[74039]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)
Oct 20 08:51:41 user nova-compute[74039]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:51:41 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] HCTL ('33', '-', '-', 0) found on session 6 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa115386-850e-4ecb-a794-97627d90134c]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:41 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Searching for a device in session 6 and hctl ['33', '*', '*', 0] yield: None {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG os_brick.utils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8797e69-9a5e-447c-a18a-b5055995f615]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03e6fee-8c2a-4c00-8cdc-a4fd6147fc93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffba4325-a1cf-4ac4-906f-69011f7642f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b445a7ba-c61d-48b5-8e46-87b9045c8d22]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:51:42 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:51:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[332adaab-1ba6-4450-b171-9f1a1d042aa5]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG os_brick.utils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Updating existing volume attachment record: 03790ce9-ebc4-4968-8238-e3bb6cbb507c {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG nova.objects.instance [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lazy-loading 'flavor' on Instance uuid ff1bca5e-9337-466c-866d-e9c91cf9200c {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-99aea62a-b218-4bdd-80e5-556f828687b1 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "ff1bca5e-9337-466c-866d-e9c91cf9200c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.867s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquiring lock "365da377-4031-4e1b-bc85-6dcaf721548e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "365da377-4031-4e1b-bc85-6dcaf721548e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:51:42 user nova-compute[74039]: INFO nova.compute.manager [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Detaching volume 23973811-16c5-48ea-932b-84766d5be0a7
Oct 20 08:51:42 user nova-compute[74039]: INFO nova.virt.block_device [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Attempting to driver detach volume 23973811-16c5-48ea-932b-84766d5be0a7 from mountpoint /dev/vdb
Oct 20 08:51:42 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f36d1402-28fc-44a4-80d0-141964dad3a2 tempest-VolumesAssistedSnapshotsTest-1398704759 tempest-VolumesAssistedSnapshotsTest-1398704759-project] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] volume_snapshot_create: create_info: {'snapshot_id': '636d6af8-0e19-494f-bff9-f1bd76079dc8', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74039) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Searching for a device in session 6 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jEvGqJnK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23831336334656134', 'path': '/dev/sdb'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831336334656134', 'path': '/dev/sdb'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f36d1402-28fc-44a4-80d0-141964dad3a2 tempest-VolumesAssistedSnapshotsTest-1398704759 tempest-VolumesAssistedSnapshotsTest-1398704759-project] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] snap xml: <domainsnapshot>
Oct 20 08:51:42 user nova-compute[74039]:   <disks>
Oct 20 08:51:42 user nova-compute[74039]:     <disk name="/dev/sde" snapshot="external" type="file">
Oct 20 08:51:42 user nova-compute[74039]:       <source file="/dev/new_file"/>
Oct 20 08:51:42 user nova-compute[74039]:     </disk>
Oct 20 08:51:42 user nova-compute[74039]:     <disk name="vda" snapshot="no"/>
Oct 20 08:51:42 user nova-compute[74039]:   </disks>
Oct 20 08:51:42 user nova-compute[74039]: </domainsnapshot>
Oct 20 08:51:42 user nova-compute[74039]:  {{(pid=74039) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG nova.objects.instance [None req-f36d1402-28fc-44a4-80d0-141964dad3a2 tempest-VolumesAssistedSnapshotsTest-1398704759 tempest-VolumesAssistedSnapshotsTest-1398704759-project] Lazy-loading 'system_metadata' on Instance uuid 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG nova.objects.instance [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Lazy-loading 'flavor' on Instance uuid 500a0ed6-ac37-4274-a8f2-2545c270e24b {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Attempting to detach device vdb from instance 365da377-4031-4e1b-bc85-6dcaf721548e from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 08:51:42 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 08:51:42 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:51:42 user nova-compute[74039]:   <source dev="/dev/sdd"/>
Oct 20 08:51:42 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 08:51:42 user nova-compute[74039]:   <serial>23973811-16c5-48ea-932b-84766d5be0a7</serial>
Oct 20 08:51:42 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 08:51:42 user nova-compute[74039]: </disk>
Oct 20 08:51:42 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 08:51:43 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Successfully detached device vdb from instance 365da377-4031-4e1b-bc85-6dcaf721548e from the persistent domain config.
Oct 20 08:51:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 365da377-4031-4e1b-bc85-6dcaf721548e from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 08:51:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 08:51:43 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:51:43 user nova-compute[74039]:   <source dev="/dev/sdd"/>
Oct 20 08:51:43 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 08:51:43 user nova-compute[74039]:   <serial>23973811-16c5-48ea-932b-84766d5be0a7</serial>
Oct 20 08:51:43 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 08:51:43 user nova-compute[74039]: </disk>
Oct 20 08:51:43 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 08:51:43 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f36d1402-28fc-44a4-80d0-141964dad3a2 tempest-VolumesAssistedSnapshotsTest-1398704759 tempest-VolumesAssistedSnapshotsTest-1398704759-project] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [None req-f36d1402-28fc-44a4-80d0-141964dad3a2 tempest-VolumesAssistedSnapshotsTest-1398704759 tempest-VolumesAssistedSnapshotsTest-1398704759-project] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Traceback (most recent call last):
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]     rv = execute(f, *args, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]     six.reraise(c, e, tb)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]     raise value
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]     rv = meth(*args, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] 
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [None req-f36d1402-28fc-44a4-80d0-141964dad3a2 tempest-VolumesAssistedSnapshotsTest-1398704759 tempest-VolumesAssistedSnapshotsTest-1398704759-project] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Traceback (most recent call last):
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]     self._volume_snapshot_create(context, instance, guest,
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]     rv = execute(f, *args, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]     six.reraise(c, e, tb)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]     raise value
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]     rv = meth(*args, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] 
Oct 20 08:51:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Acquiring lock "ff1bca5e-9337-466c-866d-e9c91cf9200c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:51:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "ff1bca5e-9337-466c-866d-e9c91cf9200c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:51:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Acquiring lock "ff1bca5e-9337-466c-866d-e9c91cf9200c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:51:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "ff1bca5e-9337-466c-866d-e9c91cf9200c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:51:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "ff1bca5e-9337-466c-866d-e9c91cf9200c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:51:43 user nova-compute[74039]: INFO nova.compute.manager [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Terminating instance
Oct 20 08:51:43 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 08:51:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-41781fb9-cd22-41a6-9c94-7be6aa341bc6 tempest-VolumesAssistedSnapshotsTest-1398704759 tempest-VolumesAssistedSnapshotsTest-1398704759-project] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] volume_snapshot_delete: delete_info: {'volume_id': '20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c'} {{(pid=74039) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [None req-41781fb9-cd22-41a6-9c94-7be6aa341bc6 tempest-VolumesAssistedSnapshotsTest-1398704759 tempest-VolumesAssistedSnapshotsTest-1398704759-project] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Traceback (most recent call last):
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74]     if delete_info['type'] != 'qcow2':
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] KeyError: 'type'
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] 
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [None req-f36d1402-28fc-44a4-80d0-141964dad3a2 tempest-VolumesAssistedSnapshotsTest-1398704759 tempest-VolumesAssistedSnapshotsTest-1398704759-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 636d6af8-0e19-494f-bff9-f1bd76079dc8 could not be found.
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     raise value
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver 
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver 
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 636d6af8-0e19-494f-bff9-f1bd76079dc8 could not be found. (HTTP 404) (Request-ID: req-51dee6f1-c0fc-4cdf-8662-89910638496c)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver 
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver 
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 636d6af8-0e19-494f-bff9-f1bd76079dc8 could not be found.
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver 
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server [None req-f36d1402-28fc-44a4-80d0-141964dad3a2 tempest-VolumesAssistedSnapshotsTest-1398704759 tempest-VolumesAssistedSnapshotsTest-1398704759-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     raise value
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server 
Oct 20 08:51:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver [None req-41781fb9-cd22-41a6-9c94-7be6aa341bc6 tempest-VolumesAssistedSnapshotsTest-1398704759 tempest-VolumesAssistedSnapshotsTest-1398704759-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver 
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver 
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-4b451587-cbff-4651-bbaf-0adcb0cdbd15)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver 
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver 
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 20 08:51:43 user nova-compute[74039]: ERROR nova.virt.libvirt.driver 
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server [None req-41781fb9-cd22-41a6-9c94-7be6aa341bc6 tempest-VolumesAssistedSnapshotsTest-1398704759 tempest-VolumesAssistedSnapshotsTest-1398704759-project] Exception during message handling: KeyError: 'type'
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 20 08:51:43 user nova-compute[74039]: ERROR oslo_messaging.rpc.server 
Oct 20 08:51:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 365da377-4031-4e1b-bc85-6dcaf721548e {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 08:51:43 user nova-compute[74039]: DEBUG nova.compute.manager [req-82811faa-838f-429f-967c-7d2e256591fe req-13c31092-9b6d-4237-9eec-305b06f18d1f service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Received event network-vif-unplugged-ca5407cc-32fc-44c3-a80d-ff65f007eeb8 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:51:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-82811faa-838f-429f-967c-7d2e256591fe req-13c31092-9b6d-4237-9eec-305b06f18d1f service nova] Acquiring lock "ff1bca5e-9337-466c-866d-e9c91cf9200c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:51:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-82811faa-838f-429f-967c-7d2e256591fe req-13c31092-9b6d-4237-9eec-305b06f18d1f service nova] Lock "ff1bca5e-9337-466c-866d-e9c91cf9200c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:51:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-82811faa-838f-429f-967c-7d2e256591fe req-13c31092-9b6d-4237-9eec-305b06f18d1f service nova] Lock "ff1bca5e-9337-466c-866d-e9c91cf9200c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:51:43 user nova-compute[74039]: DEBUG nova.compute.manager [req-82811faa-838f-429f-967c-7d2e256591fe req-13c31092-9b6d-4237-9eec-305b06f18d1f service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] No waiting events found dispatching network-vif-unplugged-ca5407cc-32fc-44c3-a80d-ff65f007eeb8 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:51:43 user nova-compute[74039]: DEBUG nova.compute.manager [req-82811faa-838f-429f-967c-7d2e256591fe req-13c31092-9b6d-4237-9eec-305b06f18d1f service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Received event network-vif-unplugged-ca5407cc-32fc-44c3-a80d-ff65f007eeb8 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:51:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Acquiring lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:51:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:51:43 user nova-compute[74039]: INFO nova.compute.manager [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Detaching volume 20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c
Oct 20 08:51:43 user nova-compute[74039]: INFO nova.virt.block_device [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Attempting to driver detach volume 20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c from mountpoint /dev/vdb
Oct 20 08:51:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Attempting to detach device vdb from instance 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74 from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 08:51:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] detach device xml: <disk type="block" device="disk">
Oct 20 08:51:43 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:51:43 user nova-compute[74039]:   <source dev="/dev/sde"/>
Oct 20 08:51:43 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 08:51:43 user nova-compute[74039]:   <serial>20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c</serial>
Oct 20 08:51:43 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 08:51:43 user nova-compute[74039]: </disk>
Oct 20 08:51:43 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 08:51:43 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Successfully detached device vdb from instance 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74 from the persistent domain config.
Oct 20 08:51:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74 from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 08:51:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] detach device xml: <disk type="block" device="disk">
Oct 20 08:51:43 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:51:43 user nova-compute[74039]:   <source dev="/dev/sde"/>
Oct 20 08:51:43 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 08:51:43 user nova-compute[74039]:   <serial>20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c</serial>
Oct 20 08:51:43 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 08:51:43 user nova-compute[74039]: </disk>
Oct 20 08:51:43 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 08:51:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:51:44 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 160432128 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:51:44 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74 {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 08:51:44 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Instance destroyed successfully.
Oct 20 08:51:44 user nova-compute[74039]: DEBUG nova.objects.instance [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lazy-loading 'resources' on Instance uuid ff1bca5e-9337-466c-866d-e9c91cf9200c {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:51:44 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-107806836',display_name='tempest-AttachSCSIVolumeTestJSON-server-107806836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-107806836',id=5,image_ref='e30bed4e-9f69-44ae-8c79-3669982fa069',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1eJZpjJcKITE4MnIUSLiKCtuUN9PQRHqIp3FF1Y6JPo7l5wHvh1Txjy6yPkArIu0YeSYOTZvf5Nxw9bCro4Cq91Z9fs5bFmQSewWaTR7HjS4BnX+lLR+1JMONO+H3I6A==',key_name='tempest-keypair-479173428',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:48:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de66876449e146b797bf3d5d95086a55',ramdisk_id='',reservation_id='r-8fjcchyd',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e30bed4e-9f69-44ae-8c79-3669982fa069',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-993810269',owner_user_name='tempest-AttachSCSIVolumeTestJSON-993810269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:48:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55453231169b4a2596ede6152645b252',uuid=ff1bca5e-9337-466c-866d-e9c91cf9200c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "address": "fa:16:3e:41:ce:3e", "network": {"id": "66bd8b72-b934-4e08-b441-7b206e30191f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-800457541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de66876449e146b797bf3d5d95086a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5407cc-32", "ovs_interfaceid": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:51:44 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Converting VIF {"id": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "address": "fa:16:3e:41:ce:3e", "network": {"id": "66bd8b72-b934-4e08-b441-7b206e30191f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-800457541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de66876449e146b797bf3d5d95086a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5407cc-32", "ovs_interfaceid": "ca5407cc-32fc-44c3-a80d-ff65f007eeb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:51:44 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:ce:3e,bridge_name='br-int',has_traffic_filtering=True,id=ca5407cc-32fc-44c3-a80d-ff65f007eeb8,network=Network(66bd8b72-b934-4e08-b441-7b206e30191f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5407cc-32') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:51:44 user nova-compute[74039]: DEBUG os_vif [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:ce:3e,bridge_name='br-int',has_traffic_filtering=True,id=ca5407cc-32fc-44c3-a80d-ff65f007eeb8,network=Network(66bd8b72-b934-4e08-b441-7b206e30191f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5407cc-32') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:51:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca5407cc-32, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:51:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e067dcb-6086-440d-a7a6-820946ff7db7) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:51:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:44 user nova-compute[74039]: INFO os_vif [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:ce:3e,bridge_name='br-int',has_traffic_filtering=True,id=ca5407cc-32fc-44c3-a80d-ff65f007eeb8,network=Network(66bd8b72-b934-4e08-b441-7b206e30191f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5407cc-32')
Oct 20 08:51:44 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Deleting instance files /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c_del
Oct 20 08:51:44 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Deletion of /opt/stack/data/nova/instances/ff1bca5e-9337-466c-866d-e9c91cf9200c_del complete
Oct 20 08:51:44 user nova-compute[74039]: INFO nova.compute.manager [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Took 1.72 seconds to destroy the instance on the hypervisor.
Oct 20 08:51:44 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 08:51:44 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 08:51:44 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 08:51:44 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 320864256 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:51:45 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 471859200 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:51:45 user nova-compute[74039]: DEBUG nova.compute.manager [req-e69f5678-3cf2-462c-8852-edab419874dd req-c087eb0e-e8ab-4706-83bc-1cefe93b52a8 service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Received event network-vif-plugged-ca5407cc-32fc-44c3-a80d-ff65f007eeb8 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:51:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e69f5678-3cf2-462c-8852-edab419874dd req-c087eb0e-e8ab-4706-83bc-1cefe93b52a8 service nova] Acquiring lock "ff1bca5e-9337-466c-866d-e9c91cf9200c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:51:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e69f5678-3cf2-462c-8852-edab419874dd req-c087eb0e-e8ab-4706-83bc-1cefe93b52a8 service nova] Lock "ff1bca5e-9337-466c-866d-e9c91cf9200c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:51:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e69f5678-3cf2-462c-8852-edab419874dd req-c087eb0e-e8ab-4706-83bc-1cefe93b52a8 service nova] Lock "ff1bca5e-9337-466c-866d-e9c91cf9200c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:51:45 user nova-compute[74039]: DEBUG nova.compute.manager [req-e69f5678-3cf2-462c-8852-edab419874dd req-c087eb0e-e8ab-4706-83bc-1cefe93b52a8 service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] No waiting events found dispatching network-vif-plugged-ca5407cc-32fc-44c3-a80d-ff65f007eeb8 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:51:45 user nova-compute[74039]: WARNING nova.compute.manager [req-e69f5678-3cf2-462c-8852-edab419874dd req-c087eb0e-e8ab-4706-83bc-1cefe93b52a8 service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Received unexpected event network-vif-plugged-ca5407cc-32fc-44c3-a80d-ff65f007eeb8 for instance with vm_state active and task_state deleting.
Oct 20 08:51:45 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 635437056 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:51:46 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 770703360 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:51:46 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:51:46 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Took 1.66 seconds to deallocate network for instance.
Oct 20 08:51:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-99f0ecc6-e6fc-47dc-b96d-8014f9e4d467 req-7cd110a8-cf88-4f6a-b85f-86bba7bb7f9e service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Received event network-vif-deleted-ca5407cc-32fc-44c3-a80d-ff65f007eeb8 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:51:46 user nova-compute[74039]: INFO nova.compute.manager [req-99f0ecc6-e6fc-47dc-b96d-8014f9e4d467 req-7cd110a8-cf88-4f6a-b85f-86bba7bb7f9e service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Neutron deleted interface ca5407cc-32fc-44c3-a80d-ff65f007eeb8; detaching it from the instance and deleting it from the info cache
Oct 20 08:51:46 user nova-compute[74039]: DEBUG nova.network.neutron [req-99f0ecc6-e6fc-47dc-b96d-8014f9e4d467 req-7cd110a8-cf88-4f6a-b85f-86bba7bb7f9e service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:51:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-99f0ecc6-e6fc-47dc-b96d-8014f9e4d467 req-7cd110a8-cf88-4f6a-b85f-86bba7bb7f9e service nova] [instance: ff1bca5e-9337-466c-866d-e9c91cf9200c] Detach interface failed, port_id=ca5407cc-32fc-44c3-a80d-ff65f007eeb8, reason: Instance ff1bca5e-9337-466c-866d-e9c91cf9200c could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 08:51:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:51:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:51:46 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:51:46 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:51:46 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 857735168 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:51:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:51:47 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Deleted allocations for instance ff1bca5e-9337-466c-866d-e9c91cf9200c
Oct 20 08:51:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b73e47e1-c615-4f19-8478-9cc78cc92cc9 tempest-AttachSCSIVolumeTestJSON-993810269 tempest-AttachSCSIVolumeTestJSON-993810269-project-member] Lock "ff1bca5e-9337-466c-866d-e9c91cf9200c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.186s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:51:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 982515712 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:51:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bfjyqgCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:51:48 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:51:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[36917e87-0b5c-4ad3-bf84-5465b6976878]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 08:51:48 user nova-compute[74039]: No targets found.
Oct 20 08:51:48 user nova-compute[74039]: iSNS:
Oct 20 08:51:48 user nova-compute[74039]: No targets found.
Oct 20 08:51:48 user nova-compute[74039]: STATIC:
Oct 20 08:51:48 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040
Oct 20 08:51:48 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:51:48 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:51:48 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7
Oct 20 08:51:48 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:51:48 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:51:48 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c
Oct 20 08:51:48 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:51:48 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:51:48 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13
Oct 20 08:51:48 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:51:48 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:51:48 user nova-compute[74039]: FIRMWARE:
Oct 20 08:51:48 user nova-compute[74039]: No targets found.
Oct 20 08:51:48 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 08:51:48 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 08:51:48 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14f0718-429f-473f-a523-f4711c5cfa88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fac2f20-acc1-48ab-818a-ff3000200ac5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:51:48 user nova-compute[74039]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)
Oct 20 08:51:48 user nova-compute[74039]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)
Oct 20 08:51:48 user nova-compute[74039]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:51:48 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:51:48 user nova-compute[74039]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)
Oct 20 08:51:48 user nova-compute[74039]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)
Oct 20 08:51:48 user nova-compute[74039]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:51:48 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae84311ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040'): ({'sdc'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Removing single pathed devices sdc {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4774db6f-e68c-457a-a76c-5de5600ae18c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[954b3e11-a02e-4478-9a5a-19b44f051a90]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Flushing IO for device /dev/sdc {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6a6da6-b349-4f2b-8aa5-3ec53a6c0585]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16ac5e9-3f0b-4076-a71a-aa5e33a4fb26]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7698e9c4-6ad0-46ec-abd1-0316eeef21e4]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7a8306-c0b0-4934-83ad-57a32f75e0eb]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040, portal: 172.16.0.220,3260]
Oct 20 08:51:48 user nova-compute[74039]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040, portal: 172.16.0.220,3260] successful.
Oct 20 08:51:48 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9402acc6-8154-4f8e-9f31-937903ad4a73]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] <== disconnect_volume: return (289ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jEvGqJnK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '500a0ed6-ac37-4274-a8f2-2545c270e24b', 'attached_at': '', 'detached_at': '', 'volume_id': '29263da0-2ddd-416e-98a9-52e451abff13', 'serial'} {{(pid=74039) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 20 08:51:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] swap_volume: removing Cinder connection for volume e60bbfa7-eab8-4fc5-a82e-16fbe709c040 {{(pid=74039) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 20 08:51:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:51:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 08:51:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 08:51:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 08:51:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:51:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:52:01 user nova-compute[74039]: INFO nova.virt.block_device [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Booting with volume a2afe51e-0277-429a-b298-bf51979c57c9 at /dev/vdc
Oct 20 08:52:01 user nova-compute[74039]: DEBUG os_brick.utils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:52:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac302fb-87b6-47f2-9d44-a05be665b53c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96f5476-9e18-481f-8a20-986608feb021]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[693a048a-e91f-4d8b-bab5-9a26a3848522]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[054c8ea6-208e-495d-900f-ef715bec5804]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:52:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:52:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:52:01 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:52:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5661180e-72cc-4e60-8c42-f81e90dcef03]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:52:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:52:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:52:01 user nova-compute[74039]: DEBUG os_brick.utils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:52:01 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Updating existing volume attachment record: 88cc85a4-d128-46ba-beea-6bb85315665e {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 08:52:03 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 365da377-4031-4e1b-bc85-6dcaf721548e is timed out.
Oct 20 08:52:03 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Successfully detached device vdb from instance 365da377-4031-4e1b-bc85-6dcaf721548e from the live domain config.
Oct 20 08:52:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PniZewAR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:52:03 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:52:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e96f793-d38c-4ef1-9d83-0040ea78adeb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 08:52:03 user nova-compute[74039]: No targets found.
Oct 20 08:52:03 user nova-compute[74039]: iSNS:
Oct 20 08:52:03 user nova-compute[74039]: No targets found.
Oct 20 08:52:03 user nova-compute[74039]: STATIC:
Oct 20 08:52:03 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7
Oct 20 08:52:03 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:52:03 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:52:03 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c
Oct 20 08:52:03 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:52:03 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:52:03 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13
Oct 20 08:52:03 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:52:03 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:52:03 user nova-compute[74039]: FIRMWARE:
Oct 20 08:52:03 user nova-compute[74039]: No targets found.
Oct 20 08:52:03 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 08:52:03 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 08:52:03 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7afa02-511c-4a62-a6cc-0499cd8f40c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[145ca14e-51e9-43cb-b601-2e7dec572107]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)
Oct 20 08:52:03 user nova-compute[74039]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)
Oct 20 08:52:03 user nova-compute[74039]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:03 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 (non-flash)
Oct 20 08:52:03 user nova-compute[74039]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)
Oct 20 08:52:03 user nova-compute[74039]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:03 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae84312950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7'): ({'sdd'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Removing single pathed devices sdd {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b28bb9-204f-4992-b17a-0f2d0c883e64]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[070c6313-972c-433d-8a79-8eb49e14cdf2]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Flushing IO for device /dev/sdd {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7996e8-a2fd-4070-af46-feb0e143d359]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[82df5c59-6ab4-4281-8e87-aa262b00275d]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1b51ec-5927-4aa9-938a-f2199569b639]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[85aae37b-82b9-4b78-83ff-4b3dc54e2c60]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7, portal: 172.16.0.220,3260]
Oct 20 08:52:03 user nova-compute[74039]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7, portal: 172.16.0.220,3260] successful.
Oct 20 08:52:03 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23973811-16c5-48ea-932b-84766d5be0a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4444a4-54c8-4e80-9727-eb7e88ae227b]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] <== disconnect_volume: return (327ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:52:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 08:52:04 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74 is timed out.
Oct 20 08:52:04 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Successfully detached device vdb from instance 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74 from the live domain config.
Oct 20 08:52:04 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EgsXeRcM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:52:04 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:52:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaedbe3-89fb-4b8d-8745-7c0d305804c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 08:52:04 user nova-compute[74039]: No targets found.
Oct 20 08:52:04 user nova-compute[74039]: iSNS:
Oct 20 08:52:04 user nova-compute[74039]: No targets found.
Oct 20 08:52:04 user nova-compute[74039]: STATIC:
Oct 20 08:52:04 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c
Oct 20 08:52:04 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:52:04 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:52:04 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13
Oct 20 08:52:04 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:52:04 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:52:04 user nova-compute[74039]: FIRMWARE:
Oct 20 08:52:04 user nova-compute[74039]: No targets found.
Oct 20 08:52:04 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 08:52:04 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 08:52:04 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[841c88d6-2778-4d93-8fa7-abf8426ee629]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d02d61-e148-44eb-b67c-14d95f8c56fd]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)
Oct 20 08:52:04 user nova-compute[74039]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:04 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c (non-flash)
Oct 20 08:52:04 user nova-compute[74039]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:04 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae8429f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c'): ({'sde'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Removing single pathed devices sde {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf54b6f1-ba1b-438e-ab4a-25cd3009fd28]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0df13a-1f41-443b-8afc-4062b2d5c4a7]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Flushing IO for device /dev/sde {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[438bf64b-2423-42da-83c3-a9b1d94d05bf]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1ffd0a-bee0-451e-b429-6404d33c610e]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] SCSI volumes sde have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[694b0482-a844-40d9-a871-9f0b38d96bdb]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2af2dd-6456-44f4-9563-945a7934631a]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c, portal: 172.16.0.220,3260]
Oct 20 08:52:04 user nova-compute[74039]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c, portal: 172.16.0.220,3260] successful.
Oct 20 08:52:04 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20a2d6eb-a4e8-4d2d-a810-c1e1b302a89c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced65047-b0dc-4d52-9343-ac700d7fe66f]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] <== disconnect_volume: return (291ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:52:04 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 08:52:06 user nova-compute[74039]: DEBUG nova.compute.manager [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] swap_volume: Updating volume e60bbfa7-eab8-4fc5-a82e-16fbe709c040 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "jEvGqJnK", "auth_password": "PhMDIcz2unXfK8", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "29263da0-2ddd-416e-98a9-52e451abff13"}, "status": "reserved", "instance": "500a0ed6-ac37-4274-a8f2-2545c270e24b", "attached_at": "", "detached_at": "", "volume_id": "29263da0-2ddd-416e-98a9-52e451abff13", "serial": "29263da0-2ddd-416e-98a9-52e451abff13"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '29263da0-2ddd-416e-98a9-52e451abff13', 'no_device': None, 'attachment_id': 'e5b5145b-baff-41d6-8d6a-27a9f7ee0f18'} {{(pid=74039) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 20 08:52:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7ce50772-234b-40d0-8b05-75e0e8dbe450 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 44.438s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:08 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:52:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:09 user nova-compute[74039]: DEBUG nova.compute.manager [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 08:52:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:52:09 user nova-compute[74039]: INFO nova.compute.claims [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Claim successful on node user
Oct 20 08:52:10 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG nova.compute.manager [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG nova.compute.manager [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG nova.network.neutron [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:52:10 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 08:52:10 user nova-compute[74039]: DEBUG nova.compute.manager [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG nova.policy [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb823f0374a04657be729eb153160659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a58985dce3491d8e45e6e468e0e549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG nova.compute.manager [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:52:10 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Creating image(s)
Oct 20 08:52:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "/opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "/opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "/opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.185s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.170s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk 1073741824" returned: 0 in 0.056s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:10 user nova-compute[74039]: DEBUG nova.network.neutron [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Successfully created port: 8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.194s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Cannot resize image /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Ensure instance console log exists: /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.network.neutron [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Successfully updated port: 8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "refresh_cache-54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquired lock "refresh_cache-54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.network.neutron [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-a10674b1-03c8-4581-ab17-9e3a43ab3cc9 req-caac1efd-804f-463e-8c80-ea3b0996b9dc service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Received event network-changed-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-a10674b1-03c8-4581-ab17-9e3a43ab3cc9 req-caac1efd-804f-463e-8c80-ea3b0996b9dc service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Refreshing instance network info cache due to event network-changed-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a10674b1-03c8-4581-ab17-9e3a43ab3cc9 req-caac1efd-804f-463e-8c80-ea3b0996b9dc service nova] Acquiring lock "refresh_cache-54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.network.neutron [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.network.neutron [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Updating instance_info_cache with network_info: [{"id": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "address": "fa:16:3e:38:e8:6c", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9df57e-7c", "ovs_interfaceid": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.objects.instance [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lazy-loading 'flavor' on Instance uuid 365da377-4031-4e1b-bc85-6dcaf721548e {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Releasing lock "refresh_cache-54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.compute.manager [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Instance network_info: |[{"id": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "address": "fa:16:3e:38:e8:6c", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9df57e-7c", "ovs_interfaceid": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a10674b1-03c8-4581-ab17-9e3a43ab3cc9 req-caac1efd-804f-463e-8c80-ea3b0996b9dc service nova] Acquired lock "refresh_cache-54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.network.neutron [req-a10674b1-03c8-4581-ab17-9e3a43ab3cc9 req-caac1efd-804f-463e-8c80-ea3b0996b9dc service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Refreshing network info cache for port 8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Start _get_guest_xml network_info=[{"id": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "address": "fa:16:3e:38:e8:6c", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9df57e-7c", "ovs_interfaceid": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:52:11 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:52:11 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1458942537',display_name='tempest-tempest.common.compute-instance-1458942537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1458942537',id=11,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTUpP2s33VfTl03H4wvNfWkRjE/JJ83tB47a0/XPOlnK2KS6d8iUtfaEnWynmonaIFqIQH11WXYG7tk5jqZm5Ea/itjl2zitoH8eHQjsIO5JMBUmZ70QQYY8ASvSrGQlA==',key_name='tempest-keypair-1150525820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88a58985dce3491d8e45e6e468e0e549',ramdisk_id='',reservation_id='r-y9rntpk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1138208404',owner_user_name='tempest-ServerActionsTestOtherA-1138208404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:52:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb823f0374a04657be729eb153160659',uuid=54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "address": "fa:16:3e:38:e8:6c", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9df57e-7c", "ovs_interfaceid": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converting VIF {"id": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "address": "fa:16:3e:38:e8:6c", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9df57e-7c", "ovs_interfaceid": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9df57e-7c') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.objects.instance [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lazy-loading 'pci_devices' on Instance uuid 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:52:11 user nova-compute[74039]:   <uuid>54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11</uuid>
Oct 20 08:52:11 user nova-compute[74039]:   <name>instance-0000000b</name>
Oct 20 08:52:11 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:52:11 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:52:11 user nova-compute[74039]:   <metadata>
Oct 20 08:52:11 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:52:11 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:52:11 user nova-compute[74039]:       <nova:name>tempest-tempest.common.compute-instance-1458942537</nova:name>
Oct 20 08:52:11 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:52:11</nova:creationTime>
Oct 20 08:52:11 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:52:11 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:52:11 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:52:11 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:52:11 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:52:11 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:52:11 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:52:11 user nova-compute[74039]:       <nova:owner>
Oct 20 08:52:11 user nova-compute[74039]:         <nova:user uuid="cb823f0374a04657be729eb153160659">tempest-ServerActionsTestOtherA-1138208404-project-member</nova:user>
Oct 20 08:52:11 user nova-compute[74039]:         <nova:project uuid="88a58985dce3491d8e45e6e468e0e549">tempest-ServerActionsTestOtherA-1138208404</nova:project>
Oct 20 08:52:11 user nova-compute[74039]:       </nova:owner>
Oct 20 08:52:11 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:52:11 user nova-compute[74039]:       <nova:ports>
Oct 20 08:52:11 user nova-compute[74039]:         <nova:port uuid="8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d">
Oct 20 08:52:11 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 08:52:11 user nova-compute[74039]:         </nova:port>
Oct 20 08:52:11 user nova-compute[74039]:       </nova:ports>
Oct 20 08:52:11 user nova-compute[74039]:     </nova:instance>
Oct 20 08:52:11 user nova-compute[74039]:   </metadata>
Oct 20 08:52:11 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:52:11 user nova-compute[74039]:     <system>
Oct 20 08:52:11 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:52:11 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:52:11 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:52:11 user nova-compute[74039]:       <entry name="serial">54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11</entry>
Oct 20 08:52:11 user nova-compute[74039]:       <entry name="uuid">54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11</entry>
Oct 20 08:52:11 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:52:11 user nova-compute[74039]:     </system>
Oct 20 08:52:11 user nova-compute[74039]:   </sysinfo>
Oct 20 08:52:11 user nova-compute[74039]:   <os>
Oct 20 08:52:11 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:52:11 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:52:11 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:52:11 user nova-compute[74039]:   </os>
Oct 20 08:52:11 user nova-compute[74039]:   <features>
Oct 20 08:52:11 user nova-compute[74039]:     <acpi/>
Oct 20 08:52:11 user nova-compute[74039]:     <apic/>
Oct 20 08:52:11 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:52:11 user nova-compute[74039]:   </features>
Oct 20 08:52:11 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:52:11 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:52:11 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:52:11 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:52:11 user nova-compute[74039]:   </clock>
Oct 20 08:52:11 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:52:11 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:52:11 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:52:11 user nova-compute[74039]:   </cpu>
Oct 20 08:52:11 user nova-compute[74039]:   <devices>
Oct 20 08:52:11 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:52:11 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:52:11 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk"/>
Oct 20 08:52:11 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:52:11 user nova-compute[74039]:     </disk>
Oct 20 08:52:11 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:52:11 user nova-compute[74039]:       <mac address="fa:16:3e:38:e8:6c"/>
Oct 20 08:52:11 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:52:11 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:52:11 user nova-compute[74039]:       <target dev="tap8b9df57e-7c"/>
Oct 20 08:52:11 user nova-compute[74039]:     </interface>
Oct 20 08:52:11 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:52:11 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/console.log" append="off"/>
Oct 20 08:52:11 user nova-compute[74039]:     </serial>
Oct 20 08:52:11 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:52:11 user nova-compute[74039]:     <video>
Oct 20 08:52:11 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:52:11 user nova-compute[74039]:     </video>
Oct 20 08:52:11 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:52:11 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:52:11 user nova-compute[74039]:     </rng>
Oct 20 08:52:11 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:52:11 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:52:11 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:52:11 user nova-compute[74039]:     </memballoon>
Oct 20 08:52:11 user nova-compute[74039]:   </devices>
Oct 20 08:52:11 user nova-compute[74039]: </domain>
Oct 20 08:52:11 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1458942537',display_name='tempest-tempest.common.compute-instance-1458942537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1458942537',id=11,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTUpP2s33VfTl03H4wvNfWkRjE/JJ83tB47a0/XPOlnK2KS6d8iUtfaEnWynmonaIFqIQH11WXYG7tk5jqZm5Ea/itjl2zitoH8eHQjsIO5JMBUmZ70QQYY8ASvSrGQlA==',key_name='tempest-keypair-1150525820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88a58985dce3491d8e45e6e468e0e549',ramdisk_id='',reservation_id='r-y9rntpk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1138208404',owner_user_name='tempest-ServerActionsTestOtherA-1138208404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:52:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb823f0374a04657be729eb153160659',uuid=54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "address": "fa:16:3e:38:e8:6c", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9df57e-7c", "ovs_interfaceid": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converting VIF {"id": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "address": "fa:16:3e:38:e8:6c", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9df57e-7c", "ovs_interfaceid": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9df57e-7c') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG os_vif [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9df57e-7c') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '881b0480-767e-56b2-b961-a9b5ebae4e69', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1da05ce3-d6a9-485a-ba80-84bdd78cf15b tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "365da377-4031-4e1b-bc85-6dcaf721548e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.097s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b9df57e-7c, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b9df57e-7c, col_values=(('qos', UUID('bce59743-5d31-4605-af30-2dc4c3ce3872')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b9df57e-7c, col_values=(('external_ids', {'iface-id': '8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:e8:6c', 'vm-uuid': '54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:52:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:11 user nova-compute[74039]: INFO os_vif [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9df57e-7c')
Oct 20 08:52:12 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] No VIF found with MAC fa:16:3e:38:e8:6c, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:52:12 user nova-compute[74039]: INFO nova.virt.block_device [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Booting with volume fba8a764-2e46-40da-b2a3-f766320b5dd7 at /dev/vdc
Oct 20 08:52:12 user nova-compute[74039]: DEBUG nova.objects.instance [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Lazy-loading 'flavor' on Instance uuid 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6e3b234a-35a1-48fb-983a-9c4507fc37b4 tempest-VolumesAssistedSnapshotsTest-1322659727 tempest-VolumesAssistedSnapshotsTest-1322659727-project-admin] Lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.553s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-453ae04e-df4f-49f5-ab1c-9db2fbe292d3 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Acquiring lock "971fb41b-7fce-4ffe-b785-5d86f435004a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-453ae04e-df4f-49f5-ab1c-9db2fbe292d3 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lock "971fb41b-7fce-4ffe-b785-5d86f435004a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG nova.network.neutron [req-a10674b1-03c8-4581-ab17-9e3a43ab3cc9 req-caac1efd-804f-463e-8c80-ea3b0996b9dc service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Updated VIF entry in instance network info cache for port 8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG nova.network.neutron [req-a10674b1-03c8-4581-ab17-9e3a43ab3cc9 req-caac1efd-804f-463e-8c80-ea3b0996b9dc service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Updating instance_info_cache with network_info: [{"id": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "address": "fa:16:3e:38:e8:6c", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9df57e-7c", "ovs_interfaceid": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG nova.objects.instance [None req-453ae04e-df4f-49f5-ab1c-9db2fbe292d3 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lazy-loading 'flavor' on Instance uuid 971fb41b-7fce-4ffe-b785-5d86f435004a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a10674b1-03c8-4581-ab17-9e3a43ab3cc9 req-caac1efd-804f-463e-8c80-ea3b0996b9dc service nova] Releasing lock "refresh_cache-54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG os_brick.utils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-453ae04e-df4f-49f5-ab1c-9db2fbe292d3 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lock "971fb41b-7fce-4ffe-b785-5d86f435004a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d39260-c338-47fb-82ba-d8afd0b3af04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b73789d-a1e1-4ebf-bef5-974cacf6e2eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8844b217-e517-4e71-8930-f7f5be3f28d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[097dcd3b-4c01-4f03-a5e0-9282e310268b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:52:12 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2de7dd-ff0d-4eb4-b8e2-d8021ab1b4b6]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG os_brick.utils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Updating existing volume attachment record: 9ddf07e9-971d-4f55-9326-f27e5fe72150 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquiring lock "interface-365da377-4031-4e1b-bc85-6dcaf721548e-dd29358a-8456-4b27-8a8c-38206751a25c" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "interface-365da377-4031-4e1b-bc85-6dcaf721548e-dd29358a-8456-4b27-8a8c-38206751a25c" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG nova.objects.instance [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lazy-loading 'flavor' on Instance uuid 365da377-4031-4e1b-bc85-6dcaf721548e {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:48:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2124112502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2124112502',id=8,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADEixoB6QWWhTLuwL+7Z2fkKKWHkyf3tVdnf4752CWzbdJ5lz/PbSjwRzike1kbeQLqKQLtsajre3rrJlFKfvXx6m1o9pCXfJmA6Y4TeaBnPAeS7YpGXhczqHT/lsYEnw==',key_name='tempest-keypair-1295832388',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:49:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40f437448d494f75838a2c7b2b6a973f',ramdisk_id='',reservation_id='r-d06qmgd5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-92531413',owner_user_name='tempest-TaggedAttachmentsTest-92531413-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:49:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29ca829a96484751876ead6f2b094e54',uuid=365da377-4031-4e1b-bc85-6dcaf721548e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd29358a-8456-4b27-8a8c-38206751a25c", "address": "fa:16:3e:60:45:3e", "network": {"id": "3774a21d-147a-442f-a2c8-b94306649d95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-954620919", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29358a-84", "ovs_interfaceid": "dd29358a-8456-4b27-8a8c-38206751a25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Converting VIF {"id": "dd29358a-8456-4b27-8a8c-38206751a25c", "address": "fa:16:3e:60:45:3e", "network": {"id": "3774a21d-147a-442f-a2c8-b94306649d95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-954620919", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29358a-84", "ovs_interfaceid": "dd29358a-8456-4b27-8a8c-38206751a25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:45:3e,bridge_name='br-int',has_traffic_filtering=True,id=dd29358a-8456-4b27-8a8c-38206751a25c,network=Network(3774a21d-147a-442f-a2c8-b94306649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd29358a-84') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:60:45:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tapdd29358a-84"/></interface> {{(pid=74039) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:60:45:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tapdd29358a-84"/></interface> {{(pid=74039) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Attempting to detach device tapdd29358a-84 from instance 365da377-4031-4e1b-bc85-6dcaf721548e from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] detach device xml: <interface type="ethernet">
Oct 20 08:52:12 user nova-compute[74039]:   <mac address="fa:16:3e:60:45:3e"/>
Oct 20 08:52:12 user nova-compute[74039]:   <model type="virtio"/>
Oct 20 08:52:12 user nova-compute[74039]:   <mtu size="1442"/>
Oct 20 08:52:12 user nova-compute[74039]:   <target dev="tapdd29358a-84"/>
Oct 20 08:52:12 user nova-compute[74039]: </interface>
Oct 20 08:52:12 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:60:45:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tapdd29358a-84"/></interface> {{(pid=74039) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:60:45:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tapdd29358a-84"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 20 08:52:12 user nova-compute[74039]:   <name>instance-00000008</name>
Oct 20 08:52:12 user nova-compute[74039]:   <uuid>365da377-4031-4e1b-bc85-6dcaf721548e</uuid>
Oct 20 08:52:12 user nova-compute[74039]:   <metadata>
Oct 20 08:52:12 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:52:12 user nova-compute[74039]:   <nova:package version="0.0.0"/>
Oct 20 08:52:12 user nova-compute[74039]:   <nova:name>tempest-device-tagging-server-2124112502</nova:name>
Oct 20 08:52:12 user nova-compute[74039]:   <nova:creationTime>2023-10-20 08:50:51</nova:creationTime>
Oct 20 08:52:12 user nova-compute[74039]:   <nova:flavor name="m1.tiny">
Oct 20 08:52:12 user nova-compute[74039]:     <nova:memory>512</nova:memory>
Oct 20 08:52:12 user nova-compute[74039]:     <nova:disk>1</nova:disk>
Oct 20 08:52:12 user nova-compute[74039]:     <nova:swap>0</nova:swap>
Oct 20 08:52:12 user nova-compute[74039]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:52:12 user nova-compute[74039]:     <nova:vcpus>1</nova:vcpus>
Oct 20 08:52:12 user nova-compute[74039]:   </nova:flavor>
Oct 20 08:52:12 user nova-compute[74039]:   <nova:owner>
Oct 20 08:52:12 user nova-compute[74039]:     <nova:user uuid="29ca829a96484751876ead6f2b094e54">tempest-TaggedAttachmentsTest-92531413-project-member</nova:user>
Oct 20 08:52:12 user nova-compute[74039]:     <nova:project uuid="40f437448d494f75838a2c7b2b6a973f">tempest-TaggedAttachmentsTest-92531413</nova:project>
Oct 20 08:52:12 user nova-compute[74039]:   </nova:owner>
Oct 20 08:52:12 user nova-compute[74039]:   <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:52:12 user nova-compute[74039]:   <nova:ports>
Oct 20 08:52:12 user nova-compute[74039]:     <nova:port uuid="8c246ad5-f489-4486-b930-9d4a1cb60c41">
Oct 20 08:52:12 user nova-compute[74039]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 08:52:12 user nova-compute[74039]:     </nova:port>
Oct 20 08:52:12 user nova-compute[74039]:     <nova:port uuid="dd29358a-8456-4b27-8a8c-38206751a25c">
Oct 20 08:52:12 user nova-compute[74039]:       <nova:ip type="fixed" address="10.10.10.210" ipVersion="4"/>
Oct 20 08:52:12 user nova-compute[74039]:     </nova:port>
Oct 20 08:52:12 user nova-compute[74039]:   </nova:ports>
Oct 20 08:52:12 user nova-compute[74039]: </nova:instance>
Oct 20 08:52:12 user nova-compute[74039]:   </metadata>
Oct 20 08:52:12 user nova-compute[74039]:   <memory unit='KiB'>524288</memory>
Oct 20 08:52:12 user nova-compute[74039]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 08:52:12 user nova-compute[74039]:   <vcpu placement='static'>1</vcpu>
Oct 20 08:52:12 user nova-compute[74039]:   <resource>
Oct 20 08:52:12 user nova-compute[74039]:     <partition>/machine</partition>
Oct 20 08:52:12 user nova-compute[74039]:   </resource>
Oct 20 08:52:12 user nova-compute[74039]:   <sysinfo type='smbios'>
Oct 20 08:52:12 user nova-compute[74039]:     <system>
Oct 20 08:52:12 user nova-compute[74039]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 08:52:12 user nova-compute[74039]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 08:52:12 user nova-compute[74039]:       <entry name='version'>0.0.0</entry>
Oct 20 08:52:12 user nova-compute[74039]:       <entry name='serial'>365da377-4031-4e1b-bc85-6dcaf721548e</entry>
Oct 20 08:52:12 user nova-compute[74039]:       <entry name='uuid'>365da377-4031-4e1b-bc85-6dcaf721548e</entry>
Oct 20 08:52:12 user nova-compute[74039]:       <entry name='family'>Virtual Machine</entry>
Oct 20 08:52:12 user nova-compute[74039]:     </system>
Oct 20 08:52:12 user nova-compute[74039]:   </sysinfo>
Oct 20 08:52:12 user nova-compute[74039]:   <os>
Oct 20 08:52:12 user nova-compute[74039]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 08:52:12 user nova-compute[74039]:     <boot dev='hd'/>
Oct 20 08:52:12 user nova-compute[74039]:     <smbios mode='sysinfo'/>
Oct 20 08:52:12 user nova-compute[74039]:   </os>
Oct 20 08:52:12 user nova-compute[74039]:   <features>
Oct 20 08:52:12 user nova-compute[74039]:     <acpi/>
Oct 20 08:52:12 user nova-compute[74039]:     <apic/>
Oct 20 08:52:12 user nova-compute[74039]:     <vmcoreinfo state='on'/>
Oct 20 08:52:12 user nova-compute[74039]:   </features>
Oct 20 08:52:12 user nova-compute[74039]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 08:52:12 user nova-compute[74039]:     <model fallback='forbid'>Nehalem</model>
Oct 20 08:52:12 user nova-compute[74039]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 08:52:12 user nova-compute[74039]:     <feature policy='require' name='vme'/>
Oct 20 08:52:12 user nova-compute[74039]:     <feature policy='require' name='x2apic'/>
Oct 20 08:52:12 user nova-compute[74039]:     <feature policy='require' name='hypervisor'/>
Oct 20 08:52:12 user nova-compute[74039]:   </cpu>
Oct 20 08:52:12 user nova-compute[74039]:   <clock offset='utc'>
Oct 20 08:52:12 user nova-compute[74039]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 08:52:12 user nova-compute[74039]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 08:52:12 user nova-compute[74039]:     <timer name='hpet' present='no'/>
Oct 20 08:52:12 user nova-compute[74039]:   </clock>
Oct 20 08:52:12 user nova-compute[74039]:   <on_poweroff>destroy</on_poweroff>
Oct 20 08:52:12 user nova-compute[74039]:   <on_reboot>restart</on_reboot>
Oct 20 08:52:12 user nova-compute[74039]:   <on_crash>destroy</on_crash>
Oct 20 08:52:12 user nova-compute[74039]:   <devices>
Oct 20 08:52:12 user nova-compute[74039]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 08:52:12 user nova-compute[74039]:     <disk type='file' device='disk'>
Oct 20 08:52:12 user nova-compute[74039]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 08:52:12 user nova-compute[74039]:       <source file='/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk' index='2'/>
Oct 20 08:52:12 user nova-compute[74039]:       <backingStore type='file' index='3'>
Oct 20 08:52:12 user nova-compute[74039]:         <format type='raw'/>
Oct 20 08:52:12 user nova-compute[74039]:         <source file='/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258'/>
Oct 20 08:52:12 user nova-compute[74039]:         <backingStore/>
Oct 20 08:52:12 user nova-compute[74039]:       </backingStore>
Oct 20 08:52:12 user nova-compute[74039]:       <target dev='vda' bus='virtio'/>
Oct 20 08:52:12 user nova-compute[74039]:       <alias name='virtio-disk0'/>
Oct 20 08:52:12 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 08:52:12 user nova-compute[74039]:     </disk>
Oct 20 08:52:12 user nova-compute[74039]:     <disk type='file' device='cdrom'>
Oct 20 08:52:12 user nova-compute[74039]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 08:52:12 user nova-compute[74039]:       <source file='/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk.config' index='1'/>
Oct 20 08:52:12 user nova-compute[74039]:       <backingStore/>
Oct 20 08:52:12 user nova-compute[74039]:       <target dev='hda' bus='ide'/>
Oct 20 08:52:12 user nova-compute[74039]:       <readonly/>
Oct 20 08:52:12 user nova-compute[74039]:       <alias name='ide0-0-0'/>
Oct 20 08:52:12 user nova-compute[74039]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 08:52:12 user nova-compute[74039]:     </disk>
Oct 20 08:52:12 user nova-compute[74039]:     <controller type='usb' index='0' model='none'>
Oct 20 08:52:12 user nova-compute[74039]:       <alias name='usb'/>
Oct 20 08:52:12 user nova-compute[74039]:     </controller>
Oct 20 08:52:12 user nova-compute[74039]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 08:52:12 user nova-compute[74039]:       <alias name='pci.0'/>
Oct 20 08:52:12 user nova-compute[74039]:     </controller>
Oct 20 08:52:12 user nova-compute[74039]:     <controller type='ide' index='0'>
Oct 20 08:52:12 user nova-compute[74039]:       <alias name='ide'/>
Oct 20 08:52:12 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 08:52:12 user nova-compute[74039]:     </controller>
Oct 20 08:52:12 user nova-compute[74039]:     <interface type='ethernet'>
Oct 20 08:52:12 user nova-compute[74039]:       <mac address='fa:16:3e:8e:e7:14'/>
Oct 20 08:52:12 user nova-compute[74039]:       <target dev='tap8c246ad5-f4'/>
Oct 20 08:52:12 user nova-compute[74039]:       <model type='virtio'/>
Oct 20 08:52:12 user nova-compute[74039]:       <mtu size='1442'/>
Oct 20 08:52:12 user nova-compute[74039]:       <alias name='net0'/>
Oct 20 08:52:12 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 08:52:12 user nova-compute[74039]:     </interface>
Oct 20 08:52:12 user nova-compute[74039]:     <interface type='ethernet'>
Oct 20 08:52:12 user nova-compute[74039]:       <mac address='fa:16:3e:60:45:3e'/>
Oct 20 08:52:12 user nova-compute[74039]:       <target dev='tapdd29358a-84'/>
Oct 20 08:52:12 user nova-compute[74039]:       <model type='virtio'/>
Oct 20 08:52:12 user nova-compute[74039]:       <mtu size='1442'/>
Oct 20 08:52:12 user nova-compute[74039]:       <alias name='net1'/>
Oct 20 08:52:12 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 20 08:52:12 user nova-compute[74039]:     </interface>
Oct 20 08:52:12 user nova-compute[74039]:     <serial type='pty'>
Oct 20 08:52:12 user nova-compute[74039]:       <source path='/dev/pts/7'/>
Oct 20 08:52:12 user nova-compute[74039]:       <log file='/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/console.log' append='off'/>
Oct 20 08:52:12 user nova-compute[74039]:       <target type='isa-serial' port='0'>
Oct 20 08:52:12 user nova-compute[74039]:         <model name='isa-serial'/>
Oct 20 08:52:12 user nova-compute[74039]:       </target>
Oct 20 08:52:12 user nova-compute[74039]:       <alias name='serial0'/>
Oct 20 08:52:12 user nova-compute[74039]:     </serial>
Oct 20 08:52:12 user nova-compute[74039]:     <console type='pty' tty='/dev/pts/7'>
Oct 20 08:52:12 user nova-compute[74039]:       <source path='/dev/pts/7'/>
Oct 20 08:52:12 user nova-compute[74039]:       <log file='/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/console.log' append='off'/>
Oct 20 08:52:12 user nova-compute[74039]:       <target type='serial' port='0'/>
Oct 20 08:52:12 user nova-compute[74039]:       <alias name='serial0'/>
Oct 20 08:52:12 user nova-compute[74039]:     </console>
Oct 20 08:52:12 user nova-compute[74039]:     <input type='mouse' bus='ps2'>
Oct 20 08:52:12 user nova-compute[74039]:       <alias name='input0'/>
Oct 20 08:52:12 user nova-compute[74039]:     </input>
Oct 20 08:52:12 user nova-compute[74039]:     <input type='keyboard' bus='ps2'>
Oct 20 08:52:12 user nova-compute[74039]:       <alias name='input1'/>
Oct 20 08:52:12 user nova-compute[74039]:     </input>
Oct 20 08:52:12 user nova-compute[74039]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 20 08:52:12 user nova-compute[74039]:       <listen type='address' address='0.0.0.0'/>
Oct 20 08:52:12 user nova-compute[74039]:     </graphics>
Oct 20 08:52:12 user nova-compute[74039]:     <audio id='1' type='none'/>
Oct 20 08:52:12 user nova-compute[74039]:     <video>
Oct 20 08:52:12 user nova-compute[74039]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 08:52:12 user nova-compute[74039]:       <alias name='video0'/>
Oct 20 08:52:12 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 08:52:12 user nova-compute[74039]:     </video>
Oct 20 08:52:12 user nova-compute[74039]:     <memballoon model='virtio'>
Oct 20 08:52:12 user nova-compute[74039]:       <stats period='10'/>
Oct 20 08:52:12 user nova-compute[74039]:       <alias name='balloon0'/>
Oct 20 08:52:12 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 08:52:12 user nova-compute[74039]:     </memballoon>
Oct 20 08:52:12 user nova-compute[74039]:     <rng model='virtio'>
Oct 20 08:52:12 user nova-compute[74039]:       <backend model='random'>/dev/urandom</backend>
Oct 20 08:52:12 user nova-compute[74039]:       <alias name='rng0'/>
Oct 20 08:52:12 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 08:52:12 user nova-compute[74039]:     </rng>
Oct 20 08:52:12 user nova-compute[74039]:   </devices>
Oct 20 08:52:12 user nova-compute[74039]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 08:52:12 user nova-compute[74039]:     <label>libvirt-365da377-4031-4e1b-bc85-6dcaf721548e</label>
Oct 20 08:52:12 user nova-compute[74039]:     <imagelabel>libvirt-365da377-4031-4e1b-bc85-6dcaf721548e</imagelabel>
Oct 20 08:52:12 user nova-compute[74039]:   </seclabel>
Oct 20 08:52:12 user nova-compute[74039]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 08:52:12 user nova-compute[74039]:     <label>+64055:+108</label>
Oct 20 08:52:12 user nova-compute[74039]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 08:52:12 user nova-compute[74039]:   </seclabel>
Oct 20 08:52:12 user nova-compute[74039]: </domain>
Oct 20 08:52:12 user nova-compute[74039]:  {{(pid=74039) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 08:52:12 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Successfully detached device tapdd29358a-84 from instance 365da377-4031-4e1b-bc85-6dcaf721548e from the persistent domain config.
Oct 20 08:52:12 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] (1/8): Attempting to detach device tapdd29358a-84 with device alias net1 from instance 365da377-4031-4e1b-bc85-6dcaf721548e from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] detach device xml: <interface type="ethernet">
Oct 20 08:52:12 user nova-compute[74039]:   <mac address="fa:16:3e:60:45:3e"/>
Oct 20 08:52:12 user nova-compute[74039]:   <model type="virtio"/>
Oct 20 08:52:12 user nova-compute[74039]:   <mtu size="1442"/>
Oct 20 08:52:12 user nova-compute[74039]:   <target dev="tapdd29358a-84"/>
Oct 20 08:52:12 user nova-compute[74039]: </interface>
Oct 20 08:52:12 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:52:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Start waiting for the detach event from libvirt for device tapdd29358a-84 with device alias net1 for instance 365da377-4031-4e1b-bc85-6dcaf721548e {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-453ae04e-df4f-49f5-ab1c-9db2fbe292d3 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Acquiring lock "971fb41b-7fce-4ffe-b785-5d86f435004a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-453ae04e-df4f-49f5-ab1c-9db2fbe292d3 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lock "971fb41b-7fce-4ffe-b785-5d86f435004a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:13 user nova-compute[74039]: INFO nova.compute.manager [None req-453ae04e-df4f-49f5-ab1c-9db2fbe292d3 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Attaching volume 0f13e1cd-3cfe-4cd0-ba26-fbe87047c381 to /dev/vdb
Oct 20 08:52:13 user nova-compute[74039]: DEBUG os_brick.utils [None req-453ae04e-df4f-49f5-ab1c-9db2fbe292d3 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1726a6-6d68-4662-a73e-f71dd6dece3b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24347b7-8f9e-4d0c-88a4-c154f166f9b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5b9803-b3a9-452b-822f-cba0a80543a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebaf4c0-56ad-491d-9a42-db089e8ba9d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-453ae04e-df4f-49f5-ab1c-9db2fbe292d3 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-453ae04e-df4f-49f5-ab1c-9db2fbe292d3 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-453ae04e-df4f-49f5-ab1c-9db2fbe292d3 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:52:13 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa15c9f0-5cba-44d3-8969-f873bcf1ac60]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-453ae04e-df4f-49f5-ab1c-9db2fbe292d3 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-453ae04e-df4f-49f5-ab1c-9db2fbe292d3 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-453ae04e-df4f-49f5-ab1c-9db2fbe292d3 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG os_brick.utils [None req-453ae04e-df4f-49f5-ab1c-9db2fbe292d3 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-453ae04e-df4f-49f5-ab1c-9db2fbe292d3 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Updating existing volume attachment record: 85ff15a5-0e6d-4ba7-9de5-40c7602b5556 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Acquiring lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-05724d39-9761-4d29-a0bb-a1c1c5d54413 req-9c60903c-9e74-4b41-b892-adde06d53e5a service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received event network-vif-unplugged-dd29358a-8456-4b27-8a8c-38206751a25c {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-05724d39-9761-4d29-a0bb-a1c1c5d54413 req-9c60903c-9e74-4b41-b892-adde06d53e5a service nova] Acquiring lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-05724d39-9761-4d29-a0bb-a1c1c5d54413 req-9c60903c-9e74-4b41-b892-adde06d53e5a service nova] Lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-05724d39-9761-4d29-a0bb-a1c1c5d54413 req-9c60903c-9e74-4b41-b892-adde06d53e5a service nova] Lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-05724d39-9761-4d29-a0bb-a1c1c5d54413 req-9c60903c-9e74-4b41-b892-adde06d53e5a service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] No waiting events found dispatching network-vif-unplugged-dd29358a-8456-4b27-8a8c-38206751a25c {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:52:13 user nova-compute[74039]: WARNING nova.compute.manager [req-05724d39-9761-4d29-a0bb-a1c1c5d54413 req-9c60903c-9e74-4b41-b892-adde06d53e5a service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received unexpected event network-vif-unplugged-dd29358a-8456-4b27-8a8c-38206751a25c for instance with vm_state active and task_state None.
Oct 20 08:52:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-05724d39-9761-4d29-a0bb-a1c1c5d54413 req-9c60903c-9e74-4b41-b892-adde06d53e5a service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received event network-vif-plugged-dd29358a-8456-4b27-8a8c-38206751a25c {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-05724d39-9761-4d29-a0bb-a1c1c5d54413 req-9c60903c-9e74-4b41-b892-adde06d53e5a service nova] Acquiring lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-05724d39-9761-4d29-a0bb-a1c1c5d54413 req-9c60903c-9e74-4b41-b892-adde06d53e5a service nova] Lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-05724d39-9761-4d29-a0bb-a1c1c5d54413 req-9c60903c-9e74-4b41-b892-adde06d53e5a service nova] Lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-05724d39-9761-4d29-a0bb-a1c1c5d54413 req-9c60903c-9e74-4b41-b892-adde06d53e5a service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] No waiting events found dispatching network-vif-plugged-dd29358a-8456-4b27-8a8c-38206751a25c {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:52:13 user nova-compute[74039]: WARNING nova.compute.manager [req-05724d39-9761-4d29-a0bb-a1c1c5d54413 req-9c60903c-9e74-4b41-b892-adde06d53e5a service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received unexpected event network-vif-plugged-dd29358a-8456-4b27-8a8c-38206751a25c for instance with vm_state active and task_state None.
Oct 20 08:52:13 user nova-compute[74039]: DEBUG os_brick.utils [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcc7280-9d76-4f16-a4e6-e7f9f08c7b45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f03b66a-73e6-4483-aeed-64831483bc25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[46097934-72eb-46c8-8a12-6ae06525a6a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac932be-8e62-42fe-8726-cc13e64543a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:52:13 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[768ee0cf-b9c3-44d7-ae72-5e8ea7b936e8]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG os_brick.utils [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-76d222f7-be93-446f-87ce-72bff323d53f req-25a8a89a-6021-43e8-a94c-b41b1ab206e4 service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Received event network-vif-plugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-76d222f7-be93-446f-87ce-72bff323d53f req-25a8a89a-6021-43e8-a94c-b41b1ab206e4 service nova] Acquiring lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-76d222f7-be93-446f-87ce-72bff323d53f req-25a8a89a-6021-43e8-a94c-b41b1ab206e4 service nova] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-76d222f7-be93-446f-87ce-72bff323d53f req-25a8a89a-6021-43e8-a94c-b41b1ab206e4 service nova] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-76d222f7-be93-446f-87ce-72bff323d53f req-25a8a89a-6021-43e8-a94c-b41b1ab206e4 service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] No waiting events found dispatching network-vif-plugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:52:13 user nova-compute[74039]: WARNING nova.compute.manager [req-76d222f7-be93-446f-87ce-72bff323d53f req-25a8a89a-6021-43e8-a94c-b41b1ab206e4 service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Received unexpected event network-vif-plugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d for instance with vm_state building and task_state spawning.
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-971fb41b-7fce-4ffe-b785-5d86f435004a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-971fb41b-7fce-4ffe-b785-5d86f435004a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:14 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Updating instance_info_cache with network_info: [{"id": "903853f8-c5ee-49d4-9896-b50b043842c6", "address": "fa:16:3e:58:48:ef", "network": {"id": "298357dd-0031-4c33-8c72-269e894c8d86", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-324557364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7efa953a4a4049925485acdb855247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903853f8-c5", "ovs_interfaceid": "903853f8-c5ee-49d4-9896-b50b043842c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:52:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-971fb41b-7fce-4ffe-b785-5d86f435004a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:52:14 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 08:52:14 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:52:14 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:52:14 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:52:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:14 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 08:52:15 user nova-compute[74039]: DEBUG nova.compute.manager [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:52:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:52:15 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Instance spawned successfully.
Oct 20 08:52:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:52:15 user nova-compute[74039]: DEBUG nova.compute.manager [req-3f877f14-b6c2-4236-a16b-fc945883d10e req-6ff8a289-2825-43a5-8ab1-6d770ea87508 service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Received event network-vif-plugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:52:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3f877f14-b6c2-4236-a16b-fc945883d10e req-6ff8a289-2825-43a5-8ab1-6d770ea87508 service nova] Acquiring lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3f877f14-b6c2-4236-a16b-fc945883d10e req-6ff8a289-2825-43a5-8ab1-6d770ea87508 service nova] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3f877f14-b6c2-4236-a16b-fc945883d10e req-6ff8a289-2825-43a5-8ab1-6d770ea87508 service nova] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:15 user nova-compute[74039]: DEBUG nova.compute.manager [req-3f877f14-b6c2-4236-a16b-fc945883d10e req-6ff8a289-2825-43a5-8ab1-6d770ea87508 service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] No waiting events found dispatching network-vif-plugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:52:15 user nova-compute[74039]: WARNING nova.compute.manager [req-3f877f14-b6c2-4236-a16b-fc945883d10e req-6ff8a289-2825-43a5-8ab1-6d770ea87508 service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Received unexpected event network-vif-plugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d for instance with vm_state building and task_state spawning.
Oct 20 08:52:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:52:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:52:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:52:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:52:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:52:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:52:16 user nova-compute[74039]: INFO nova.compute.manager [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Took 5.66 seconds to spawn the instance on the hypervisor.
Oct 20 08:52:16 user nova-compute[74039]: DEBUG nova.compute.manager [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:52:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:16 user nova-compute[74039]: INFO nova.compute.manager [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Took 6.48 seconds to build instance.
Oct 20 08:52:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-213a61bb-d06e-4304-ada5-2ff1731ea5d1 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.596s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 08:52:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:20 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:52:20 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:52:20 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8027MB free_disk=25.717025756835938GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 08:52:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:20 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 9fe77a96-fcb5-4410-85cc-58d925548e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:52:20 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c8054dbd-c0ae-45d2-af95-dae7d05f8c69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:52:20 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:52:20 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 971fb41b-7fce-4ffe-b785-5d86f435004a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:52:20 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 500a0ed6-ac37-4274-a8f2-2545c270e24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:52:20 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:52:20 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 365da377-4031-4e1b-bc85-6dcaf721548e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:52:20 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 70e52f06-4f2a-4431-8149-2228565072e6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:52:20 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 913d6d22-a50f-457a-b1d2-9b978838b2a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:52:20 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:52:20 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 08:52:20 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 08:52:20 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:52:20 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:52:21 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 08:52:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.642s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:22 user nova-compute[74039]: INFO nova.compute.manager [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Swapping volume 29263da0-2ddd-416e-98a9-52e451abff13 for e60bbfa7-eab8-4fc5-a82e-16fbe709c040
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.compute.manager [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:52:22 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Creating image(s)
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Did not create local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Ensure instance console log exists: /opt/stack/data/nova/instances/913d6d22-a50f-457a-b1d2-9b978838b2a3/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.004s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Start _get_guest_xml network_info=[{"id": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "address": "fa:16:3e:27:23:4b", "network": {"id": "723ba7d9-d7fc-4535-a2f6-1b39dc49a17b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915355671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a71dec-6b", "ovs_interfaceid": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1c8f7b72-7806-406d-9d21-a8193be01c97", "address": "fa:16:3e:df:20:46", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8f7b72-78", "ovs_interfaceid": "1c8f7b72-7806-406d-9d21-a8193be01c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "address": "fa:16:3e:7c:fd:34", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25aacf0-64", "ovs_interfaceid": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "address": "fa:16:3e:bf:f8:b5", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dced799-a2", "ovs_interfaceid": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "154a5063-b927-47c2-b08c-9073addff7ce", "address": "fa:16:3e:0b:46:4c", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154a5063-b9", "ovs_interfaceid": "154a5063-b927-47c2-b08c-9073addff7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b722390-36c0-4a62-a055-b8db6a876107", "address": "fa:16:3e:c8:55:48", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b722390-36", "ovs_interfaceid": "7b722390-36c0-4a62-a055-b8db6a876107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "address": "fa:16:3e:8e:3a:c0", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce3df1d-10", "ovs_interfaceid": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'be85cfa1-faf6-483d-a063-b1e9ce328289', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgwayPoi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '913d6d22-a50f-457a-b1d2-9b978838b2a3', 'attached_at': '', 'detached_at': '', 'volume_id': '8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d', 'serial': '8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d'}, 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': '03790ce9-ebc4-4968-8238-e3bb6cbb507c', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etxbDzUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '913d6d22-a50f-457a-b1d2-9b978838b2a3', 'attached_at': '', 'detached_at': '', 'volume_id': 'd0edc0db-2f45-4846-9357-4aec238a54cf', 'serial': 'd0edc0db-2f45-4846-9357-4aec238a54cf'}, 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': '88cc85a4-d128-46ba-beea-6bb85315665e', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdc', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNMmcXaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '913d6d22-a50f-457a-b1d2-9b978838b2a3', 'attached_at': '', 'detached_at': '', 'volume_id': 'a2afe51e-0277-429a-b298-bf51979c57c9', 'serial': 'a2afe51e-0277-429a-b298-bf51979c57c9'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:52:22 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:52:22 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgwayPoi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:52:22 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:52:22 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:52:22 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[11afaad3-89c2-4f8f-86c6-46123ce0be35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 08:52:22 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc08aeb3-d118-4e24-aaa4-0034c730b20d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d] added
Oct 20 08:52:22 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[766a8721-fc86-4518-a296-3d94627e37df]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad93ed34-f543-42a5-83c0-4f40790fe819]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XgwayPoi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XgwayPoi" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a50d91-93d6-4547-9821-ccc746f61f38]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XgwayPoi'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6368b1b6-2257-4fd2-bf1c-15ea6b3d5d10]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42835f4-bb91-499a-b0b0-c7c4ea6e387c]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:22 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:22 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafe7bfc-f09b-47a7-890e-dd869799b399]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d, portal: 172.16.0.220,3260]
Oct 20 08:52:22 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d, portal: 172.16.0.220,3260] successful.
Oct 20 08:52:22 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[236b5960-ae5d-4462-ab40-0e193be51714]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd49ca76-485e-44a9-89db-d4a544f7839f]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:22 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:52:22 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:22 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:52:22 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] HCTL ('34', '-', '-', 0) found on session 7 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd06685-c402-415d-bc0b-15404be8148e]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Searching for a device in session 7 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:52:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgwayPoi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23936396663386364', 'path': '/dev/sdc'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936396663386364', 'path': '/dev/sdc'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etxbDzUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:52:23 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:52:23 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:52:23 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b320fb3-69af-42ed-a691-f4ded56c84d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 08:52:23 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae83b78-ebe6-4181-8d4c-58e6871c3e78]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf] added
Oct 20 08:52:23 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[76980a57-fe1e-437f-aa0a-34581b2873bf]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2142d839-92ee-493e-bd4b-70dad5fe25e3]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etxbDzUR {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etxbDzUR" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f63ed15-f797-421e-94d3-4e6dd7c6238a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'etxbDzUR'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[905b9d21-0def-4b76-8218-b10c37078cea]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e8ea4c-ffae-4562-a19b-efb22ba10fe0]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:23 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:52:23 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:23 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:52:23 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fe864d-36f0-4540-8363-c33445272e70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf, portal: 172.16.0.220,3260]
Oct 20 08:52:23 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf, portal: 172.16.0.220,3260] successful.
Oct 20 08:52:23 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4778b737-79eb-4302-a8b6-38bb90bc2c4b]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb185a4d-16e2-4a01-a421-24caff9c392e]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:23 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:52:23 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:52:23 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:23 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:52:23 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:52:23 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] HCTL ('35', '-', '-', 0) found on session 8 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93c3b3f-7b4a-44e8-99e0-afda287064c7]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:23 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Searching for a device in session 8 and hctl ['35', '*', '*', 0] yield: None {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Searching for a device in session 8 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etxbDzUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26435323732653335', 'path': '/dev/sdd'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435323732653335', 'path': '/dev/sdd'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNMmcXaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:52:24 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:52:24 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:52:24 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:52:24 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:52:24 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 08:52:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8367ae-39bf-4960-8477-090bb2c64be1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 08:52:24 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cb847e-d901-49a0-9ebd-48e4ed06c1a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9] added
Oct 20 08:52:24 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d478df-fa1e-499b-859d-5300f72969aa]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c55be4a-d9fb-433f-9811-cc3f6dacafcd]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VNMmcXaY {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VNMmcXaY" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e70ebc9-6a98-419d-a070-7a81351248a0]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VNMmcXaY'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fa02d2-a20a-488b-b32e-997f79434f3c]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[404f6e7c-a040-4b4f-a023-b5bfea5a1e58]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:25 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:52:25 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:52:25 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:25 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:52:25 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:52:25 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bf7928-5268-461d-9f42-04d4da7196e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9, portal: 172.16.0.220,3260]
Oct 20 08:52:25 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9, portal: 172.16.0.220,3260] successful.
Oct 20 08:52:25 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db72d34-c6d6-45f1-8cbf-d0e28a394a98]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[281944e9-fd9f-44b0-a9fe-44fece4acb73]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:25 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:52:25 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:52:25 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:52:25 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:25 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:52:25 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:52:25 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:52:25 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] HCTL ('36', '-', '-', 0) found on session 9 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[91336d41-af14-4c12-92d0-2affe4e0a079]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Searching for a device in session 9 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:52:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNMmcXaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23230623731356166', 'path': '/dev/sde'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230623731356166', 'path': '/dev/sde'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "address": "fa:16:3e:27:23:4b", "network": {"id": "723ba7d9-d7fc-4535-a2f6-1b39dc49a17b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915355671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a71dec-6b", "ovs_interfaceid": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "address": "fa:16:3e:27:23:4b", "network": {"id": "723ba7d9-d7fc-4535-a2f6-1b39dc49a17b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915355671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a71dec-6b", "ovs_interfaceid": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:23:4b,bridge_name='br-int',has_traffic_filtering=True,id=89a71dec-6bb5-448c-8bc6-81c4c2096518,network=Network(723ba7d9-d7fc-4535-a2f6-1b39dc49a17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a71dec-6b') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c8f7b72-7806-406d-9d21-a8193be01c97", "address": "fa:16:3e:df:20:46", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8f7b72-78", "ovs_interfaceid": "1c8f7b72-7806-406d-9d21-a8193be01c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "1c8f7b72-7806-406d-9d21-a8193be01c97", "address": "fa:16:3e:df:20:46", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8f7b72-78", "ovs_interfaceid": "1c8f7b72-7806-406d-9d21-a8193be01c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:20:46,bridge_name='br-int',has_traffic_filtering=True,id=1c8f7b72-7806-406d-9d21-a8193be01c97,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c8f7b72-78') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "address": "fa:16:3e:7c:fd:34", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25aacf0-64", "ovs_interfaceid": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "address": "fa:16:3e:7c:fd:34", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25aacf0-64", "ovs_interfaceid": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:fd:34,bridge_name='br-int',has_traffic_filtering=True,id=a25aacf0-6498-44b2-aff7-c6aa628dd132,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa25aacf0-64') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "address": "fa:16:3e:bf:f8:b5", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dced799-a2", "ovs_interfaceid": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "address": "fa:16:3e:bf:f8:b5", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dced799-a2", "ovs_interfaceid": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:f8:b5,bridge_name='br-int',has_traffic_filtering=True,id=4dced799-a2ac-44eb-ac2f-f0f01f78b6c7,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dced799-a2') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "154a5063-b927-47c2-b08c-9073addff7ce", "address": "fa:16:3e:0b:46:4c", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154a5063-b9", "ovs_interfaceid": "154a5063-b927-47c2-b08c-9073addff7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "154a5063-b927-47c2-b08c-9073addff7ce", "address": "fa:16:3e:0b:46:4c", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154a5063-b9", "ovs_interfaceid": "154a5063-b927-47c2-b08c-9073addff7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:46:4c,bridge_name='br-int',has_traffic_filtering=True,id=154a5063-b927-47c2-b08c-9073addff7ce,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154a5063-b9') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b722390-36c0-4a62-a055-b8db6a876107", "address": "fa:16:3e:c8:55:48", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b722390-36", "ovs_interfaceid": "7b722390-36c0-4a62-a055-b8db6a876107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "7b722390-36c0-4a62-a055-b8db6a876107", "address": "fa:16:3e:c8:55:48", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b722390-36", "ovs_interfaceid": "7b722390-36c0-4a62-a055-b8db6a876107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:55:48,bridge_name='br-int',has_traffic_filtering=True,id=7b722390-36c0-4a62-a055-b8db6a876107,network=Network(138662f4-a000-4df5-833c-fe65e388960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b722390-36') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "address": "fa:16:3e:8e:3a:c0", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce3df1d-10", "ovs_interfaceid": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "address": "fa:16:3e:8e:3a:c0", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce3df1d-10", "ovs_interfaceid": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:3a:c0,bridge_name='br-int',has_traffic_filtering=True,id=2ce3df1d-107d-4fd0-9443-d143cd17dfe5,network=Network(138662f4-a000-4df5-833c-fe65e388960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce3df1d-10') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.objects.instance [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lazy-loading 'pci_devices' on Instance uuid 913d6d22-a50f-457a-b1d2-9b978838b2a3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:52:26 user nova-compute[74039]:   <uuid>913d6d22-a50f-457a-b1d2-9b978838b2a3</uuid>
Oct 20 08:52:26 user nova-compute[74039]:   <name>instance-0000000a</name>
Oct 20 08:52:26 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:52:26 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:52:26 user nova-compute[74039]:   <metadata>
Oct 20 08:52:26 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:52:26 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:52:26 user nova-compute[74039]:       <nova:name>tempest-device-tagging-server-1592859451</nova:name>
Oct 20 08:52:26 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:52:22</nova:creationTime>
Oct 20 08:52:26 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:52:26 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:52:26 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:52:26 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:52:26 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:52:26 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:52:26 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:52:26 user nova-compute[74039]:       <nova:owner>
Oct 20 08:52:26 user nova-compute[74039]:         <nova:user uuid="bf9b8efde2e542e490d56ab047ab1d60">tempest-TaggedBootDevicesTest_v242-72787988-project-member</nova:user>
Oct 20 08:52:26 user nova-compute[74039]:         <nova:project uuid="a813e975532746078989fb217f969a33">tempest-TaggedBootDevicesTest_v242-72787988</nova:project>
Oct 20 08:52:26 user nova-compute[74039]:       </nova:owner>
Oct 20 08:52:26 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:52:26 user nova-compute[74039]:       <nova:ports>
Oct 20 08:52:26 user nova-compute[74039]:         <nova:port uuid="89a71dec-6bb5-448c-8bc6-81c4c2096518">
Oct 20 08:52:26 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 08:52:26 user nova-compute[74039]:         </nova:port>
Oct 20 08:52:26 user nova-compute[74039]:         <nova:port uuid="1c8f7b72-7806-406d-9d21-a8193be01c97">
Oct 20 08:52:26 user nova-compute[74039]:           <nova:ip type="fixed" address="10.1.1.170" ipVersion="4"/>
Oct 20 08:52:26 user nova-compute[74039]:         </nova:port>
Oct 20 08:52:26 user nova-compute[74039]:         <nova:port uuid="a25aacf0-6498-44b2-aff7-c6aa628dd132">
Oct 20 08:52:26 user nova-compute[74039]:           <nova:ip type="fixed" address="10.1.1.186" ipVersion="4"/>
Oct 20 08:52:26 user nova-compute[74039]:         </nova:port>
Oct 20 08:52:26 user nova-compute[74039]:         <nova:port uuid="4dced799-a2ac-44eb-ac2f-f0f01f78b6c7">
Oct 20 08:52:26 user nova-compute[74039]:           <nova:ip type="fixed" address="10.1.1.219" ipVersion="4"/>
Oct 20 08:52:26 user nova-compute[74039]:         </nova:port>
Oct 20 08:52:26 user nova-compute[74039]:         <nova:port uuid="154a5063-b927-47c2-b08c-9073addff7ce">
Oct 20 08:52:26 user nova-compute[74039]:           <nova:ip type="fixed" address="10.1.1.202" ipVersion="4"/>
Oct 20 08:52:26 user nova-compute[74039]:         </nova:port>
Oct 20 08:52:26 user nova-compute[74039]:         <nova:port uuid="7b722390-36c0-4a62-a055-b8db6a876107">
Oct 20 08:52:26 user nova-compute[74039]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 20 08:52:26 user nova-compute[74039]:         </nova:port>
Oct 20 08:52:26 user nova-compute[74039]:         <nova:port uuid="2ce3df1d-107d-4fd0-9443-d143cd17dfe5">
Oct 20 08:52:26 user nova-compute[74039]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 20 08:52:26 user nova-compute[74039]:         </nova:port>
Oct 20 08:52:26 user nova-compute[74039]:       </nova:ports>
Oct 20 08:52:26 user nova-compute[74039]:     </nova:instance>
Oct 20 08:52:26 user nova-compute[74039]:   </metadata>
Oct 20 08:52:26 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:52:26 user nova-compute[74039]:     <system>
Oct 20 08:52:26 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:52:26 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:52:26 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:52:26 user nova-compute[74039]:       <entry name="serial">913d6d22-a50f-457a-b1d2-9b978838b2a3</entry>
Oct 20 08:52:26 user nova-compute[74039]:       <entry name="uuid">913d6d22-a50f-457a-b1d2-9b978838b2a3</entry>
Oct 20 08:52:26 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:52:26 user nova-compute[74039]:     </system>
Oct 20 08:52:26 user nova-compute[74039]:   </sysinfo>
Oct 20 08:52:26 user nova-compute[74039]:   <os>
Oct 20 08:52:26 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:52:26 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:52:26 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:52:26 user nova-compute[74039]:   </os>
Oct 20 08:52:26 user nova-compute[74039]:   <features>
Oct 20 08:52:26 user nova-compute[74039]:     <acpi/>
Oct 20 08:52:26 user nova-compute[74039]:     <apic/>
Oct 20 08:52:26 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:52:26 user nova-compute[74039]:   </features>
Oct 20 08:52:26 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:52:26 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:52:26 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:52:26 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:52:26 user nova-compute[74039]:   </clock>
Oct 20 08:52:26 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:52:26 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:52:26 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:52:26 user nova-compute[74039]:   </cpu>
Oct 20 08:52:26 user nova-compute[74039]:   <devices>
Oct 20 08:52:26 user nova-compute[74039]:     <disk type="file" device="cdrom">
Oct 20 08:52:26 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 08:52:26 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/913d6d22-a50f-457a-b1d2-9b978838b2a3/disk.config"/>
Oct 20 08:52:26 user nova-compute[74039]:       <target dev="hda" bus="ide"/>
Oct 20 08:52:26 user nova-compute[74039]:     </disk>
Oct 20 08:52:26 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 08:52:26 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:52:26 user nova-compute[74039]:       <source dev="/dev/sdc"/>
Oct 20 08:52:26 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:52:26 user nova-compute[74039]:       <serial>8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d</serial>
Oct 20 08:52:26 user nova-compute[74039]:     </disk>
Oct 20 08:52:26 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 08:52:26 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:52:26 user nova-compute[74039]:       <source dev="/dev/sdd"/>
Oct 20 08:52:26 user nova-compute[74039]:       <target dev="vdb" bus="virtio"/>
Oct 20 08:52:26 user nova-compute[74039]:       <serial>d0edc0db-2f45-4846-9357-4aec238a54cf</serial>
Oct 20 08:52:26 user nova-compute[74039]:     </disk>
Oct 20 08:52:26 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 08:52:26 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:52:26 user nova-compute[74039]:       <source dev="/dev/sde"/>
Oct 20 08:52:26 user nova-compute[74039]:       <target dev="vdc" bus="virtio"/>
Oct 20 08:52:26 user nova-compute[74039]:       <serial>a2afe51e-0277-429a-b298-bf51979c57c9</serial>
Oct 20 08:52:26 user nova-compute[74039]:     </disk>
Oct 20 08:52:26 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:52:26 user nova-compute[74039]:       <mac address="fa:16:3e:27:23:4b"/>
Oct 20 08:52:26 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:52:26 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:52:26 user nova-compute[74039]:       <target dev="tap89a71dec-6b"/>
Oct 20 08:52:26 user nova-compute[74039]:     </interface>
Oct 20 08:52:26 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:52:26 user nova-compute[74039]:       <mac address="fa:16:3e:df:20:46"/>
Oct 20 08:52:26 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:52:26 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:52:26 user nova-compute[74039]:       <target dev="tap1c8f7b72-78"/>
Oct 20 08:52:26 user nova-compute[74039]:     </interface>
Oct 20 08:52:26 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:52:26 user nova-compute[74039]:       <mac address="fa:16:3e:7c:fd:34"/>
Oct 20 08:52:26 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:52:26 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:52:26 user nova-compute[74039]:       <target dev="tapa25aacf0-64"/>
Oct 20 08:52:26 user nova-compute[74039]:     </interface>
Oct 20 08:52:26 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:52:26 user nova-compute[74039]:       <mac address="fa:16:3e:bf:f8:b5"/>
Oct 20 08:52:26 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:52:26 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:52:26 user nova-compute[74039]:       <target dev="tap4dced799-a2"/>
Oct 20 08:52:26 user nova-compute[74039]:     </interface>
Oct 20 08:52:26 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:52:26 user nova-compute[74039]:       <mac address="fa:16:3e:0b:46:4c"/>
Oct 20 08:52:26 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:52:26 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:52:26 user nova-compute[74039]:       <target dev="tap154a5063-b9"/>
Oct 20 08:52:26 user nova-compute[74039]:     </interface>
Oct 20 08:52:26 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:52:26 user nova-compute[74039]:       <mac address="fa:16:3e:c8:55:48"/>
Oct 20 08:52:26 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:52:26 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:52:26 user nova-compute[74039]:       <target dev="tap7b722390-36"/>
Oct 20 08:52:26 user nova-compute[74039]:     </interface>
Oct 20 08:52:26 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:52:26 user nova-compute[74039]:       <mac address="fa:16:3e:8e:3a:c0"/>
Oct 20 08:52:26 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:52:26 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:52:26 user nova-compute[74039]:       <target dev="tap2ce3df1d-10"/>
Oct 20 08:52:26 user nova-compute[74039]:     </interface>
Oct 20 08:52:26 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:52:26 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/913d6d22-a50f-457a-b1d2-9b978838b2a3/console.log" append="off"/>
Oct 20 08:52:26 user nova-compute[74039]:     </serial>
Oct 20 08:52:26 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:52:26 user nova-compute[74039]:     <video>
Oct 20 08:52:26 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:52:26 user nova-compute[74039]:     </video>
Oct 20 08:52:26 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:52:26 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:52:26 user nova-compute[74039]:     </rng>
Oct 20 08:52:26 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:52:26 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:52:26 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:52:26 user nova-compute[74039]:     </memballoon>
Oct 20 08:52:26 user nova-compute[74039]:   </devices>
Oct 20 08:52:26 user nova-compute[74039]: </domain>
Oct 20 08:52:26 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "address": "fa:16:3e:27:23:4b", "network": {"id": "723ba7d9-d7fc-4535-a2f6-1b39dc49a17b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915355671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a71dec-6b", "ovs_interfaceid": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "address": "fa:16:3e:27:23:4b", "network": {"id": "723ba7d9-d7fc-4535-a2f6-1b39dc49a17b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915355671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a71dec-6b", "ovs_interfaceid": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:23:4b,bridge_name='br-int',has_traffic_filtering=True,id=89a71dec-6bb5-448c-8bc6-81c4c2096518,network=Network(723ba7d9-d7fc-4535-a2f6-1b39dc49a17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a71dec-6b') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG os_vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:23:4b,bridge_name='br-int',has_traffic_filtering=True,id=89a71dec-6bb5-448c-8bc6-81c4c2096518,network=Network(723ba7d9-d7fc-4535-a2f6-1b39dc49a17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a71dec-6b') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73cc0abc-a2da-5b71-b9d9-4362ef3ac86e', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89a71dec-6b, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89a71dec-6b, col_values=(('qos', UUID('97c94b87-5de8-4022-be25-8441ad087b6a')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89a71dec-6b, col_values=(('external_ids', {'iface-id': '89a71dec-6bb5-448c-8bc6-81c4c2096518', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:23:4b', 'vm-uuid': '913d6d22-a50f-457a-b1d2-9b978838b2a3'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: INFO os_vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:23:4b,bridge_name='br-int',has_traffic_filtering=True,id=89a71dec-6bb5-448c-8bc6-81c4c2096518,network=Network(723ba7d9-d7fc-4535-a2f6-1b39dc49a17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a71dec-6b')
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c8f7b72-7806-406d-9d21-a8193be01c97", "address": "fa:16:3e:df:20:46", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8f7b72-78", "ovs_interfaceid": "1c8f7b72-7806-406d-9d21-a8193be01c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "1c8f7b72-7806-406d-9d21-a8193be01c97", "address": "fa:16:3e:df:20:46", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8f7b72-78", "ovs_interfaceid": "1c8f7b72-7806-406d-9d21-a8193be01c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:20:46,bridge_name='br-int',has_traffic_filtering=True,id=1c8f7b72-7806-406d-9d21-a8193be01c97,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c8f7b72-78') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG os_vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:20:46,bridge_name='br-int',has_traffic_filtering=True,id=1c8f7b72-7806-406d-9d21-a8193be01c97,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c8f7b72-78') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eafc95e2-43ce-5b34-a9de-a97f36655f45', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c8f7b72-78, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c8f7b72-78, col_values=(('qos', UUID('2681360c-8f58-4106-b4d1-b6fe1864e031')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c8f7b72-78, col_values=(('external_ids', {'iface-id': '1c8f7b72-7806-406d-9d21-a8193be01c97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:20:46', 'vm-uuid': '913d6d22-a50f-457a-b1d2-9b978838b2a3'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: INFO os_vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:20:46,bridge_name='br-int',has_traffic_filtering=True,id=1c8f7b72-7806-406d-9d21-a8193be01c97,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c8f7b72-78')
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "address": "fa:16:3e:7c:fd:34", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25aacf0-64", "ovs_interfaceid": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "address": "fa:16:3e:7c:fd:34", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25aacf0-64", "ovs_interfaceid": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:fd:34,bridge_name='br-int',has_traffic_filtering=True,id=a25aacf0-6498-44b2-aff7-c6aa628dd132,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa25aacf0-64') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG os_vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:fd:34,bridge_name='br-int',has_traffic_filtering=True,id=a25aacf0-6498-44b2-aff7-c6aa628dd132,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa25aacf0-64') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f978930-bdc1-5dbb-95fa-f63f7bbe4897', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa25aacf0-64, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa25aacf0-64, col_values=(('qos', UUID('f7875973-bd37-4532-a0ad-0fad8084b970')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa25aacf0-64, col_values=(('external_ids', {'iface-id': 'a25aacf0-6498-44b2-aff7-c6aa628dd132', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:fd:34', 'vm-uuid': '913d6d22-a50f-457a-b1d2-9b978838b2a3'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: INFO os_vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:fd:34,bridge_name='br-int',has_traffic_filtering=True,id=a25aacf0-6498-44b2-aff7-c6aa628dd132,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa25aacf0-64')
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "address": "fa:16:3e:bf:f8:b5", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dced799-a2", "ovs_interfaceid": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "address": "fa:16:3e:bf:f8:b5", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dced799-a2", "ovs_interfaceid": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:f8:b5,bridge_name='br-int',has_traffic_filtering=True,id=4dced799-a2ac-44eb-ac2f-f0f01f78b6c7,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dced799-a2') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG os_vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:f8:b5,bridge_name='br-int',has_traffic_filtering=True,id=4dced799-a2ac-44eb-ac2f-f0f01f78b6c7,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dced799-a2') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca3248d3-24bd-5aaf-a245-22b3e528ecbf', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4dced799-a2, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4dced799-a2, col_values=(('qos', UUID('33a58052-6a0e-4b16-84e4-5853ddb329c0')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4dced799-a2, col_values=(('external_ids', {'iface-id': '4dced799-a2ac-44eb-ac2f-f0f01f78b6c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:f8:b5', 'vm-uuid': '913d6d22-a50f-457a-b1d2-9b978838b2a3'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: INFO os_vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:f8:b5,bridge_name='br-int',has_traffic_filtering=True,id=4dced799-a2ac-44eb-ac2f-f0f01f78b6c7,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dced799-a2')
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "154a5063-b927-47c2-b08c-9073addff7ce", "address": "fa:16:3e:0b:46:4c", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154a5063-b9", "ovs_interfaceid": "154a5063-b927-47c2-b08c-9073addff7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "154a5063-b927-47c2-b08c-9073addff7ce", "address": "fa:16:3e:0b:46:4c", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154a5063-b9", "ovs_interfaceid": "154a5063-b927-47c2-b08c-9073addff7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:46:4c,bridge_name='br-int',has_traffic_filtering=True,id=154a5063-b927-47c2-b08c-9073addff7ce,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154a5063-b9') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG os_vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:46:4c,bridge_name='br-int',has_traffic_filtering=True,id=154a5063-b927-47c2-b08c-9073addff7ce,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154a5063-b9') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c422a3e-8643-5d74-b789-babf5e5a342e', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap154a5063-b9, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap154a5063-b9, col_values=(('qos', UUID('485494ac-7aba-4fed-89d6-e9dabbb3c1af')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap154a5063-b9, col_values=(('external_ids', {'iface-id': '154a5063-b927-47c2-b08c-9073addff7ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:46:4c', 'vm-uuid': '913d6d22-a50f-457a-b1d2-9b978838b2a3'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: INFO os_vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:46:4c,bridge_name='br-int',has_traffic_filtering=True,id=154a5063-b927-47c2-b08c-9073addff7ce,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154a5063-b9')
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b722390-36c0-4a62-a055-b8db6a876107", "address": "fa:16:3e:c8:55:48", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b722390-36", "ovs_interfaceid": "7b722390-36c0-4a62-a055-b8db6a876107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "7b722390-36c0-4a62-a055-b8db6a876107", "address": "fa:16:3e:c8:55:48", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b722390-36", "ovs_interfaceid": "7b722390-36c0-4a62-a055-b8db6a876107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:55:48,bridge_name='br-int',has_traffic_filtering=True,id=7b722390-36c0-4a62-a055-b8db6a876107,network=Network(138662f4-a000-4df5-833c-fe65e388960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b722390-36') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG os_vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:55:48,bridge_name='br-int',has_traffic_filtering=True,id=7b722390-36c0-4a62-a055-b8db6a876107,network=Network(138662f4-a000-4df5-833c-fe65e388960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b722390-36') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa9391c5-9975-5510-91a8-c369087b2ad7', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b722390-36, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b722390-36, col_values=(('qos', UUID('4f7fcc98-8122-4142-89c8-b100cc532e5a')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b722390-36, col_values=(('external_ids', {'iface-id': '7b722390-36c0-4a62-a055-b8db6a876107', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:55:48', 'vm-uuid': '913d6d22-a50f-457a-b1d2-9b978838b2a3'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: INFO os_vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:55:48,bridge_name='br-int',has_traffic_filtering=True,id=7b722390-36c0-4a62-a055-b8db6a876107,network=Network(138662f4-a000-4df5-833c-fe65e388960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b722390-36')
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:51:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "address": "fa:16:3e:8e:3a:c0", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce3df1d-10", "ovs_interfaceid": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "address": "fa:16:3e:8e:3a:c0", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce3df1d-10", "ovs_interfaceid": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:3a:c0,bridge_name='br-int',has_traffic_filtering=True,id=2ce3df1d-107d-4fd0-9443-d143cd17dfe5,network=Network(138662f4-a000-4df5-833c-fe65e388960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce3df1d-10') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG os_vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:3a:c0,bridge_name='br-int',has_traffic_filtering=True,id=2ce3df1d-107d-4fd0-9443-d143cd17dfe5,network=Network(138662f4-a000-4df5-833c-fe65e388960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce3df1d-10') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd69bae90-35be-5fc1-ae6e-0865e8eb5100', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ce3df1d-10, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ce3df1d-10, col_values=(('qos', UUID('10635127-6afc-4ec1-a14b-b5b4295be0bd')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ce3df1d-10, col_values=(('external_ids', {'iface-id': '2ce3df1d-107d-4fd0-9443-d143cd17dfe5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:3a:c0', 'vm-uuid': '913d6d22-a50f-457a-b1d2-9b978838b2a3'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:52:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:27 user nova-compute[74039]: INFO os_vif [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:3a:c0,bridge_name='br-int',has_traffic_filtering=True,id=2ce3df1d-107d-4fd0-9443-d143cd17dfe5,network=Network(138662f4-a000-4df5-833c-fe65e388960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce3df1d-10')
Oct 20 08:52:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] No BDM found with device name hda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:52:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:52:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] No VIF found with MAC fa:16:3e:27:23:4b, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:52:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] No VIF found with MAC fa:16:3e:0b:46:4c, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:52:27 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Using config drive
Oct 20 08:52:27 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Creating config drive at /opt/stack/data/nova/instances/913d6d22-a50f-457a-b1d2-9b978838b2a3/disk.config
Oct 20 08:52:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/913d6d22-a50f-457a-b1d2-9b978838b2a3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp01bmmiif {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/913d6d22-a50f-457a-b1d2-9b978838b2a3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp01bmmiif" returned: 0 in 0.054s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-246253ab-2c2b-4dfb-9421-a7513c59a00a req-ace97f64-5d2d-4d87-9610-8766921d8a7e service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-89a71dec-6bb5-448c-8bc6-81c4c2096518 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-246253ab-2c2b-4dfb-9421-a7513c59a00a req-ace97f64-5d2d-4d87-9610-8766921d8a7e service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-246253ab-2c2b-4dfb-9421-a7513c59a00a req-ace97f64-5d2d-4d87-9610-8766921d8a7e service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-246253ab-2c2b-4dfb-9421-a7513c59a00a req-ace97f64-5d2d-4d87-9610-8766921d8a7e service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-246253ab-2c2b-4dfb-9421-a7513c59a00a req-ace97f64-5d2d-4d87-9610-8766921d8a7e service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-89a71dec-6bb5-448c-8bc6-81c4c2096518 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:52:29 user nova-compute[74039]: WARNING nova.compute.manager [req-246253ab-2c2b-4dfb-9421-a7513c59a00a req-ace97f64-5d2d-4d87-9610-8766921d8a7e service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-89a71dec-6bb5-448c-8bc6-81c4c2096518 for instance with vm_state building and task_state spawning.
Oct 20 08:52:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-53d78d4a-b5d3-4fef-b1c5-2085a05db66f req-b5017bca-3a76-4ea9-bfa8-f778cb28b6a9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-1c8f7b72-7806-406d-9d21-a8193be01c97 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-53d78d4a-b5d3-4fef-b1c5-2085a05db66f req-b5017bca-3a76-4ea9-bfa8-f778cb28b6a9 service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-53d78d4a-b5d3-4fef-b1c5-2085a05db66f req-b5017bca-3a76-4ea9-bfa8-f778cb28b6a9 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-53d78d4a-b5d3-4fef-b1c5-2085a05db66f req-b5017bca-3a76-4ea9-bfa8-f778cb28b6a9 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-53d78d4a-b5d3-4fef-b1c5-2085a05db66f req-b5017bca-3a76-4ea9-bfa8-f778cb28b6a9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-1c8f7b72-7806-406d-9d21-a8193be01c97 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:52:29 user nova-compute[74039]: WARNING nova.compute.manager [req-53d78d4a-b5d3-4fef-b1c5-2085a05db66f req-b5017bca-3a76-4ea9-bfa8-f778cb28b6a9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-1c8f7b72-7806-406d-9d21-a8193be01c97 for instance with vm_state building and task_state spawning.
Oct 20 08:52:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-fdcebf2c-45b8-4a8f-879a-551d8974fcda req-8a55cfbf-5ce3-4f3c-b576-6be016fda89c service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-7b722390-36c0-4a62-a055-b8db6a876107 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:52:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-fdcebf2c-45b8-4a8f-879a-551d8974fcda req-8a55cfbf-5ce3-4f3c-b576-6be016fda89c service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-fdcebf2c-45b8-4a8f-879a-551d8974fcda req-8a55cfbf-5ce3-4f3c-b576-6be016fda89c service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-fdcebf2c-45b8-4a8f-879a-551d8974fcda req-8a55cfbf-5ce3-4f3c-b576-6be016fda89c service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-fdcebf2c-45b8-4a8f-879a-551d8974fcda req-8a55cfbf-5ce3-4f3c-b576-6be016fda89c service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-7b722390-36c0-4a62-a055-b8db6a876107 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:52:30 user nova-compute[74039]: WARNING nova.compute.manager [req-fdcebf2c-45b8-4a8f-879a-551d8974fcda req-8a55cfbf-5ce3-4f3c-b576-6be016fda89c service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-7b722390-36c0-4a62-a055-b8db6a876107 for instance with vm_state building and task_state spawning.
Oct 20 08:52:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-89a71dec-6bb5-448c-8bc6-81c4c2096518 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-89a71dec-6bb5-448c-8bc6-81c4c2096518 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:52:31 user nova-compute[74039]: WARNING nova.compute.manager [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-89a71dec-6bb5-448c-8bc6-81c4c2096518 for instance with vm_state building and task_state spawning.
Oct 20 08:52:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-4dced799-a2ac-44eb-ac2f-f0f01f78b6c7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-4dced799-a2ac-44eb-ac2f-f0f01f78b6c7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:52:31 user nova-compute[74039]: WARNING nova.compute.manager [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-4dced799-a2ac-44eb-ac2f-f0f01f78b6c7 for instance with vm_state building and task_state spawning.
Oct 20 08:52:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-4dced799-a2ac-44eb-ac2f-f0f01f78b6c7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-4dced799-a2ac-44eb-ac2f-f0f01f78b6c7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:52:31 user nova-compute[74039]: WARNING nova.compute.manager [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-4dced799-a2ac-44eb-ac2f-f0f01f78b6c7 for instance with vm_state building and task_state spawning.
Oct 20 08:52:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-154a5063-b927-47c2-b08c-9073addff7ce {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-154a5063-b927-47c2-b08c-9073addff7ce {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:52:31 user nova-compute[74039]: WARNING nova.compute.manager [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-154a5063-b927-47c2-b08c-9073addff7ce for instance with vm_state building and task_state spawning.
Oct 20 08:52:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-154a5063-b927-47c2-b08c-9073addff7ce {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-154a5063-b927-47c2-b08c-9073addff7ce {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:52:31 user nova-compute[74039]: WARNING nova.compute.manager [req-8d2b7c27-4ce8-46ca-bc46-aa41da81f646 req-f425e869-f6b4-48b7-8f51-53c5d8f41cd9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-154a5063-b927-47c2-b08c-9073addff7ce for instance with vm_state building and task_state spawning.
Oct 20 08:52:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-ab515d24-a643-46af-bc86-b35ee1217b56 req-d666ac7c-a9d5-4d6d-85c3-56d5e09e509a service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-1c8f7b72-7806-406d-9d21-a8193be01c97 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ab515d24-a643-46af-bc86-b35ee1217b56 req-d666ac7c-a9d5-4d6d-85c3-56d5e09e509a service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ab515d24-a643-46af-bc86-b35ee1217b56 req-d666ac7c-a9d5-4d6d-85c3-56d5e09e509a service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ab515d24-a643-46af-bc86-b35ee1217b56 req-d666ac7c-a9d5-4d6d-85c3-56d5e09e509a service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-ab515d24-a643-46af-bc86-b35ee1217b56 req-d666ac7c-a9d5-4d6d-85c3-56d5e09e509a service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-1c8f7b72-7806-406d-9d21-a8193be01c97 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:52:31 user nova-compute[74039]: WARNING nova.compute.manager [req-ab515d24-a643-46af-bc86-b35ee1217b56 req-d666ac7c-a9d5-4d6d-85c3-56d5e09e509a service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-1c8f7b72-7806-406d-9d21-a8193be01c97 for instance with vm_state building and task_state spawning.
Oct 20 08:52:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-ab515d24-a643-46af-bc86-b35ee1217b56 req-d666ac7c-a9d5-4d6d-85c3-56d5e09e509a service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-a25aacf0-6498-44b2-aff7-c6aa628dd132 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ab515d24-a643-46af-bc86-b35ee1217b56 req-d666ac7c-a9d5-4d6d-85c3-56d5e09e509a service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ab515d24-a643-46af-bc86-b35ee1217b56 req-d666ac7c-a9d5-4d6d-85c3-56d5e09e509a service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ab515d24-a643-46af-bc86-b35ee1217b56 req-d666ac7c-a9d5-4d6d-85c3-56d5e09e509a service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-ab515d24-a643-46af-bc86-b35ee1217b56 req-d666ac7c-a9d5-4d6d-85c3-56d5e09e509a service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-a25aacf0-6498-44b2-aff7-c6aa628dd132 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:52:31 user nova-compute[74039]: WARNING nova.compute.manager [req-ab515d24-a643-46af-bc86-b35ee1217b56 req-d666ac7c-a9d5-4d6d-85c3-56d5e09e509a service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-a25aacf0-6498-44b2-aff7-c6aa628dd132 for instance with vm_state building and task_state spawning.
Oct 20 08:52:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-ab515d24-a643-46af-bc86-b35ee1217b56 req-d666ac7c-a9d5-4d6d-85c3-56d5e09e509a service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-a25aacf0-6498-44b2-aff7-c6aa628dd132 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ab515d24-a643-46af-bc86-b35ee1217b56 req-d666ac7c-a9d5-4d6d-85c3-56d5e09e509a service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ab515d24-a643-46af-bc86-b35ee1217b56 req-d666ac7c-a9d5-4d6d-85c3-56d5e09e509a service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ab515d24-a643-46af-bc86-b35ee1217b56 req-d666ac7c-a9d5-4d6d-85c3-56d5e09e509a service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-ab515d24-a643-46af-bc86-b35ee1217b56 req-d666ac7c-a9d5-4d6d-85c3-56d5e09e509a service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-a25aacf0-6498-44b2-aff7-c6aa628dd132 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:52:31 user nova-compute[74039]: WARNING nova.compute.manager [req-ab515d24-a643-46af-bc86-b35ee1217b56 req-d666ac7c-a9d5-4d6d-85c3-56d5e09e509a service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-a25aacf0-6498-44b2-aff7-c6aa628dd132 for instance with vm_state building and task_state spawning.
Oct 20 08:52:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:33 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Waiting for libvirt event about the detach of device tapdd29358a-84 with device alias net1 from instance 365da377-4031-4e1b-bc85-6dcaf721548e is timed out.
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:60:45:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tapdd29358a-84"/></interface> {{(pid=74039) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:60:45:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tapdd29358a-84"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 20 08:52:33 user nova-compute[74039]:   <name>instance-00000008</name>
Oct 20 08:52:33 user nova-compute[74039]:   <uuid>365da377-4031-4e1b-bc85-6dcaf721548e</uuid>
Oct 20 08:52:33 user nova-compute[74039]:   <metadata>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:52:33 user nova-compute[74039]:   <nova:package version="0.0.0"/>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:name>tempest-device-tagging-server-2124112502</nova:name>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:creationTime>2023-10-20 08:50:51</nova:creationTime>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:flavor name="m1.tiny">
Oct 20 08:52:33 user nova-compute[74039]:     <nova:memory>512</nova:memory>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:disk>1</nova:disk>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:swap>0</nova:swap>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:vcpus>1</nova:vcpus>
Oct 20 08:52:33 user nova-compute[74039]:   </nova:flavor>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:owner>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:user uuid="29ca829a96484751876ead6f2b094e54">tempest-TaggedAttachmentsTest-92531413-project-member</nova:user>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:project uuid="40f437448d494f75838a2c7b2b6a973f">tempest-TaggedAttachmentsTest-92531413</nova:project>
Oct 20 08:52:33 user nova-compute[74039]:   </nova:owner>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:ports>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:port uuid="8c246ad5-f489-4486-b930-9d4a1cb60c41">
Oct 20 08:52:33 user nova-compute[74039]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 08:52:33 user nova-compute[74039]:     </nova:port>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:port uuid="dd29358a-8456-4b27-8a8c-38206751a25c">
Oct 20 08:52:33 user nova-compute[74039]:       <nova:ip type="fixed" address="10.10.10.210" ipVersion="4"/>
Oct 20 08:52:33 user nova-compute[74039]:     </nova:port>
Oct 20 08:52:33 user nova-compute[74039]:   </nova:ports>
Oct 20 08:52:33 user nova-compute[74039]: </nova:instance>
Oct 20 08:52:33 user nova-compute[74039]:   </metadata>
Oct 20 08:52:33 user nova-compute[74039]:   <memory unit='KiB'>524288</memory>
Oct 20 08:52:33 user nova-compute[74039]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 08:52:33 user nova-compute[74039]:   <vcpu placement='static'>1</vcpu>
Oct 20 08:52:33 user nova-compute[74039]:   <resource>
Oct 20 08:52:33 user nova-compute[74039]:     <partition>/machine</partition>
Oct 20 08:52:33 user nova-compute[74039]:   </resource>
Oct 20 08:52:33 user nova-compute[74039]:   <sysinfo type='smbios'>
Oct 20 08:52:33 user nova-compute[74039]:     <system>
Oct 20 08:52:33 user nova-compute[74039]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 08:52:33 user nova-compute[74039]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 08:52:33 user nova-compute[74039]:       <entry name='version'>0.0.0</entry>
Oct 20 08:52:33 user nova-compute[74039]:       <entry name='serial'>365da377-4031-4e1b-bc85-6dcaf721548e</entry>
Oct 20 08:52:33 user nova-compute[74039]:       <entry name='uuid'>365da377-4031-4e1b-bc85-6dcaf721548e</entry>
Oct 20 08:52:33 user nova-compute[74039]:       <entry name='family'>Virtual Machine</entry>
Oct 20 08:52:33 user nova-compute[74039]:     </system>
Oct 20 08:52:33 user nova-compute[74039]:   </sysinfo>
Oct 20 08:52:33 user nova-compute[74039]:   <os>
Oct 20 08:52:33 user nova-compute[74039]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 08:52:33 user nova-compute[74039]:     <boot dev='hd'/>
Oct 20 08:52:33 user nova-compute[74039]:     <smbios mode='sysinfo'/>
Oct 20 08:52:33 user nova-compute[74039]:   </os>
Oct 20 08:52:33 user nova-compute[74039]:   <features>
Oct 20 08:52:33 user nova-compute[74039]:     <acpi/>
Oct 20 08:52:33 user nova-compute[74039]:     <apic/>
Oct 20 08:52:33 user nova-compute[74039]:     <vmcoreinfo state='on'/>
Oct 20 08:52:33 user nova-compute[74039]:   </features>
Oct 20 08:52:33 user nova-compute[74039]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 08:52:33 user nova-compute[74039]:     <model fallback='forbid'>Nehalem</model>
Oct 20 08:52:33 user nova-compute[74039]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 08:52:33 user nova-compute[74039]:     <feature policy='require' name='vme'/>
Oct 20 08:52:33 user nova-compute[74039]:     <feature policy='require' name='x2apic'/>
Oct 20 08:52:33 user nova-compute[74039]:     <feature policy='require' name='hypervisor'/>
Oct 20 08:52:33 user nova-compute[74039]:   </cpu>
Oct 20 08:52:33 user nova-compute[74039]:   <clock offset='utc'>
Oct 20 08:52:33 user nova-compute[74039]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 08:52:33 user nova-compute[74039]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 08:52:33 user nova-compute[74039]:     <timer name='hpet' present='no'/>
Oct 20 08:52:33 user nova-compute[74039]:   </clock>
Oct 20 08:52:33 user nova-compute[74039]:   <on_poweroff>destroy</on_poweroff>
Oct 20 08:52:33 user nova-compute[74039]:   <on_reboot>restart</on_reboot>
Oct 20 08:52:33 user nova-compute[74039]:   <on_crash>destroy</on_crash>
Oct 20 08:52:33 user nova-compute[74039]:   <devices>
Oct 20 08:52:33 user nova-compute[74039]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 08:52:33 user nova-compute[74039]:     <disk type='file' device='disk'>
Oct 20 08:52:33 user nova-compute[74039]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 08:52:33 user nova-compute[74039]:       <source file='/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk' index='2'/>
Oct 20 08:52:33 user nova-compute[74039]:       <backingStore type='file' index='3'>
Oct 20 08:52:33 user nova-compute[74039]:         <format type='raw'/>
Oct 20 08:52:33 user nova-compute[74039]:         <source file='/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258'/>
Oct 20 08:52:33 user nova-compute[74039]:         <backingStore/>
Oct 20 08:52:33 user nova-compute[74039]:       </backingStore>
Oct 20 08:52:33 user nova-compute[74039]:       <target dev='vda' bus='virtio'/>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='virtio-disk0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </disk>
Oct 20 08:52:33 user nova-compute[74039]:     <disk type='file' device='cdrom'>
Oct 20 08:52:33 user nova-compute[74039]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 08:52:33 user nova-compute[74039]:       <source file='/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk.config' index='1'/>
Oct 20 08:52:33 user nova-compute[74039]:       <backingStore/>
Oct 20 08:52:33 user nova-compute[74039]:       <target dev='hda' bus='ide'/>
Oct 20 08:52:33 user nova-compute[74039]:       <readonly/>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='ide0-0-0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </disk>
Oct 20 08:52:33 user nova-compute[74039]:     <controller type='usb' index='0' model='none'>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='usb'/>
Oct 20 08:52:33 user nova-compute[74039]:     </controller>
Oct 20 08:52:33 user nova-compute[74039]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='pci.0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </controller>
Oct 20 08:52:33 user nova-compute[74039]:     <controller type='ide' index='0'>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='ide'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 08:52:33 user nova-compute[74039]:     </controller>
Oct 20 08:52:33 user nova-compute[74039]:     <interface type='ethernet'>
Oct 20 08:52:33 user nova-compute[74039]:       <mac address='fa:16:3e:8e:e7:14'/>
Oct 20 08:52:33 user nova-compute[74039]:       <target dev='tap8c246ad5-f4'/>
Oct 20 08:52:33 user nova-compute[74039]:       <model type='virtio'/>
Oct 20 08:52:33 user nova-compute[74039]:       <mtu size='1442'/>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='net0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </interface>
Oct 20 08:52:33 user nova-compute[74039]:     <serial type='pty'>
Oct 20 08:52:33 user nova-compute[74039]:       <source path='/dev/pts/7'/>
Oct 20 08:52:33 user nova-compute[74039]:       <log file='/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/console.log' append='off'/>
Oct 20 08:52:33 user nova-compute[74039]:       <target type='isa-serial' port='0'>
Oct 20 08:52:33 user nova-compute[74039]:         <model name='isa-serial'/>
Oct 20 08:52:33 user nova-compute[74039]:       </target>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='serial0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </serial>
Oct 20 08:52:33 user nova-compute[74039]:     <console type='pty' tty='/dev/pts/7'>
Oct 20 08:52:33 user nova-compute[74039]:       <source path='/dev/pts/7'/>
Oct 20 08:52:33 user nova-compute[74039]:       <log file='/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/console.log' append='off'/>
Oct 20 08:52:33 user nova-compute[74039]:       <target type='serial' port='0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='serial0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </console>
Oct 20 08:52:33 user nova-compute[74039]:     <input type='mouse' bus='ps2'>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='input0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </input>
Oct 20 08:52:33 user nova-compute[74039]:     <input type='keyboard' bus='ps2'>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='input1'/>
Oct 20 08:52:33 user nova-compute[74039]:     </input>
Oct 20 08:52:33 user nova-compute[74039]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 20 08:52:33 user nova-compute[74039]:       <listen type='address' address='0.0.0.0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </graphics>
Oct 20 08:52:33 user nova-compute[74039]:     <audio id='1' type='none'/>
Oct 20 08:52:33 user nova-compute[74039]:     <video>
Oct 20 08:52:33 user nova-compute[74039]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='video0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </video>
Oct 20 08:52:33 user nova-compute[74039]:     <memballoon model='virtio'>
Oct 20 08:52:33 user nova-compute[74039]:       <stats period='10'/>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='balloon0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </memballoon>
Oct 20 08:52:33 user nova-compute[74039]:     <rng model='virtio'>
Oct 20 08:52:33 user nova-compute[74039]:       <backend model='random'>/dev/urandom</backend>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='rng0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </rng>
Oct 20 08:52:33 user nova-compute[74039]:   </devices>
Oct 20 08:52:33 user nova-compute[74039]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 08:52:33 user nova-compute[74039]:     <label>libvirt-365da377-4031-4e1b-bc85-6dcaf721548e</label>
Oct 20 08:52:33 user nova-compute[74039]:     <imagelabel>libvirt-365da377-4031-4e1b-bc85-6dcaf721548e</imagelabel>
Oct 20 08:52:33 user nova-compute[74039]:   </seclabel>
Oct 20 08:52:33 user nova-compute[74039]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 08:52:33 user nova-compute[74039]:     <label>+64055:+108</label>
Oct 20 08:52:33 user nova-compute[74039]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 08:52:33 user nova-compute[74039]:   </seclabel>
Oct 20 08:52:33 user nova-compute[74039]: </domain>
Oct 20 08:52:33 user nova-compute[74039]:  {{(pid=74039) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 08:52:33 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Successfully detached device tapdd29358a-84 from instance 365da377-4031-4e1b-bc85-6dcaf721548e from the live domain config.
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:48:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2124112502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2124112502',id=8,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADEixoB6QWWhTLuwL+7Z2fkKKWHkyf3tVdnf4752CWzbdJ5lz/PbSjwRzike1kbeQLqKQLtsajre3rrJlFKfvXx6m1o9pCXfJmA6Y4TeaBnPAeS7YpGXhczqHT/lsYEnw==',key_name='tempest-keypair-1295832388',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:49:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40f437448d494f75838a2c7b2b6a973f',ramdisk_id='',reservation_id='r-d06qmgd5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-92531413',owner_user_name='tempest-TaggedAttachmentsTest-92531413-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:49:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29ca829a96484751876ead6f2b094e54',uuid=365da377-4031-4e1b-bc85-6dcaf721548e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd29358a-8456-4b27-8a8c-38206751a25c", "address": "fa:16:3e:60:45:3e", "network": {"id": "3774a21d-147a-442f-a2c8-b94306649d95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-954620919", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29358a-84", "ovs_interfaceid": "dd29358a-8456-4b27-8a8c-38206751a25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Converting VIF {"id": "dd29358a-8456-4b27-8a8c-38206751a25c", "address": "fa:16:3e:60:45:3e", "network": {"id": "3774a21d-147a-442f-a2c8-b94306649d95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-954620919", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29358a-84", "ovs_interfaceid": "dd29358a-8456-4b27-8a8c-38206751a25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:45:3e,bridge_name='br-int',has_traffic_filtering=True,id=dd29358a-8456-4b27-8a8c-38206751a25c,network=Network(3774a21d-147a-442f-a2c8-b94306649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd29358a-84') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG os_vif [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:45:3e,bridge_name='br-int',has_traffic_filtering=True,id=dd29358a-8456-4b27-8a8c-38206751a25c,network=Network(3774a21d-147a-442f-a2c8-b94306649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd29358a-84') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd29358a-84, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa856901-957e-4963-8eb1-5a4877155d7e) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:33 user nova-compute[74039]: INFO os_vif [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:45:3e,bridge_name='br-int',has_traffic_filtering=True,id=dd29358a-8456-4b27-8a8c-38206751a25c,network=Network(3774a21d-147a-442f-a2c8-b94306649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd29358a-84')
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:52:33 user nova-compute[74039]:   <nova:package version="0.0.0"/>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:name>tempest-device-tagging-server-2124112502</nova:name>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:creationTime>2023-10-20 08:52:33</nova:creationTime>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:flavor name="m1.tiny">
Oct 20 08:52:33 user nova-compute[74039]:     <nova:memory>512</nova:memory>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:disk>1</nova:disk>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:swap>0</nova:swap>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:vcpus>1</nova:vcpus>
Oct 20 08:52:33 user nova-compute[74039]:   </nova:flavor>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:owner>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:user uuid="29ca829a96484751876ead6f2b094e54">tempest-TaggedAttachmentsTest-92531413-project-member</nova:user>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:project uuid="40f437448d494f75838a2c7b2b6a973f">tempest-TaggedAttachmentsTest-92531413</nova:project>
Oct 20 08:52:33 user nova-compute[74039]:   </nova:owner>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:ports>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:port uuid="8c246ad5-f489-4486-b930-9d4a1cb60c41">
Oct 20 08:52:33 user nova-compute[74039]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 08:52:33 user nova-compute[74039]:     </nova:port>
Oct 20 08:52:33 user nova-compute[74039]:   </nova:ports>
Oct 20 08:52:33 user nova-compute[74039]: </nova:instance>
Oct 20 08:52:33 user nova-compute[74039]:  {{(pid=74039) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.compute.manager [req-c59b5680-9ddb-42da-a0d8-e11fe6179784 req-68af1cad-be61-4e53-9d3d-bd9fb35dda57 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-7b722390-36c0-4a62-a055-b8db6a876107 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c59b5680-9ddb-42da-a0d8-e11fe6179784 req-68af1cad-be61-4e53-9d3d-bd9fb35dda57 service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c59b5680-9ddb-42da-a0d8-e11fe6179784 req-68af1cad-be61-4e53-9d3d-bd9fb35dda57 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c59b5680-9ddb-42da-a0d8-e11fe6179784 req-68af1cad-be61-4e53-9d3d-bd9fb35dda57 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.compute.manager [req-c59b5680-9ddb-42da-a0d8-e11fe6179784 req-68af1cad-be61-4e53-9d3d-bd9fb35dda57 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-7b722390-36c0-4a62-a055-b8db6a876107 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:52:33 user nova-compute[74039]: WARNING nova.compute.manager [req-c59b5680-9ddb-42da-a0d8-e11fe6179784 req-68af1cad-be61-4e53-9d3d-bd9fb35dda57 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-7b722390-36c0-4a62-a055-b8db6a876107 for instance with vm_state building and task_state spawning.
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.compute.manager [req-c59b5680-9ddb-42da-a0d8-e11fe6179784 req-68af1cad-be61-4e53-9d3d-bd9fb35dda57 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-2ce3df1d-107d-4fd0-9443-d143cd17dfe5 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c59b5680-9ddb-42da-a0d8-e11fe6179784 req-68af1cad-be61-4e53-9d3d-bd9fb35dda57 service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c59b5680-9ddb-42da-a0d8-e11fe6179784 req-68af1cad-be61-4e53-9d3d-bd9fb35dda57 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c59b5680-9ddb-42da-a0d8-e11fe6179784 req-68af1cad-be61-4e53-9d3d-bd9fb35dda57 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.compute.manager [req-c59b5680-9ddb-42da-a0d8-e11fe6179784 req-68af1cad-be61-4e53-9d3d-bd9fb35dda57 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-2ce3df1d-107d-4fd0-9443-d143cd17dfe5 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:52:33 user nova-compute[74039]: WARNING nova.compute.manager [req-c59b5680-9ddb-42da-a0d8-e11fe6179784 req-68af1cad-be61-4e53-9d3d-bd9fb35dda57 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-2ce3df1d-107d-4fd0-9443-d143cd17dfe5 for instance with vm_state building and task_state spawning.
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.compute.manager [req-c59b5680-9ddb-42da-a0d8-e11fe6179784 req-68af1cad-be61-4e53-9d3d-bd9fb35dda57 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-2ce3df1d-107d-4fd0-9443-d143cd17dfe5 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c59b5680-9ddb-42da-a0d8-e11fe6179784 req-68af1cad-be61-4e53-9d3d-bd9fb35dda57 service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c59b5680-9ddb-42da-a0d8-e11fe6179784 req-68af1cad-be61-4e53-9d3d-bd9fb35dda57 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c59b5680-9ddb-42da-a0d8-e11fe6179784 req-68af1cad-be61-4e53-9d3d-bd9fb35dda57 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.compute.manager [req-c59b5680-9ddb-42da-a0d8-e11fe6179784 req-68af1cad-be61-4e53-9d3d-bd9fb35dda57 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-2ce3df1d-107d-4fd0-9443-d143cd17dfe5 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:52:33 user nova-compute[74039]: WARNING nova.compute.manager [req-c59b5680-9ddb-42da-a0d8-e11fe6179784 req-68af1cad-be61-4e53-9d3d-bd9fb35dda57 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-2ce3df1d-107d-4fd0-9443-d143cd17dfe5 for instance with vm_state building and task_state spawning.
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.compute.manager [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:52:33 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Instance spawned successfully.
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:52:33 user nova-compute[74039]: INFO nova.compute.manager [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Took 11.40 seconds to spawn the instance on the hypervisor.
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.compute.manager [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquiring lock "refresh_cache-365da377-4031-4e1b-bc85-6dcaf721548e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquired lock "refresh_cache-365da377-4031-4e1b-bc85-6dcaf721548e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.network.neutron [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:52:33 user nova-compute[74039]: INFO nova.compute.manager [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Took 73.01 seconds to build instance.
Oct 20 08:52:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-94f9cc35-beff-453d-b561-1428a786c045 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 73.123s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.compute.manager [req-0091da88-5dcb-4a46-bead-d6c6def7d7ad req-943ffd9d-0cee-4b2b-b7ad-089eaed27072 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received event network-vif-deleted-dd29358a-8456-4b27-8a8c-38206751a25c {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:52:33 user nova-compute[74039]: INFO nova.compute.manager [req-0091da88-5dcb-4a46-bead-d6c6def7d7ad req-943ffd9d-0cee-4b2b-b7ad-089eaed27072 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Neutron deleted interface dd29358a-8456-4b27-8a8c-38206751a25c; detaching it from the instance and deleting it from the info cache
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.network.neutron [req-0091da88-5dcb-4a46-bead-d6c6def7d7ad req-943ffd9d-0cee-4b2b-b7ad-089eaed27072 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Updating instance_info_cache with network_info: [{"id": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "address": "fa:16:3e:8e:e7:14", "network": {"id": "48788255-d08e-4361-9b44-b6554c28bc6b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-33959125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c246ad5-f4", "ovs_interfaceid": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.objects.instance [req-0091da88-5dcb-4a46-bead-d6c6def7d7ad req-943ffd9d-0cee-4b2b-b7ad-089eaed27072 service nova] Lazy-loading 'system_metadata' on Instance uuid 365da377-4031-4e1b-bc85-6dcaf721548e {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.objects.instance [req-0091da88-5dcb-4a46-bead-d6c6def7d7ad req-943ffd9d-0cee-4b2b-b7ad-089eaed27072 service nova] Lazy-loading 'flavor' on Instance uuid 365da377-4031-4e1b-bc85-6dcaf721548e {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.objects.base [req-0091da88-5dcb-4a46-bead-d6c6def7d7ad req-943ffd9d-0cee-4b2b-b7ad-089eaed27072 service nova] Object Instance<365da377-4031-4e1b-bc85-6dcaf721548e> lazy-loaded attributes: system_metadata,flavor {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [req-0091da88-5dcb-4a46-bead-d6c6def7d7ad req-943ffd9d-0cee-4b2b-b7ad-089eaed27072 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:48:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2124112502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2124112502',id=8,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADEixoB6QWWhTLuwL+7Z2fkKKWHkyf3tVdnf4752CWzbdJ5lz/PbSjwRzike1kbeQLqKQLtsajre3rrJlFKfvXx6m1o9pCXfJmA6Y4TeaBnPAeS7YpGXhczqHT/lsYEnw==',key_name='tempest-keypair-1295832388',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:49:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40f437448d494f75838a2c7b2b6a973f',ramdisk_id='',reservation_id='r-d06qmgd5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-92531413',owner_user_name='tempest-TaggedAttachmentsTest-92531413-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:49:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29ca829a96484751876ead6f2b094e54',uuid=365da377-4031-4e1b-bc85-6dcaf721548e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd29358a-8456-4b27-8a8c-38206751a25c", "address": "fa:16:3e:60:45:3e", "network": {"id": "3774a21d-147a-442f-a2c8-b94306649d95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-954620919", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29358a-84", "ovs_interfaceid": "dd29358a-8456-4b27-8a8c-38206751a25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.network.os_vif_util [req-0091da88-5dcb-4a46-bead-d6c6def7d7ad req-943ffd9d-0cee-4b2b-b7ad-089eaed27072 service nova] Converting VIF {"id": "dd29358a-8456-4b27-8a8c-38206751a25c", "address": "fa:16:3e:60:45:3e", "network": {"id": "3774a21d-147a-442f-a2c8-b94306649d95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-954620919", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29358a-84", "ovs_interfaceid": "dd29358a-8456-4b27-8a8c-38206751a25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.network.os_vif_util [req-0091da88-5dcb-4a46-bead-d6c6def7d7ad req-943ffd9d-0cee-4b2b-b7ad-089eaed27072 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:45:3e,bridge_name='br-int',has_traffic_filtering=True,id=dd29358a-8456-4b27-8a8c-38206751a25c,network=Network(3774a21d-147a-442f-a2c8-b94306649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd29358a-84') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [req-0091da88-5dcb-4a46-bead-d6c6def7d7ad req-943ffd9d-0cee-4b2b-b7ad-089eaed27072 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:60:45:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tapdd29358a-84"/></interface> {{(pid=74039) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [req-0091da88-5dcb-4a46-bead-d6c6def7d7ad req-943ffd9d-0cee-4b2b-b7ad-089eaed27072 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:60:45:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tapdd29358a-84"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 20 08:52:33 user nova-compute[74039]:   <name>instance-00000008</name>
Oct 20 08:52:33 user nova-compute[74039]:   <uuid>365da377-4031-4e1b-bc85-6dcaf721548e</uuid>
Oct 20 08:52:33 user nova-compute[74039]:   <metadata>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:52:33 user nova-compute[74039]:   <nova:package version="0.0.0"/>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:name>tempest-device-tagging-server-2124112502</nova:name>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:creationTime>2023-10-20 08:52:33</nova:creationTime>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:flavor name="m1.tiny">
Oct 20 08:52:33 user nova-compute[74039]:     <nova:memory>512</nova:memory>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:disk>1</nova:disk>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:swap>0</nova:swap>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:vcpus>1</nova:vcpus>
Oct 20 08:52:33 user nova-compute[74039]:   </nova:flavor>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:owner>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:user uuid="29ca829a96484751876ead6f2b094e54">tempest-TaggedAttachmentsTest-92531413-project-member</nova:user>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:project uuid="40f437448d494f75838a2c7b2b6a973f">tempest-TaggedAttachmentsTest-92531413</nova:project>
Oct 20 08:52:33 user nova-compute[74039]:   </nova:owner>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:ports>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:port uuid="8c246ad5-f489-4486-b930-9d4a1cb60c41">
Oct 20 08:52:33 user nova-compute[74039]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 08:52:33 user nova-compute[74039]:     </nova:port>
Oct 20 08:52:33 user nova-compute[74039]:   </nova:ports>
Oct 20 08:52:33 user nova-compute[74039]: </nova:instance>
Oct 20 08:52:33 user nova-compute[74039]:   </metadata>
Oct 20 08:52:33 user nova-compute[74039]:   <memory unit='KiB'>524288</memory>
Oct 20 08:52:33 user nova-compute[74039]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 08:52:33 user nova-compute[74039]:   <vcpu placement='static'>1</vcpu>
Oct 20 08:52:33 user nova-compute[74039]:   <resource>
Oct 20 08:52:33 user nova-compute[74039]:     <partition>/machine</partition>
Oct 20 08:52:33 user nova-compute[74039]:   </resource>
Oct 20 08:52:33 user nova-compute[74039]:   <sysinfo type='smbios'>
Oct 20 08:52:33 user nova-compute[74039]:     <system>
Oct 20 08:52:33 user nova-compute[74039]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 08:52:33 user nova-compute[74039]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 08:52:33 user nova-compute[74039]:       <entry name='version'>0.0.0</entry>
Oct 20 08:52:33 user nova-compute[74039]:       <entry name='serial'>365da377-4031-4e1b-bc85-6dcaf721548e</entry>
Oct 20 08:52:33 user nova-compute[74039]:       <entry name='uuid'>365da377-4031-4e1b-bc85-6dcaf721548e</entry>
Oct 20 08:52:33 user nova-compute[74039]:       <entry name='family'>Virtual Machine</entry>
Oct 20 08:52:33 user nova-compute[74039]:     </system>
Oct 20 08:52:33 user nova-compute[74039]:   </sysinfo>
Oct 20 08:52:33 user nova-compute[74039]:   <os>
Oct 20 08:52:33 user nova-compute[74039]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 08:52:33 user nova-compute[74039]:     <boot dev='hd'/>
Oct 20 08:52:33 user nova-compute[74039]:     <smbios mode='sysinfo'/>
Oct 20 08:52:33 user nova-compute[74039]:   </os>
Oct 20 08:52:33 user nova-compute[74039]:   <features>
Oct 20 08:52:33 user nova-compute[74039]:     <acpi/>
Oct 20 08:52:33 user nova-compute[74039]:     <apic/>
Oct 20 08:52:33 user nova-compute[74039]:     <vmcoreinfo state='on'/>
Oct 20 08:52:33 user nova-compute[74039]:   </features>
Oct 20 08:52:33 user nova-compute[74039]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 08:52:33 user nova-compute[74039]:     <model fallback='forbid'>Nehalem</model>
Oct 20 08:52:33 user nova-compute[74039]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 08:52:33 user nova-compute[74039]:     <feature policy='require' name='vme'/>
Oct 20 08:52:33 user nova-compute[74039]:     <feature policy='require' name='x2apic'/>
Oct 20 08:52:33 user nova-compute[74039]:     <feature policy='require' name='hypervisor'/>
Oct 20 08:52:33 user nova-compute[74039]:   </cpu>
Oct 20 08:52:33 user nova-compute[74039]:   <clock offset='utc'>
Oct 20 08:52:33 user nova-compute[74039]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 08:52:33 user nova-compute[74039]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 08:52:33 user nova-compute[74039]:     <timer name='hpet' present='no'/>
Oct 20 08:52:33 user nova-compute[74039]:   </clock>
Oct 20 08:52:33 user nova-compute[74039]:   <on_poweroff>destroy</on_poweroff>
Oct 20 08:52:33 user nova-compute[74039]:   <on_reboot>restart</on_reboot>
Oct 20 08:52:33 user nova-compute[74039]:   <on_crash>destroy</on_crash>
Oct 20 08:52:33 user nova-compute[74039]:   <devices>
Oct 20 08:52:33 user nova-compute[74039]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 08:52:33 user nova-compute[74039]:     <disk type='file' device='disk'>
Oct 20 08:52:33 user nova-compute[74039]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 08:52:33 user nova-compute[74039]:       <source file='/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk' index='2'/>
Oct 20 08:52:33 user nova-compute[74039]:       <backingStore type='file' index='3'>
Oct 20 08:52:33 user nova-compute[74039]:         <format type='raw'/>
Oct 20 08:52:33 user nova-compute[74039]:         <source file='/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258'/>
Oct 20 08:52:33 user nova-compute[74039]:         <backingStore/>
Oct 20 08:52:33 user nova-compute[74039]:       </backingStore>
Oct 20 08:52:33 user nova-compute[74039]:       <target dev='vda' bus='virtio'/>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='virtio-disk0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </disk>
Oct 20 08:52:33 user nova-compute[74039]:     <disk type='file' device='cdrom'>
Oct 20 08:52:33 user nova-compute[74039]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 08:52:33 user nova-compute[74039]:       <source file='/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk.config' index='1'/>
Oct 20 08:52:33 user nova-compute[74039]:       <backingStore/>
Oct 20 08:52:33 user nova-compute[74039]:       <target dev='hda' bus='ide'/>
Oct 20 08:52:33 user nova-compute[74039]:       <readonly/>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='ide0-0-0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </disk>
Oct 20 08:52:33 user nova-compute[74039]:     <controller type='usb' index='0' model='none'>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='usb'/>
Oct 20 08:52:33 user nova-compute[74039]:     </controller>
Oct 20 08:52:33 user nova-compute[74039]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='pci.0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </controller>
Oct 20 08:52:33 user nova-compute[74039]:     <controller type='ide' index='0'>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='ide'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 08:52:33 user nova-compute[74039]:     </controller>
Oct 20 08:52:33 user nova-compute[74039]:     <interface type='ethernet'>
Oct 20 08:52:33 user nova-compute[74039]:       <mac address='fa:16:3e:8e:e7:14'/>
Oct 20 08:52:33 user nova-compute[74039]:       <target dev='tap8c246ad5-f4'/>
Oct 20 08:52:33 user nova-compute[74039]:       <model type='virtio'/>
Oct 20 08:52:33 user nova-compute[74039]:       <mtu size='1442'/>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='net0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </interface>
Oct 20 08:52:33 user nova-compute[74039]:     <serial type='pty'>
Oct 20 08:52:33 user nova-compute[74039]:       <source path='/dev/pts/7'/>
Oct 20 08:52:33 user nova-compute[74039]:       <log file='/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/console.log' append='off'/>
Oct 20 08:52:33 user nova-compute[74039]:       <target type='isa-serial' port='0'>
Oct 20 08:52:33 user nova-compute[74039]:         <model name='isa-serial'/>
Oct 20 08:52:33 user nova-compute[74039]:       </target>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='serial0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </serial>
Oct 20 08:52:33 user nova-compute[74039]:     <console type='pty' tty='/dev/pts/7'>
Oct 20 08:52:33 user nova-compute[74039]:       <source path='/dev/pts/7'/>
Oct 20 08:52:33 user nova-compute[74039]:       <log file='/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/console.log' append='off'/>
Oct 20 08:52:33 user nova-compute[74039]:       <target type='serial' port='0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='serial0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </console>
Oct 20 08:52:33 user nova-compute[74039]:     <input type='mouse' bus='ps2'>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='input0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </input>
Oct 20 08:52:33 user nova-compute[74039]:     <input type='keyboard' bus='ps2'>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='input1'/>
Oct 20 08:52:33 user nova-compute[74039]:     </input>
Oct 20 08:52:33 user nova-compute[74039]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 20 08:52:33 user nova-compute[74039]:       <listen type='address' address='0.0.0.0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </graphics>
Oct 20 08:52:33 user nova-compute[74039]:     <audio id='1' type='none'/>
Oct 20 08:52:33 user nova-compute[74039]:     <video>
Oct 20 08:52:33 user nova-compute[74039]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='video0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </video>
Oct 20 08:52:33 user nova-compute[74039]:     <memballoon model='virtio'>
Oct 20 08:52:33 user nova-compute[74039]:       <stats period='10'/>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='balloon0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </memballoon>
Oct 20 08:52:33 user nova-compute[74039]:     <rng model='virtio'>
Oct 20 08:52:33 user nova-compute[74039]:       <backend model='random'>/dev/urandom</backend>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='rng0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </rng>
Oct 20 08:52:33 user nova-compute[74039]:   </devices>
Oct 20 08:52:33 user nova-compute[74039]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 08:52:33 user nova-compute[74039]:     <label>libvirt-365da377-4031-4e1b-bc85-6dcaf721548e</label>
Oct 20 08:52:33 user nova-compute[74039]:     <imagelabel>libvirt-365da377-4031-4e1b-bc85-6dcaf721548e</imagelabel>
Oct 20 08:52:33 user nova-compute[74039]:   </seclabel>
Oct 20 08:52:33 user nova-compute[74039]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 08:52:33 user nova-compute[74039]:     <label>+64055:+108</label>
Oct 20 08:52:33 user nova-compute[74039]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 08:52:33 user nova-compute[74039]:   </seclabel>
Oct 20 08:52:33 user nova-compute[74039]: </domain>
Oct 20 08:52:33 user nova-compute[74039]:  {{(pid=74039) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [req-0091da88-5dcb-4a46-bead-d6c6def7d7ad req-943ffd9d-0cee-4b2b-b7ad-089eaed27072 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:60:45:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tapdd29358a-84"/></interface> {{(pid=74039) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 08:52:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [req-0091da88-5dcb-4a46-bead-d6c6def7d7ad req-943ffd9d-0cee-4b2b-b7ad-089eaed27072 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:60:45:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tapdd29358a-84"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 20 08:52:33 user nova-compute[74039]:   <name>instance-00000008</name>
Oct 20 08:52:33 user nova-compute[74039]:   <uuid>365da377-4031-4e1b-bc85-6dcaf721548e</uuid>
Oct 20 08:52:33 user nova-compute[74039]:   <metadata>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:52:33 user nova-compute[74039]:   <nova:package version="0.0.0"/>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:name>tempest-device-tagging-server-2124112502</nova:name>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:creationTime>2023-10-20 08:52:33</nova:creationTime>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:flavor name="m1.tiny">
Oct 20 08:52:33 user nova-compute[74039]:     <nova:memory>512</nova:memory>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:disk>1</nova:disk>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:swap>0</nova:swap>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:vcpus>1</nova:vcpus>
Oct 20 08:52:33 user nova-compute[74039]:   </nova:flavor>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:owner>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:user uuid="29ca829a96484751876ead6f2b094e54">tempest-TaggedAttachmentsTest-92531413-project-member</nova:user>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:project uuid="40f437448d494f75838a2c7b2b6a973f">tempest-TaggedAttachmentsTest-92531413</nova:project>
Oct 20 08:52:33 user nova-compute[74039]:   </nova:owner>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:52:33 user nova-compute[74039]:   <nova:ports>
Oct 20 08:52:33 user nova-compute[74039]:     <nova:port uuid="8c246ad5-f489-4486-b930-9d4a1cb60c41">
Oct 20 08:52:33 user nova-compute[74039]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 08:52:33 user nova-compute[74039]:     </nova:port>
Oct 20 08:52:33 user nova-compute[74039]:   </nova:ports>
Oct 20 08:52:33 user nova-compute[74039]: </nova:instance>
Oct 20 08:52:33 user nova-compute[74039]:   </metadata>
Oct 20 08:52:33 user nova-compute[74039]:   <memory unit='KiB'>524288</memory>
Oct 20 08:52:33 user nova-compute[74039]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 08:52:33 user nova-compute[74039]:   <vcpu placement='static'>1</vcpu>
Oct 20 08:52:33 user nova-compute[74039]:   <resource>
Oct 20 08:52:33 user nova-compute[74039]:     <partition>/machine</partition>
Oct 20 08:52:33 user nova-compute[74039]:   </resource>
Oct 20 08:52:33 user nova-compute[74039]:   <sysinfo type='smbios'>
Oct 20 08:52:33 user nova-compute[74039]:     <system>
Oct 20 08:52:33 user nova-compute[74039]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 08:52:33 user nova-compute[74039]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 08:52:33 user nova-compute[74039]:       <entry name='version'>0.0.0</entry>
Oct 20 08:52:33 user nova-compute[74039]:       <entry name='serial'>365da377-4031-4e1b-bc85-6dcaf721548e</entry>
Oct 20 08:52:33 user nova-compute[74039]:       <entry name='uuid'>365da377-4031-4e1b-bc85-6dcaf721548e</entry>
Oct 20 08:52:33 user nova-compute[74039]:       <entry name='family'>Virtual Machine</entry>
Oct 20 08:52:33 user nova-compute[74039]:     </system>
Oct 20 08:52:33 user nova-compute[74039]:   </sysinfo>
Oct 20 08:52:33 user nova-compute[74039]:   <os>
Oct 20 08:52:33 user nova-compute[74039]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 08:52:33 user nova-compute[74039]:     <boot dev='hd'/>
Oct 20 08:52:33 user nova-compute[74039]:     <smbios mode='sysinfo'/>
Oct 20 08:52:33 user nova-compute[74039]:   </os>
Oct 20 08:52:33 user nova-compute[74039]:   <features>
Oct 20 08:52:33 user nova-compute[74039]:     <acpi/>
Oct 20 08:52:33 user nova-compute[74039]:     <apic/>
Oct 20 08:52:33 user nova-compute[74039]:     <vmcoreinfo state='on'/>
Oct 20 08:52:33 user nova-compute[74039]:   </features>
Oct 20 08:52:33 user nova-compute[74039]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 08:52:33 user nova-compute[74039]:     <model fallback='forbid'>Nehalem</model>
Oct 20 08:52:33 user nova-compute[74039]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 08:52:33 user nova-compute[74039]:     <feature policy='require' name='vme'/>
Oct 20 08:52:33 user nova-compute[74039]:     <feature policy='require' name='x2apic'/>
Oct 20 08:52:33 user nova-compute[74039]:     <feature policy='require' name='hypervisor'/>
Oct 20 08:52:33 user nova-compute[74039]:   </cpu>
Oct 20 08:52:33 user nova-compute[74039]:   <clock offset='utc'>
Oct 20 08:52:33 user nova-compute[74039]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 08:52:33 user nova-compute[74039]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 08:52:33 user nova-compute[74039]:     <timer name='hpet' present='no'/>
Oct 20 08:52:33 user nova-compute[74039]:   </clock>
Oct 20 08:52:33 user nova-compute[74039]:   <on_poweroff>destroy</on_poweroff>
Oct 20 08:52:33 user nova-compute[74039]:   <on_reboot>restart</on_reboot>
Oct 20 08:52:33 user nova-compute[74039]:   <on_crash>destroy</on_crash>
Oct 20 08:52:33 user nova-compute[74039]:   <devices>
Oct 20 08:52:33 user nova-compute[74039]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 08:52:33 user nova-compute[74039]:     <disk type='file' device='disk'>
Oct 20 08:52:33 user nova-compute[74039]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 08:52:33 user nova-compute[74039]:       <source file='/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk' index='2'/>
Oct 20 08:52:33 user nova-compute[74039]:       <backingStore type='file' index='3'>
Oct 20 08:52:33 user nova-compute[74039]:         <format type='raw'/>
Oct 20 08:52:33 user nova-compute[74039]:         <source file='/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258'/>
Oct 20 08:52:33 user nova-compute[74039]:         <backingStore/>
Oct 20 08:52:33 user nova-compute[74039]:       </backingStore>
Oct 20 08:52:33 user nova-compute[74039]:       <target dev='vda' bus='virtio'/>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='virtio-disk0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </disk>
Oct 20 08:52:33 user nova-compute[74039]:     <disk type='file' device='cdrom'>
Oct 20 08:52:33 user nova-compute[74039]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 08:52:33 user nova-compute[74039]:       <source file='/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/disk.config' index='1'/>
Oct 20 08:52:33 user nova-compute[74039]:       <backingStore/>
Oct 20 08:52:33 user nova-compute[74039]:       <target dev='hda' bus='ide'/>
Oct 20 08:52:33 user nova-compute[74039]:       <readonly/>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='ide0-0-0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </disk>
Oct 20 08:52:33 user nova-compute[74039]:     <controller type='usb' index='0' model='none'>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='usb'/>
Oct 20 08:52:33 user nova-compute[74039]:     </controller>
Oct 20 08:52:33 user nova-compute[74039]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='pci.0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </controller>
Oct 20 08:52:33 user nova-compute[74039]:     <controller type='ide' index='0'>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='ide'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 08:52:33 user nova-compute[74039]:     </controller>
Oct 20 08:52:33 user nova-compute[74039]:     <interface type='ethernet'>
Oct 20 08:52:33 user nova-compute[74039]:       <mac address='fa:16:3e:8e:e7:14'/>
Oct 20 08:52:33 user nova-compute[74039]:       <target dev='tap8c246ad5-f4'/>
Oct 20 08:52:33 user nova-compute[74039]:       <model type='virtio'/>
Oct 20 08:52:33 user nova-compute[74039]:       <mtu size='1442'/>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='net0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </interface>
Oct 20 08:52:33 user nova-compute[74039]:     <serial type='pty'>
Oct 20 08:52:33 user nova-compute[74039]:       <source path='/dev/pts/7'/>
Oct 20 08:52:33 user nova-compute[74039]:       <log file='/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/console.log' append='off'/>
Oct 20 08:52:33 user nova-compute[74039]:       <target type='isa-serial' port='0'>
Oct 20 08:52:33 user nova-compute[74039]:         <model name='isa-serial'/>
Oct 20 08:52:33 user nova-compute[74039]:       </target>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='serial0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </serial>
Oct 20 08:52:33 user nova-compute[74039]:     <console type='pty' tty='/dev/pts/7'>
Oct 20 08:52:33 user nova-compute[74039]:       <source path='/dev/pts/7'/>
Oct 20 08:52:33 user nova-compute[74039]:       <log file='/opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e/console.log' append='off'/>
Oct 20 08:52:33 user nova-compute[74039]:       <target type='serial' port='0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='serial0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </console>
Oct 20 08:52:33 user nova-compute[74039]:     <input type='mouse' bus='ps2'>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='input0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </input>
Oct 20 08:52:33 user nova-compute[74039]:     <input type='keyboard' bus='ps2'>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='input1'/>
Oct 20 08:52:33 user nova-compute[74039]:     </input>
Oct 20 08:52:33 user nova-compute[74039]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 20 08:52:33 user nova-compute[74039]:       <listen type='address' address='0.0.0.0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </graphics>
Oct 20 08:52:33 user nova-compute[74039]:     <audio id='1' type='none'/>
Oct 20 08:52:33 user nova-compute[74039]:     <video>
Oct 20 08:52:33 user nova-compute[74039]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='video0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </video>
Oct 20 08:52:33 user nova-compute[74039]:     <memballoon model='virtio'>
Oct 20 08:52:33 user nova-compute[74039]:       <stats period='10'/>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='balloon0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </memballoon>
Oct 20 08:52:33 user nova-compute[74039]:     <rng model='virtio'>
Oct 20 08:52:33 user nova-compute[74039]:       <backend model='random'>/dev/urandom</backend>
Oct 20 08:52:33 user nova-compute[74039]:       <alias name='rng0'/>
Oct 20 08:52:33 user nova-compute[74039]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 08:52:33 user nova-compute[74039]:     </rng>
Oct 20 08:52:33 user nova-compute[74039]:   </devices>
Oct 20 08:52:33 user nova-compute[74039]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 08:52:33 user nova-compute[74039]:     <label>libvirt-365da377-4031-4e1b-bc85-6dcaf721548e</label>
Oct 20 08:52:33 user nova-compute[74039]:     <imagelabel>libvirt-365da377-4031-4e1b-bc85-6dcaf721548e</imagelabel>
Oct 20 08:52:33 user nova-compute[74039]:   </seclabel>
Oct 20 08:52:33 user nova-compute[74039]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 08:52:33 user nova-compute[74039]:     <label>+64055:+108</label>
Oct 20 08:52:33 user nova-compute[74039]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 08:52:33 user nova-compute[74039]:   </seclabel>
Oct 20 08:52:33 user nova-compute[74039]: </domain>
Oct 20 08:52:33 user nova-compute[74039]:  {{(pid=74039) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 08:52:34 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [req-0091da88-5dcb-4a46-bead-d6c6def7d7ad req-943ffd9d-0cee-4b2b-b7ad-089eaed27072 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Detaching interface fa:16:3e:60:45:3e failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapdd29358a-84' not found.
Oct 20 08:52:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [req-0091da88-5dcb-4a46-bead-d6c6def7d7ad req-943ffd9d-0cee-4b2b-b7ad-089eaed27072 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:48:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2124112502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2124112502',id=8,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADEixoB6QWWhTLuwL+7Z2fkKKWHkyf3tVdnf4752CWzbdJ5lz/PbSjwRzike1kbeQLqKQLtsajre3rrJlFKfvXx6m1o9pCXfJmA6Y4TeaBnPAeS7YpGXhczqHT/lsYEnw==',key_name='tempest-keypair-1295832388',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:49:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40f437448d494f75838a2c7b2b6a973f',ramdisk_id='',reservation_id='r-d06qmgd5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-92531413',owner_user_name='tempest-TaggedAttachmentsTest-92531413-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:49:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29ca829a96484751876ead6f2b094e54',uuid=365da377-4031-4e1b-bc85-6dcaf721548e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd29358a-8456-4b27-8a8c-38206751a25c", "address": "fa:16:3e:60:45:3e", "network": {"id": "3774a21d-147a-442f-a2c8-b94306649d95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-954620919", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29358a-84", "ovs_interfaceid": "dd29358a-8456-4b27-8a8c-38206751a25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:52:34 user nova-compute[74039]: DEBUG nova.network.os_vif_util [req-0091da88-5dcb-4a46-bead-d6c6def7d7ad req-943ffd9d-0cee-4b2b-b7ad-089eaed27072 service nova] Converting VIF {"id": "dd29358a-8456-4b27-8a8c-38206751a25c", "address": "fa:16:3e:60:45:3e", "network": {"id": "3774a21d-147a-442f-a2c8-b94306649d95", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-954620919", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29358a-84", "ovs_interfaceid": "dd29358a-8456-4b27-8a8c-38206751a25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:52:34 user nova-compute[74039]: DEBUG nova.network.os_vif_util [req-0091da88-5dcb-4a46-bead-d6c6def7d7ad req-943ffd9d-0cee-4b2b-b7ad-089eaed27072 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:45:3e,bridge_name='br-int',has_traffic_filtering=True,id=dd29358a-8456-4b27-8a8c-38206751a25c,network=Network(3774a21d-147a-442f-a2c8-b94306649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd29358a-84') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:52:34 user nova-compute[74039]: DEBUG os_vif [req-0091da88-5dcb-4a46-bead-d6c6def7d7ad req-943ffd9d-0cee-4b2b-b7ad-089eaed27072 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:45:3e,bridge_name='br-int',has_traffic_filtering=True,id=dd29358a-8456-4b27-8a8c-38206751a25c,network=Network(3774a21d-147a-442f-a2c8-b94306649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd29358a-84') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:52:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd29358a-84, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:52:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:52:34 user nova-compute[74039]: INFO os_vif [req-0091da88-5dcb-4a46-bead-d6c6def7d7ad req-943ffd9d-0cee-4b2b-b7ad-089eaed27072 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:45:3e,bridge_name='br-int',has_traffic_filtering=True,id=dd29358a-8456-4b27-8a8c-38206751a25c,network=Network(3774a21d-147a-442f-a2c8-b94306649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd29358a-84')
Oct 20 08:52:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [req-0091da88-5dcb-4a46-bead-d6c6def7d7ad req-943ffd9d-0cee-4b2b-b7ad-089eaed27072 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:52:34 user nova-compute[74039]:   <nova:package version="0.0.0"/>
Oct 20 08:52:34 user nova-compute[74039]:   <nova:name>tempest-device-tagging-server-2124112502</nova:name>
Oct 20 08:52:34 user nova-compute[74039]:   <nova:creationTime>2023-10-20 08:52:34</nova:creationTime>
Oct 20 08:52:34 user nova-compute[74039]:   <nova:flavor name="m1.tiny">
Oct 20 08:52:34 user nova-compute[74039]:     <nova:memory>512</nova:memory>
Oct 20 08:52:34 user nova-compute[74039]:     <nova:disk>1</nova:disk>
Oct 20 08:52:34 user nova-compute[74039]:     <nova:swap>0</nova:swap>
Oct 20 08:52:34 user nova-compute[74039]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:52:34 user nova-compute[74039]:     <nova:vcpus>1</nova:vcpus>
Oct 20 08:52:34 user nova-compute[74039]:   </nova:flavor>
Oct 20 08:52:34 user nova-compute[74039]:   <nova:owner>
Oct 20 08:52:34 user nova-compute[74039]:     <nova:user uuid="29ca829a96484751876ead6f2b094e54">tempest-TaggedAttachmentsTest-92531413-project-member</nova:user>
Oct 20 08:52:34 user nova-compute[74039]:     <nova:project uuid="40f437448d494f75838a2c7b2b6a973f">tempest-TaggedAttachmentsTest-92531413</nova:project>
Oct 20 08:52:34 user nova-compute[74039]:   </nova:owner>
Oct 20 08:52:34 user nova-compute[74039]:   <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:52:34 user nova-compute[74039]:   <nova:ports>
Oct 20 08:52:34 user nova-compute[74039]:     <nova:port uuid="8c246ad5-f489-4486-b930-9d4a1cb60c41">
Oct 20 08:52:34 user nova-compute[74039]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 08:52:34 user nova-compute[74039]:     </nova:port>
Oct 20 08:52:34 user nova-compute[74039]:   </nova:ports>
Oct 20 08:52:34 user nova-compute[74039]: </nova:instance>
Oct 20 08:52:34 user nova-compute[74039]:  {{(pid=74039) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 08:52:34 user nova-compute[74039]: INFO nova.network.neutron [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Port dd29358a-8456-4b27-8a8c-38206751a25c from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Oct 20 08:52:34 user nova-compute[74039]: DEBUG nova.network.neutron [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Updating instance_info_cache with network_info: [{"id": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "address": "fa:16:3e:8e:e7:14", "network": {"id": "48788255-d08e-4361-9b44-b6554c28bc6b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-33959125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c246ad5-f4", "ovs_interfaceid": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:52:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Releasing lock "refresh_cache-365da377-4031-4e1b-bc85-6dcaf721548e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:52:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5f480d24-a773-424b-b9a9-e1dbde296bf1 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "interface-365da377-4031-4e1b-bc85-6dcaf721548e-dd29358a-8456-4b27-8a8c-38206751a25c" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.640s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG nova.compute.manager [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bfjyqgCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '500a0ed6-ac37-4274-a8f2-2545c270e24b', 'attached_at': '', 'detached_at': '', 'volume_id': 'e60bbfa7-eab8-4fc5-a82e-16fbe709c040', 'serial': 'e60bbfa7-eab8-4fc5-a82e-16fbe709c040'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jEvGqJnK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '29263da0-2ddd-416e-98a9-52e451abff13'}, 'status': 'reserved', 'instance': '500a0ed6-ac37-4274-a8f2-2545c270e24b', 'attached_at': '', 'detached_at': '', 'volume_id': '29263da0-2ddd-416e-98a9-52e451abff13', 'serial'} {{(pid=74039) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bfjyqgCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:52:42 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:52:42 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:52:42 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35e318b-db8d-4cb8-8e1c-f989dfa4d969]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 08:52:42 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e67864-e585-4c58-a44c-17da21da09ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040] added
Oct 20 08:52:42 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f195162e-b7e9-4d00-a0bc-88a6164cda32]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc72860-ab64-4e75-89e5-c1580a93cec0]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bfjyqgCi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bfjyqgCi" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b591d824-276b-47a0-af35-5f86de3c237c]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bfjyqgCi'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe4d353-b152-4011-b6c3-8673e419f38c]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be49767-19e5-4b77-8ed9-b06dd7c06a0c]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:42 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:52:42 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:52:42 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:52:42 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:42 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:52:42 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:52:42 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:52:42 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8c2641-d4ec-4c81-846b-159fac7e3703]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040, portal: 172.16.0.220,3260]
Oct 20 08:52:42 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040, portal: 172.16.0.220,3260] successful.
Oct 20 08:52:42 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[42632b17-5695-44d1-a299-798eb3593e7a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e4e610-9b68-4e23-b93a-6cfbb559f311]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:52:42 user nova-compute[74039]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:42 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:52:42 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:52:42 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:52:42 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:52:42 user nova-compute[74039]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:42 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:52:42 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:52:42 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:52:42 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3892aa4c-7494-4490-b909-f8ffb68fb6e7]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bfjyqgCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 08:52:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:43 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:52:43 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26266633734306262', 'path': '/dev/sdf'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:52:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266633734306262', 'path': '/dev/sdf'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 08:52:43 user nova-compute[74039]: DEBUG nova.objects.instance [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Lazy-loading 'flavor' on Instance uuid 500a0ed6-ac37-4274-a8f2-2545c270e24b {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:52:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:52:44 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 123731968 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:52:44 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 242221056 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:52:45 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 389021696 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:52:45 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 515899392 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:52:46 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 644874240 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:52:46 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 811597824 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:52:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 960495616 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:52:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 962592768 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:52:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 962592768 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:52:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 962592768 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:52:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 999292928 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jEvGqJnK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '29263da0-2ddd-416e-98a9-52e451abff13'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:52:50 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:52:50 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[478311b4-0c65-44b1-86e1-9213d176169b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 08:52:50 user nova-compute[74039]: No targets found.
Oct 20 08:52:50 user nova-compute[74039]: iSNS:
Oct 20 08:52:50 user nova-compute[74039]: No targets found.
Oct 20 08:52:50 user nova-compute[74039]: STATIC:
Oct 20 08:52:50 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040
Oct 20 08:52:50 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:52:50 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:52:50 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf
Oct 20 08:52:50 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:52:50 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:52:50 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d
Oct 20 08:52:50 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:52:50 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:52:50 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13
Oct 20 08:52:50 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:52:50 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:52:50 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9
Oct 20 08:52:50 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:52:50 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:52:50 user nova-compute[74039]: FIRMWARE:
Oct 20 08:52:50 user nova-compute[74039]: No targets found.
Oct 20 08:52:50 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 08:52:50 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 08:52:50 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63641b7-851b-46f4-ae53-08955c35865d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2e9a5d-3f84-4cc0-9fe1-0c3e43d8920b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:52:50 user nova-compute[74039]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:50 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:52:50 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:52:50 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:52:50 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:52:50 user nova-compute[74039]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 (non-flash)
Oct 20 08:52:50 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:52:50 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:52:50 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:52:50 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae841ec040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13'): ({'sdb'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Removing single pathed devices sdb {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f0da29-11dc-4c75-9fc3-9b930a21f29e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d6f6fc-437c-4430-9680-bc99fa787c43]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Flushing IO for device /dev/sdb {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[506f93a4-cef0-4bd8-9563-632abc4ee315]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9a6702-dc18-4f2b-aae4-e4826393ce59]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e741037-5562-482b-861e-fbadf9d351c4]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[76389399-d4ac-488d-993e-c73fe4db0c84]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13, portal: 172.16.0.220,3260]
Oct 20 08:52:50 user nova-compute[74039]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13, portal: 172.16.0.220,3260] successful.
Oct 20 08:52:50 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29263da0-2ddd-416e-98a9-52e451abff13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae6aef1-0381-4516-8b98-e753a7ddfc75]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] <== disconnect_volume: return (358ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG nova.compute.manager [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bfjyqgCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '500a0ed6-ac37-4274-a8f2-2545c270e24b', 'attached_at': '', 'detached_at': '', 'volume_id': 'e60bbfa7-eab8-4fc5-a82e-16fbe709c040', 'serial'} {{(pid=74039) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 20 08:52:50 user nova-compute[74039]: DEBUG nova.compute.manager [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] swap_volume: removing Cinder connection for volume 29263da0-2ddd-416e-98a9-52e451abff13 {{(pid=74039) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 20 08:52:51 user nova-compute[74039]: DEBUG nova.compute.manager [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] swap_volume: Updating volume 29263da0-2ddd-416e-98a9-52e451abff13 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "bfjyqgCi", "auth_password": "7vhA4VYS6MuaBy", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "e60bbfa7-eab8-4fc5-a82e-16fbe709c040"}, "status": "reserved", "instance": "500a0ed6-ac37-4274-a8f2-2545c270e24b", "attached_at": "", "detached_at": "", "volume_id": "e60bbfa7-eab8-4fc5-a82e-16fbe709c040", "serial": "e60bbfa7-eab8-4fc5-a82e-16fbe709c040"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'e60bbfa7-eab8-4fc5-a82e-16fbe709c040', 'no_device': None, 'attachment_id': '453410e5-9934-4a07-903e-4b7a53a94f8b'} {{(pid=74039) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 20 08:52:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-10a5b3a5-8d7d-47f7-83ec-0af2716d8b61 tempest-TestVolumeSwap-1727362083 tempest-TestVolumeSwap-1727362083-project-admin] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 38.228s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.volume.cinder [None req-453ae04e-df4f-49f5-ab1c-9db2fbe292d3 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Update attachment failed for attachment 85ff15a5-0e6d-4ba7-9de5-40c7602b5556. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a1fbe16a-b8ae-4c42-a849-415d2b5e341f) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a1fbe16a-b8ae-4c42-a849-415d2b5e341f)
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [None req-453ae04e-df4f-49f5-ab1c-9db2fbe292d3 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Failed to attach 0f13e1cd-3cfe-4cd0-ba26-fbe87047c381 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a1fbe16a-b8ae-4c42-a849-415d2b5e341f)
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Traceback (most recent call last):
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]     ret_val = method(obj, context, *args, **kwargs)
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]     self._do_attach(context, instance, volume, volume_api,
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]     self._volume_attach(context, volume, connector, instance,
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]     connection_info = volume_api.attachment_update(
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]     res = method(self, ctx, *args, **kwargs)
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]     with excutils.save_and_reraise_exception():
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]     self.force_reraise()
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]     raise self.value
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]     return method.func(obj, *args, **kwargs)
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]     resp = self._update('/attachments/%s' % id, body)
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]     return self.request(url, method, **kwargs)
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a]     raise exceptions.from_response(resp, body)
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a1fbe16a-b8ae-4c42-a849-415d2b5e341f)
Oct 20 08:52:52 user nova-compute[74039]: ERROR nova.compute.manager [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] 
Oct 20 08:52:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-453ae04e-df4f-49f5-ab1c-9db2fbe292d3 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lock "971fb41b-7fce-4ffe-b785-5d86f435004a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 39.332s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server [None req-453ae04e-df4f-49f5-ab1c-9db2fbe292d3 tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a1fbe16a-b8ae-4c42-a849-415d2b5e341f)
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a1fbe16a-b8ae-4c42-a849-415d2b5e341f)
Oct 20 08:52:52 user nova-compute[74039]: ERROR oslo_messaging.rpc.server 
Oct 20 08:52:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Acquiring lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:52:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:52:52 user nova-compute[74039]: INFO nova.compute.manager [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Detaching volume e60bbfa7-eab8-4fc5-a82e-16fbe709c040
Oct 20 08:52:52 user nova-compute[74039]: INFO nova.virt.block_device [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Attempting to driver detach volume e60bbfa7-eab8-4fc5-a82e-16fbe709c040 from mountpoint /dev/vdb
Oct 20 08:52:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Attempting to detach device vdb from instance 500a0ed6-ac37-4274-a8f2-2545c270e24b from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 08:52:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 08:52:52 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:52:52 user nova-compute[74039]:   <source dev="/dev/sdf"/>
Oct 20 08:52:52 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 08:52:52 user nova-compute[74039]:   <serial>e60bbfa7-eab8-4fc5-a82e-16fbe709c040</serial>
Oct 20 08:52:52 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 08:52:52 user nova-compute[74039]: </disk>
Oct 20 08:52:52 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 08:52:52 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Successfully detached device vdb from instance 500a0ed6-ac37-4274-a8f2-2545c270e24b from the persistent domain config.
Oct 20 08:52:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 500a0ed6-ac37-4274-a8f2-2545c270e24b from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 08:52:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 08:52:52 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:52:52 user nova-compute[74039]:   <source dev="/dev/sdf"/>
Oct 20 08:52:52 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 08:52:52 user nova-compute[74039]:   <serial>e60bbfa7-eab8-4fc5-a82e-16fbe709c040</serial>
Oct 20 08:52:52 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 08:52:52 user nova-compute[74039]: </disk>
Oct 20 08:52:52 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 08:52:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:52:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 500a0ed6-ac37-4274-a8f2-2545c270e24b {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 08:52:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:52:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquiring lock "365da377-4031-4e1b-bc85-6dcaf721548e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "365da377-4031-4e1b-bc85-6dcaf721548e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquiring lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:03 user nova-compute[74039]: INFO nova.compute.manager [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Terminating instance
Oct 20 08:53:03 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 08:53:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:03 user nova-compute[74039]: DEBUG nova.compute.manager [req-7bda8d0a-3f88-47da-9964-4931cf6d6cae req-b392016c-d7a7-47c5-861f-e9b32be89543 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received event network-vif-unplugged-8c246ad5-f489-4486-b930-9d4a1cb60c41 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7bda8d0a-3f88-47da-9964-4931cf6d6cae req-b392016c-d7a7-47c5-861f-e9b32be89543 service nova] Acquiring lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7bda8d0a-3f88-47da-9964-4931cf6d6cae req-b392016c-d7a7-47c5-861f-e9b32be89543 service nova] Lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7bda8d0a-3f88-47da-9964-4931cf6d6cae req-b392016c-d7a7-47c5-861f-e9b32be89543 service nova] Lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:03 user nova-compute[74039]: DEBUG nova.compute.manager [req-7bda8d0a-3f88-47da-9964-4931cf6d6cae req-b392016c-d7a7-47c5-861f-e9b32be89543 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] No waiting events found dispatching network-vif-unplugged-8c246ad5-f489-4486-b930-9d4a1cb60c41 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:03 user nova-compute[74039]: DEBUG nova.compute.manager [req-7bda8d0a-3f88-47da-9964-4931cf6d6cae req-b392016c-d7a7-47c5-861f-e9b32be89543 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received event network-vif-unplugged-8c246ad5-f489-4486-b930-9d4a1cb60c41 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:53:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:04 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Instance destroyed successfully.
Oct 20 08:53:04 user nova-compute[74039]: DEBUG nova.objects.instance [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lazy-loading 'resources' on Instance uuid 365da377-4031-4e1b-bc85-6dcaf721548e {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:53:04 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:48:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2124112502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2124112502',id=8,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADEixoB6QWWhTLuwL+7Z2fkKKWHkyf3tVdnf4752CWzbdJ5lz/PbSjwRzike1kbeQLqKQLtsajre3rrJlFKfvXx6m1o9pCXfJmA6Y4TeaBnPAeS7YpGXhczqHT/lsYEnw==',key_name='tempest-keypair-1295832388',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:49:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40f437448d494f75838a2c7b2b6a973f',ramdisk_id='',reservation_id='r-d06qmgd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-92531413',owner_user_name='tempest-TaggedAttachmentsTest-92531413-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:49:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29ca829a96484751876ead6f2b094e54',uuid=365da377-4031-4e1b-bc85-6dcaf721548e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "address": "fa:16:3e:8e:e7:14", "network": {"id": "48788255-d08e-4361-9b44-b6554c28bc6b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-33959125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c246ad5-f4", "ovs_interfaceid": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:53:04 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Converting VIF {"id": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "address": "fa:16:3e:8e:e7:14", "network": {"id": "48788255-d08e-4361-9b44-b6554c28bc6b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-33959125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f437448d494f75838a2c7b2b6a973f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c246ad5-f4", "ovs_interfaceid": "8c246ad5-f489-4486-b930-9d4a1cb60c41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:53:04 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:e7:14,bridge_name='br-int',has_traffic_filtering=True,id=8c246ad5-f489-4486-b930-9d4a1cb60c41,network=Network(48788255-d08e-4361-9b44-b6554c28bc6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c246ad5-f4') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:53:04 user nova-compute[74039]: DEBUG os_vif [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:e7:14,bridge_name='br-int',has_traffic_filtering=True,id=8c246ad5-f489-4486-b930-9d4a1cb60c41,network=Network(48788255-d08e-4361-9b44-b6554c28bc6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c246ad5-f4') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:53:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c246ad5-f4, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be5fcd26-33bd-4376-a27b-62af62ee4aa5) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:04 user nova-compute[74039]: INFO os_vif [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:e7:14,bridge_name='br-int',has_traffic_filtering=True,id=8c246ad5-f489-4486-b930-9d4a1cb60c41,network=Network(48788255-d08e-4361-9b44-b6554c28bc6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c246ad5-f4')
Oct 20 08:53:04 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Deleting instance files /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e_del
Oct 20 08:53:04 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Deletion of /opt/stack/data/nova/instances/365da377-4031-4e1b-bc85-6dcaf721548e_del complete
Oct 20 08:53:04 user nova-compute[74039]: INFO nova.compute.manager [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 20 08:53:04 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 08:53:04 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 08:53:04 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 08:53:05 user nova-compute[74039]: INFO nova.compute.manager [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Rescuing
Oct 20 08:53:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:53:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquired lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:53:05 user nova-compute[74039]: DEBUG nova.network.neutron [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:53:05 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:53:05 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Took 1.14 seconds to deallocate network for instance.
Oct 20 08:53:05 user nova-compute[74039]: DEBUG nova.compute.manager [req-e09f834f-e550-4f3e-b8a0-ff153281e5bd req-5df38f82-3d2e-4d13-9aec-309323482842 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received event network-vif-deleted-8c246ad5-f489-4486-b930-9d4a1cb60c41 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:05 user nova-compute[74039]: DEBUG nova.compute.manager [req-e863a420-3cc2-450f-96d6-28c0ef0ed971 req-bdb52246-583d-465f-abe7-74440c0fd9b4 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received event network-vif-plugged-8c246ad5-f489-4486-b930-9d4a1cb60c41 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e863a420-3cc2-450f-96d6-28c0ef0ed971 req-bdb52246-583d-465f-abe7-74440c0fd9b4 service nova] Acquiring lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e863a420-3cc2-450f-96d6-28c0ef0ed971 req-bdb52246-583d-465f-abe7-74440c0fd9b4 service nova] Lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e863a420-3cc2-450f-96d6-28c0ef0ed971 req-bdb52246-583d-465f-abe7-74440c0fd9b4 service nova] Lock "365da377-4031-4e1b-bc85-6dcaf721548e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:05 user nova-compute[74039]: DEBUG nova.compute.manager [req-e863a420-3cc2-450f-96d6-28c0ef0ed971 req-bdb52246-583d-465f-abe7-74440c0fd9b4 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] No waiting events found dispatching network-vif-plugged-8c246ad5-f489-4486-b930-9d4a1cb60c41 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:05 user nova-compute[74039]: WARNING nova.compute.manager [req-e863a420-3cc2-450f-96d6-28c0ef0ed971 req-bdb52246-583d-465f-abe7-74440c0fd9b4 service nova] [instance: 365da377-4031-4e1b-bc85-6dcaf721548e] Received unexpected event network-vif-plugged-8c246ad5-f489-4486-b930-9d4a1cb60c41 for instance with vm_state deleted and task_state None.
Oct 20 08:53:05 user nova-compute[74039]: DEBUG nova.network.neutron [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Updating instance_info_cache with network_info: [{"id": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "address": "fa:16:3e:63:75:a3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9fe7711-d5", "ovs_interfaceid": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:53:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Releasing lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:53:06 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:53:06 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:53:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:06 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Deleted allocations for instance 365da377-4031-4e1b-bc85-6dcaf721548e
Oct 20 08:53:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d4b0f09a-ba04-472f-ba34-303b5657e106 tempest-TaggedAttachmentsTest-92531413 tempest-TaggedAttachmentsTest-92531413-project-member] Lock "365da377-4031-4e1b-bc85-6dcaf721548e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.721s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:06 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Instance destroyed successfully.
Oct 20 08:53:06 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Attempting rescue
Oct 20 08:53:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74039) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 08:53:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Instance directory exists: not creating {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 08:53:06 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Creating image(s)
Oct 20 08:53:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "/opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "/opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "/opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:06 user nova-compute[74039]: DEBUG nova.objects.instance [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9fe77a96-fcb5-4410-85cc-58d925548e03 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:53:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.214s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk.rescue {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk.rescue" returned: 0 in 0.051s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.objects.instance [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'migration_context' on Instance uuid 9fe77a96-fcb5-4410-85cc-58d925548e03 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.objects.base [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Object Instance<9fe77a96-fcb5-4410-85cc-58d925548e03> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Start _get_guest_xml network_info=[{"id": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "address": "fa:16:3e:63:75:a3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "vif_mac": "fa:16:3e:63:75:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9fe7711-d5", "ovs_interfaceid": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f58b9629-4790-4951-9492-6447e1485638', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.objects.instance [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'resources' on Instance uuid 9fe77a96-fcb5-4410-85cc-58d925548e03 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.objects.base [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Object Instance<9fe77a96-fcb5-4410-85cc-58d925548e03> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.objects.instance [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'numa_topology' on Instance uuid 9fe77a96-fcb5-4410-85cc-58d925548e03 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.objects.base [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Object Instance<9fe77a96-fcb5-4410-85cc-58d925548e03> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 08:53:07 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:53:07 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.objects.instance [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9fe77a96-fcb5-4410-85cc-58d925548e03 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.objects.base [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Object Instance<9fe77a96-fcb5-4410-85cc-58d925548e03> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:48:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1613714497',display_name='tempest-ServerRescueNegativeTestJSON-server-1613714497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1613714497',id=1,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:48:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d74bb65080a343afb5cbcea1b5481938',ramdisk_id='',reservation_id='r-a20rs244',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1580334620',owner_user_name='tempest-ServerRescueNegativeTestJSON-1580334620-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:48:34Z,user_data=None,user_id='4024fa0ccfda49e0a070b9e6166e37ed',uuid=9fe77a96-fcb5-4410-85cc-58d925548e03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "address": "fa:16:3e:63:75:a3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "vif_mac": "fa:16:3e:63:75:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9fe7711-d5", "ovs_interfaceid": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converting VIF {"id": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "address": "fa:16:3e:63:75:a3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "vif_mac": "fa:16:3e:63:75:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9fe7711-d5", "ovs_interfaceid": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:75:a3,bridge_name='br-int',has_traffic_filtering=True,id=e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9fe7711-d5') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.objects.instance [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fe77a96-fcb5-4410-85cc-58d925548e03 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.objects.base [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Object Instance<9fe77a96-fcb5-4410-85cc-58d925548e03> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:53:07 user nova-compute[74039]:   <uuid>9fe77a96-fcb5-4410-85cc-58d925548e03</uuid>
Oct 20 08:53:07 user nova-compute[74039]:   <name>instance-00000001</name>
Oct 20 08:53:07 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:53:07 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:53:07 user nova-compute[74039]:   <metadata>
Oct 20 08:53:07 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:53:07 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:53:07 user nova-compute[74039]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1613714497</nova:name>
Oct 20 08:53:07 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:53:07</nova:creationTime>
Oct 20 08:53:07 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:53:07 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:53:07 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:53:07 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:53:07 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:53:07 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:53:07 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:53:07 user nova-compute[74039]:       <nova:owner>
Oct 20 08:53:07 user nova-compute[74039]:         <nova:user uuid="4024fa0ccfda49e0a070b9e6166e37ed">tempest-ServerRescueNegativeTestJSON-1580334620-project-member</nova:user>
Oct 20 08:53:07 user nova-compute[74039]:         <nova:project uuid="d74bb65080a343afb5cbcea1b5481938">tempest-ServerRescueNegativeTestJSON-1580334620</nova:project>
Oct 20 08:53:07 user nova-compute[74039]:       </nova:owner>
Oct 20 08:53:07 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:53:07 user nova-compute[74039]:       <nova:ports>
Oct 20 08:53:07 user nova-compute[74039]:         <nova:port uuid="e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7">
Oct 20 08:53:07 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 08:53:07 user nova-compute[74039]:         </nova:port>
Oct 20 08:53:07 user nova-compute[74039]:       </nova:ports>
Oct 20 08:53:07 user nova-compute[74039]:     </nova:instance>
Oct 20 08:53:07 user nova-compute[74039]:   </metadata>
Oct 20 08:53:07 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:53:07 user nova-compute[74039]:     <system>
Oct 20 08:53:07 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:53:07 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:53:07 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:53:07 user nova-compute[74039]:       <entry name="serial">9fe77a96-fcb5-4410-85cc-58d925548e03</entry>
Oct 20 08:53:07 user nova-compute[74039]:       <entry name="uuid">9fe77a96-fcb5-4410-85cc-58d925548e03</entry>
Oct 20 08:53:07 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:53:07 user nova-compute[74039]:     </system>
Oct 20 08:53:07 user nova-compute[74039]:   </sysinfo>
Oct 20 08:53:07 user nova-compute[74039]:   <os>
Oct 20 08:53:07 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:53:07 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:53:07 user nova-compute[74039]:   </os>
Oct 20 08:53:07 user nova-compute[74039]:   <features>
Oct 20 08:53:07 user nova-compute[74039]:     <acpi/>
Oct 20 08:53:07 user nova-compute[74039]:     <apic/>
Oct 20 08:53:07 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:53:07 user nova-compute[74039]:   </features>
Oct 20 08:53:07 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:53:07 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:53:07 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:53:07 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:53:07 user nova-compute[74039]:   </clock>
Oct 20 08:53:07 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:53:07 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:53:07 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:53:07 user nova-compute[74039]:   </cpu>
Oct 20 08:53:07 user nova-compute[74039]:   <devices>
Oct 20 08:53:07 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:53:07 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:53:07 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk.rescue"/>
Oct 20 08:53:07 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:53:07 user nova-compute[74039]:     </disk>
Oct 20 08:53:07 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:53:07 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:53:07 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk"/>
Oct 20 08:53:07 user nova-compute[74039]:       <target dev="vdb" bus="virtio"/>
Oct 20 08:53:07 user nova-compute[74039]:     </disk>
Oct 20 08:53:07 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:53:07 user nova-compute[74039]:       <mac address="fa:16:3e:63:75:a3"/>
Oct 20 08:53:07 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:53:07 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:53:07 user nova-compute[74039]:       <target dev="tape9fe7711-d5"/>
Oct 20 08:53:07 user nova-compute[74039]:     </interface>
Oct 20 08:53:07 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:53:07 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/console.log" append="off"/>
Oct 20 08:53:07 user nova-compute[74039]:     </serial>
Oct 20 08:53:07 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:53:07 user nova-compute[74039]:     <video>
Oct 20 08:53:07 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:53:07 user nova-compute[74039]:     </video>
Oct 20 08:53:07 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:53:07 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:53:07 user nova-compute[74039]:     </rng>
Oct 20 08:53:07 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:53:07 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:53:07 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:53:07 user nova-compute[74039]:     </memballoon>
Oct 20 08:53:07 user nova-compute[74039]:   </devices>
Oct 20 08:53:07 user nova-compute[74039]: </domain>
Oct 20 08:53:07 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:53:07 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Instance destroyed successfully.
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] No VIF found with MAC fa:16:3e:63:75:a3, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-8246264a-18c4-4464-8377-1da21e4b3038 req-a9690bb5-4cbd-48a9-9ec4-db93aee8f438 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received event network-vif-unplugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8246264a-18c4-4464-8377-1da21e4b3038 req-a9690bb5-4cbd-48a9-9ec4-db93aee8f438 service nova] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8246264a-18c4-4464-8377-1da21e4b3038 req-a9690bb5-4cbd-48a9-9ec4-db93aee8f438 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8246264a-18c4-4464-8377-1da21e4b3038 req-a9690bb5-4cbd-48a9-9ec4-db93aee8f438 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-8246264a-18c4-4464-8377-1da21e4b3038 req-a9690bb5-4cbd-48a9-9ec4-db93aee8f438 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] No waiting events found dispatching network-vif-unplugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:08 user nova-compute[74039]: WARNING nova.compute.manager [req-8246264a-18c4-4464-8377-1da21e4b3038 req-a9690bb5-4cbd-48a9-9ec4-db93aee8f438 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received unexpected event network-vif-unplugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 for instance with vm_state active and task_state rescuing.
Oct 20 08:53:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-8246264a-18c4-4464-8377-1da21e4b3038 req-a9690bb5-4cbd-48a9-9ec4-db93aee8f438 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8246264a-18c4-4464-8377-1da21e4b3038 req-a9690bb5-4cbd-48a9-9ec4-db93aee8f438 service nova] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8246264a-18c4-4464-8377-1da21e4b3038 req-a9690bb5-4cbd-48a9-9ec4-db93aee8f438 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8246264a-18c4-4464-8377-1da21e4b3038 req-a9690bb5-4cbd-48a9-9ec4-db93aee8f438 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-8246264a-18c4-4464-8377-1da21e4b3038 req-a9690bb5-4cbd-48a9-9ec4-db93aee8f438 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] No waiting events found dispatching network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:08 user nova-compute[74039]: WARNING nova.compute.manager [req-8246264a-18c4-4464-8377-1da21e4b3038 req-a9690bb5-4cbd-48a9-9ec4-db93aee8f438 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received unexpected event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 for instance with vm_state active and task_state rescuing.
Oct 20 08:53:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-590ba042-c045-4949-a2f8-2695d3c50263 req-8284a166-7e1c-4ca4-8cfd-5f7233ac9b18 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-590ba042-c045-4949-a2f8-2695d3c50263 req-8284a166-7e1c-4ca4-8cfd-5f7233ac9b18 service nova] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-590ba042-c045-4949-a2f8-2695d3c50263 req-8284a166-7e1c-4ca4-8cfd-5f7233ac9b18 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-590ba042-c045-4949-a2f8-2695d3c50263 req-8284a166-7e1c-4ca4-8cfd-5f7233ac9b18 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-590ba042-c045-4949-a2f8-2695d3c50263 req-8284a166-7e1c-4ca4-8cfd-5f7233ac9b18 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] No waiting events found dispatching network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:10 user nova-compute[74039]: WARNING nova.compute.manager [req-590ba042-c045-4949-a2f8-2695d3c50263 req-8284a166-7e1c-4ca4-8cfd-5f7233ac9b18 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received unexpected event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 for instance with vm_state active and task_state rescuing.
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-590ba042-c045-4949-a2f8-2695d3c50263 req-8284a166-7e1c-4ca4-8cfd-5f7233ac9b18 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-590ba042-c045-4949-a2f8-2695d3c50263 req-8284a166-7e1c-4ca4-8cfd-5f7233ac9b18 service nova] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-590ba042-c045-4949-a2f8-2695d3c50263 req-8284a166-7e1c-4ca4-8cfd-5f7233ac9b18 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-590ba042-c045-4949-a2f8-2695d3c50263 req-8284a166-7e1c-4ca4-8cfd-5f7233ac9b18 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-590ba042-c045-4949-a2f8-2695d3c50263 req-8284a166-7e1c-4ca4-8cfd-5f7233ac9b18 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] No waiting events found dispatching network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:10 user nova-compute[74039]: WARNING nova.compute.manager [req-590ba042-c045-4949-a2f8-2695d3c50263 req-8284a166-7e1c-4ca4-8cfd-5f7233ac9b18 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received unexpected event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 for instance with vm_state active and task_state rescuing.
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.compute.manager [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:53:10 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Creating image(s)
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Did not create local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Ensure instance console log exists: /opt/stack/data/nova/instances/70e52f06-4f2a-4431-8149-2228565072e6/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Start _get_guest_xml network_info=[{"id": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "address": "fa:16:3e:63:9f:0c", "network": {"id": "b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-648216651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559c1e42-8d", "ovs_interfaceid": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "address": "fa:16:3e:36:b9:ef", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9c8977-ca", "ovs_interfaceid": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "address": "fa:16:3e:36:6e:69", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5d3f5c-ff", "ovs_interfaceid": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "address": "fa:16:3e:ec:24:89", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ca163-f5", "ovs_interfaceid": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "address": "fa:16:3e:7d:de:76", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0a6d7c-1f", "ovs_interfaceid": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "address": "fa:16:3e:14:f4:6b", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bf8dcb-50", "ovs_interfaceid": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "address": "fa:16:3e:b7:1c:11", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ec0b8d-c5", "ovs_interfaceid": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9edf32e8-923b-4e1f-a649-d3471f0f4b8f', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxOUZclt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '70e52f06-4f2a-4431-8149-2228565072e6', 'attached_at': '', 'detached_at': '', 'volume_id': '5ddf3a93-eecd-4682-8412-6209c4c708aa', 'serial': '5ddf3a93-eecd-4682-8412-6209c4c708aa'}, 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': '88e0b537-9cc9-46bb-8102-0b798af4f011', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxMGztOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '70e52f06-4f2a-4431-8149-2228565072e6', 'attached_at': '', 'detached_at': '', 'volume_id': 'e05c25ad-8992-4e59-9b12-2e99c5129e08', 'serial': 'e05c25ad-8992-4e59-9b12-2e99c5129e08'}, 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': '9ddf07e9-971d-4f55-9326-f27e5fe72150', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdc', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNigOxWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '70e52f06-4f2a-4431-8149-2228565072e6', 'attached_at': '', 'detached_at': '', 'volume_id': 'fba8a764-2e46-40da-b2a3-f766320b5dd7', 'serial': 'fba8a764-2e46-40da-b2a3-f766320b5dd7'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:53:10 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:53:10 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:53:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxOUZclt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:53:11 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:53:11 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:53:11 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[97723e81-8311-4d94-b126-94a153bf482f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 08:53:11 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e23ec4-ad21-4e7d-9606-79d363dd3035]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa] added
Oct 20 08:53:11 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d98c11-68f0-437d-a69b-9f475ee3379a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[605df593-a4fe-4ef0-b53d-9725d5ece1b3]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AxOUZclt {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AxOUZclt" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecdd0da-4d21-44c5-a654-f6dc55640186]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AxOUZclt'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c9e752-564b-4dd6-b8eb-4d3de2181344]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b57ea5-06f1-4436-a300-b2af777f6acf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:53:11 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:53:11 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:53:11 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:53:11 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:53:11 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:53:11 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:53:11 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:53:11 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3958207a-acb8-4502-ac4f-54ec3f30ea53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa, portal: 172.16.0.220,3260]
Oct 20 08:53:11 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa, portal: 172.16.0.220,3260] successful.
Oct 20 08:53:11 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.053s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[026c989d-1a71-4bff-ab83-c1159ebc13ae]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG nova.compute.manager [None req-38c048dc-0e6f-444d-b834-80c544e261a5 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37e4bd7-5ec4-4fc7-85e0-cffddad883c4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:53:11 user nova-compute[74039]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)
Oct 20 08:53:11 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:53:11 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:53:11 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:53:11 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:53:11 user nova-compute[74039]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)
Oct 20 08:53:11 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:53:11 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:53:11 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:53:11 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.390s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d75ecb7-1792-4182-bcb5-80e6b54c77fd]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxOUZclt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Acquiring lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Acquiring lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:11 user nova-compute[74039]: INFO nova.compute.manager [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Terminating instance
Oct 20 08:53:11 user nova-compute[74039]: DEBUG nova.compute.manager [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG nova.compute.manager [req-c35335e3-02ea-446f-8120-61a66f7f013d req-f5432233-4f3f-48ea-8a5a-95aa686d33cb service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Received event network-vif-unplugged-64d1e940-638e-4992-83cc-4c3d515d7d7c {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c35335e3-02ea-446f-8120-61a66f7f013d req-f5432233-4f3f-48ea-8a5a-95aa686d33cb service nova] Acquiring lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c35335e3-02ea-446f-8120-61a66f7f013d req-f5432233-4f3f-48ea-8a5a-95aa686d33cb service nova] Lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c35335e3-02ea-446f-8120-61a66f7f013d req-f5432233-4f3f-48ea-8a5a-95aa686d33cb service nova] Lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG nova.compute.manager [req-c35335e3-02ea-446f-8120-61a66f7f013d req-f5432233-4f3f-48ea-8a5a-95aa686d33cb service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] No waiting events found dispatching network-vif-unplugged-64d1e940-638e-4992-83cc-4c3d515d7d7c {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG nova.compute.manager [req-c35335e3-02ea-446f-8120-61a66f7f013d req-f5432233-4f3f-48ea-8a5a-95aa686d33cb service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Received event network-vif-unplugged-64d1e940-638e-4992-83cc-4c3d515d7d7c for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:53:12 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Instance destroyed successfully.
Oct 20 08:53:12 user nova-compute[74039]: DEBUG nova.objects.instance [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Lazy-loading 'resources' on Instance uuid 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:48:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-7828159',display_name='tempest-VolumesAssistedSnapshotsTest-server-7828159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-7828159',id=7,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFrwWQBbYYwls8N09mOUayZKRVnw2WDpqhd57eHGSJhkp42g3CzJkSFj+sP8U7nqyxF6+rcTijOFho8kNWH6RwjXUAXV5uFEuvZwgK2pcwTyA6WsxuWbh6fGiwrVPbwYw==',key_name='tempest-keypair-1005654622',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:48:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d44db9563c584bb482055ddb6ac19447',ramdisk_id='',reservation_id='r-0kffnd1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1126553144',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1126553144-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f279e153daba4202b3b5ba4c63b68a23',uuid=7daab27d-f8f5-437e-9ed5-8ea1e72c8e74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "address": "fa:16:3e:1d:51:19", "network": {"id": "81514bfa-76db-4527-832f-f0214a1b0501", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2103077624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44db9563c584bb482055ddb6ac19447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1e940-63", "ovs_interfaceid": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Converting VIF {"id": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "address": "fa:16:3e:1d:51:19", "network": {"id": "81514bfa-76db-4527-832f-f0214a1b0501", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2103077624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44db9563c584bb482055ddb6ac19447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d1e940-63", "ovs_interfaceid": "64d1e940-638e-4992-83cc-4c3d515d7d7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:51:19,bridge_name='br-int',has_traffic_filtering=True,id=64d1e940-638e-4992-83cc-4c3d515d7d7c,network=Network(81514bfa-76db-4527-832f-f0214a1b0501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d1e940-63') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_vif [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:51:19,bridge_name='br-int',has_traffic_filtering=True,id=64d1e940-638e-4992-83cc-4c3d515d7d7c,network=Network(81514bfa-76db-4527-832f-f0214a1b0501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d1e940-63') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64d1e940-63, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '26539616565376131', 'path': '/dev/sdb'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539616565376131', 'path': '/dev/sdb'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ff1d3f1-4c04-445c-ae75-ac4120068eeb) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:53:12 user nova-compute[74039]: INFO os_vif [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:51:19,bridge_name='br-int',has_traffic_filtering=True,id=64d1e940-638e-4992-83cc-4c3d515d7d7c,network=Network(81514bfa-76db-4527-832f-f0214a1b0501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d1e940-63')
Oct 20 08:53:12 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Deleting instance files /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74_del
Oct 20 08:53:12 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Deletion of /opt/stack/data/nova/instances/7daab27d-f8f5-437e-9ed5-8ea1e72c8e74_del complete
Oct 20 08:53:12 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxMGztOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:53:12 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:53:12 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:53:12 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[194b779d-64dc-4fe7-b059-45d48c437f09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 08:53:12 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[383f8aab-c68e-4b17-8de5-50ada3355270]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08] added
Oct 20 08:53:12 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:12 user nova-compute[74039]: INFO nova.compute.manager [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6a7698-b382-449d-a160-1e28def8cd6f]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee82132-b366-4e30-b26f-2c2ae047307a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AxMGztOL {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AxMGztOL" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a155d4f-6788-43ae-84cb-a68f8901df6f]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AxMGztOL'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8bdccc-f445-41e5-bbf2-5001596ab8ca]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[75aeb157-0acc-44b6-9082-c1c9ec1499b8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:53:12 user nova-compute[74039]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)
Oct 20 08:53:12 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:53:12 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:53:12 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:53:12 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:53:12 user nova-compute[74039]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)
Oct 20 08:53:12 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:53:12 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:53:12 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:53:12 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df5ac07-4d0d-4f7c-83b9-fff2bda5215f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08, portal: 172.16.0.220,3260]
Oct 20 08:53:12 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08, portal: 172.16.0.220,3260] successful.
Oct 20 08:53:12 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37df5dd-c252-4a48-bc2b-99b6967d1f23]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3729511c-f79d-48b0-9a96-46f480eb0597]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:53:12 user nova-compute[74039]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)
Oct 20 08:53:12 user nova-compute[74039]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)
Oct 20 08:53:12 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:53:12 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:53:12 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:53:12 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:53:12 user nova-compute[74039]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)
Oct 20 08:53:12 user nova-compute[74039]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)
Oct 20 08:53:12 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:53:12 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:53:12 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:53:12 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] HCTL ('38', '-', '-', 0) found on session 12 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a89790-9ac3-4882-92b6-ba4ad6ee8438]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Searching for a device in session 12 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:53:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxMGztOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 08:53:13 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 500a0ed6-ac37-4274-a8f2-2545c270e24b is timed out.
Oct 20 08:53:13 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Successfully detached device vdb from instance 500a0ed6-ac37-4274-a8f2-2545c270e24b from the live domain config.
Oct 20 08:53:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 08:53:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bfjyqgCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'e60bbfa7-eab8-4fc5-a82e-16fbe709c040'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:53:13 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:53:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:53:13 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:53:13 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Took 1.12 seconds to deallocate network for instance.
Oct 20 08:53:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-ad871e85-bf29-4328-a3c6-abaed5670531 req-9ba9a0e7-1f60-4908-ba5b-bc4ffb796e21 service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Received event network-vif-deleted-64d1e940-638e-4992-83cc-4c3d515d7d7c {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:53:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '23861626661303837', 'path': '/dev/sdg'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:53:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861626661303837', 'path': '/dev/sdg'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 08:53:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.456s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:53:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7ecf73-dc18-47d7-b082-af4fff0d8224]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 08:53:13 user nova-compute[74039]: No targets found.
Oct 20 08:53:13 user nova-compute[74039]: iSNS:
Oct 20 08:53:13 user nova-compute[74039]: No targets found.
Oct 20 08:53:13 user nova-compute[74039]: STATIC:
Oct 20 08:53:13 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08
Oct 20 08:53:13 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:53:13 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:53:13 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040
Oct 20 08:53:13 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:53:13 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:53:13 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf
Oct 20 08:53:13 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:53:13 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:53:13 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d
Oct 20 08:53:13 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:53:13 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:53:13 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa
Oct 20 08:53:13 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:53:13 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:53:13 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9
Oct 20 08:53:13 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:53:13 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:53:13 user nova-compute[74039]: FIRMWARE:
Oct 20 08:53:13 user nova-compute[74039]: No targets found.
Oct 20 08:53:13 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:53:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 08:53:13 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 08:53:13 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 08:53:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 08:53:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 08:53:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNigOxWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:53:13 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:53:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:53:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db82025-b0f6-40af-bae2-6bc92ff438e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8bd0b7-e25f-48a5-afc8-adb71a5ce152]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:53:14 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:53:14 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae8456fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040'): ({'sdf'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Removing single pathed devices sdf {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0343f8-260e-42dc-9de5-f711c4287266]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c58b74-ae95-4025-bc9a-7b3561ab8f5e]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Flushing IO for device /dev/sdf {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2304d1-cdea-4f15-bfe9-ead494dbabe3]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[720dc02d-1f3c-474f-82f6-ae2a761ce875]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] SCSI volumes sdf have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78d273e-d9b4-41e6-90f3-9466e0e72d30]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG nova.compute.manager [req-b1085ac5-a955-4ba1-8966-2c047ccc1bd7 req-d4dfe8cb-e93b-4018-b11a-b8138c8588fa service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Received event network-vif-plugged-64d1e940-638e-4992-83cc-4c3d515d7d7c {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b1085ac5-a955-4ba1-8966-2c047ccc1bd7 req-d4dfe8cb-e93b-4018-b11a-b8138c8588fa service nova] Acquiring lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b1085ac5-a955-4ba1-8966-2c047ccc1bd7 req-d4dfe8cb-e93b-4018-b11a-b8138c8588fa service nova] Lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b1085ac5-a955-4ba1-8966-2c047ccc1bd7 req-d4dfe8cb-e93b-4018-b11a-b8138c8588fa service nova] Lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG nova.compute.manager [req-b1085ac5-a955-4ba1-8966-2c047ccc1bd7 req-d4dfe8cb-e93b-4018-b11a-b8138c8588fa service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] No waiting events found dispatching network-vif-plugged-64d1e940-638e-4992-83cc-4c3d515d7d7c {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:14 user nova-compute[74039]: WARNING nova.compute.manager [req-b1085ac5-a955-4ba1-8966-2c047ccc1bd7 req-d4dfe8cb-e93b-4018-b11a-b8138c8588fa service nova] [instance: 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74] Received unexpected event network-vif-plugged-64d1e940-638e-4992-83cc-4c3d515d7d7c for instance with vm_state deleted and task_state None.
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0d5f6a-b691-4b6b-9351-764ef0489969]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040, portal: 172.16.0.220,3260]
Oct 20 08:53:14 user nova-compute[74039]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040, portal: 172.16.0.220,3260] successful.
Oct 20 08:53:14 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:14 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Deleted allocations for instance 7daab27d-f8f5-437e-9ed5-8ea1e72c8e74
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60bbfa7-eab8-4fc5-a82e-16fbe709c040 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf876f6-d27d-4402-94db-f50224587b72]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] <== disconnect_volume: return (895ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.407s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:53:14 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:53:14 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53d6bba-5db8-4e5b-b309-f91cd9f36ebd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 08:53:14 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[12453652-aef4-4403-a9bf-41ca8c308d63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7] added
Oct 20 08:53:14 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2c54a1-178f-415f-b9ec-44f32f3ba8a8]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87707f1-13a3-4aa0-b6dc-da2100b4841d]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5ae06111-b0b4-4c37-b116-697e0b6176ea tempest-VolumesAssistedSnapshotsTest-1126553144 tempest-VolumesAssistedSnapshotsTest-1126553144-project-member] Lock "7daab27d-f8f5-437e-9ed5-8ea1e72c8e74" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.905s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LNigOxWZ {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LNigOxWZ" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a774a63e-e26f-4ce2-aa3a-ddd0a8993c98]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LNigOxWZ'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e32080-377c-45d4-a009-bb09f0bd1fdb]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[234600e2-a036-460c-b82b-c21850b275e2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:53:14 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:53:14 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef30dd0d-69e1-4a98-91b7-5901ca2fb16e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7, portal: 172.16.0.220,3260]
Oct 20 08:53:14 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7, portal: 172.16.0.220,3260] successful.
Oct 20 08:53:14 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf84e572-ac7b-4831-99ca-4a6a2a910e8b]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d5b0e9-d2ba-4bfc-8304-f5a234a69ae7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:53:14 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:53:14 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:53:14 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] HCTL ('37', '-', '-', 0) found on session 13 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f46a86-d7f7-49eb-8c8d-f6e7ef76104a]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:53:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNigOxWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] <== connect_volume: return (1788ms) {'type': 'block', 'scsi_wwn': '23163636239376538', 'path': '/dev/sdf'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163636239376538', 'path': '/dev/sdf'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "address": "fa:16:3e:63:9f:0c", "network": {"id": "b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-648216651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559c1e42-8d", "ovs_interfaceid": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "address": "fa:16:3e:63:9f:0c", "network": {"id": "b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-648216651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559c1e42-8d", "ovs_interfaceid": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:9f:0c,bridge_name='br-int',has_traffic_filtering=True,id=559c1e42-8d19-4a1a-b6e9-385cb497a7df,network=Network(b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559c1e42-8d') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "address": "fa:16:3e:36:b9:ef", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9c8977-ca", "ovs_interfaceid": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "address": "fa:16:3e:36:b9:ef", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9c8977-ca", "ovs_interfaceid": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:b9:ef,bridge_name='br-int',has_traffic_filtering=True,id=1e9c8977-ca97-4285-b762-d5ceb5f701ef,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e9c8977-ca') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "address": "fa:16:3e:36:6e:69", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5d3f5c-ff", "ovs_interfaceid": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "address": "fa:16:3e:36:6e:69", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5d3f5c-ff", "ovs_interfaceid": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6e:69,bridge_name='br-int',has_traffic_filtering=True,id=aa5d3f5c-ff64-4554-9ecb-b9e14730d29a,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaa5d3f5c-ff') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "address": "fa:16:3e:ec:24:89", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ca163-f5", "ovs_interfaceid": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "address": "fa:16:3e:ec:24:89", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ca163-f5", "ovs_interfaceid": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:24:89,bridge_name='br-int',has_traffic_filtering=True,id=ea5ca163-f56a-49dc-ba70-a18ab6e4cd11,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea5ca163-f5') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "address": "fa:16:3e:7d:de:76", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0a6d7c-1f", "ovs_interfaceid": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "address": "fa:16:3e:7d:de:76", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0a6d7c-1f", "ovs_interfaceid": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:de:76,bridge_name='br-int',has_traffic_filtering=True,id=7c0a6d7c-1f14-4014-baf3-784dd0f5ef18,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0a6d7c-1f') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "address": "fa:16:3e:14:f4:6b", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bf8dcb-50", "ovs_interfaceid": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "address": "fa:16:3e:14:f4:6b", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bf8dcb-50", "ovs_interfaceid": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=90bf8dcb-50f9-4f4b-a743-07754de5bddf,network=Network(9ca3c2dc-7c79-4df0-938f-ff05c3de9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bf8dcb-50') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "address": "fa:16:3e:b7:1c:11", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ec0b8d-c5", "ovs_interfaceid": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "address": "fa:16:3e:b7:1c:11", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ec0b8d-c5", "ovs_interfaceid": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:1c:11,bridge_name='br-int',has_traffic_filtering=True,id=a2ec0b8d-c5ed-4f71-9b28-76b48949f029,network=Network(9ca3c2dc-7c79-4df0-938f-ff05c3de9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ec0b8d-c5') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.objects.instance [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lazy-loading 'pci_devices' on Instance uuid 70e52f06-4f2a-4431-8149-2228565072e6 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:53:15 user nova-compute[74039]:   <uuid>70e52f06-4f2a-4431-8149-2228565072e6</uuid>
Oct 20 08:53:15 user nova-compute[74039]:   <name>instance-00000009</name>
Oct 20 08:53:15 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:53:15 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:53:15 user nova-compute[74039]:   <metadata>
Oct 20 08:53:15 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:53:15 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:53:15 user nova-compute[74039]:       <nova:name>tempest-device-tagging-server-503202872</nova:name>
Oct 20 08:53:15 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:53:10</nova:creationTime>
Oct 20 08:53:15 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:53:15 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:53:15 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:53:15 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:53:15 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:53:15 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:53:15 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:53:15 user nova-compute[74039]:       <nova:owner>
Oct 20 08:53:15 user nova-compute[74039]:         <nova:user uuid="dabfaebbed414fe1bddedb1b4e02d358">tempest-TaggedBootDevicesTest-1640177090-project-member</nova:user>
Oct 20 08:53:15 user nova-compute[74039]:         <nova:project uuid="b602fae310894282bb68869684db4965">tempest-TaggedBootDevicesTest-1640177090</nova:project>
Oct 20 08:53:15 user nova-compute[74039]:       </nova:owner>
Oct 20 08:53:15 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:53:15 user nova-compute[74039]:       <nova:ports>
Oct 20 08:53:15 user nova-compute[74039]:         <nova:port uuid="559c1e42-8d19-4a1a-b6e9-385cb497a7df">
Oct 20 08:53:15 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 08:53:15 user nova-compute[74039]:         </nova:port>
Oct 20 08:53:15 user nova-compute[74039]:         <nova:port uuid="1e9c8977-ca97-4285-b762-d5ceb5f701ef">
Oct 20 08:53:15 user nova-compute[74039]:           <nova:ip type="fixed" address="10.1.1.60" ipVersion="4"/>
Oct 20 08:53:15 user nova-compute[74039]:         </nova:port>
Oct 20 08:53:15 user nova-compute[74039]:         <nova:port uuid="aa5d3f5c-ff64-4554-9ecb-b9e14730d29a">
Oct 20 08:53:15 user nova-compute[74039]:           <nova:ip type="fixed" address="10.1.1.240" ipVersion="4"/>
Oct 20 08:53:15 user nova-compute[74039]:         </nova:port>
Oct 20 08:53:15 user nova-compute[74039]:         <nova:port uuid="ea5ca163-f56a-49dc-ba70-a18ab6e4cd11">
Oct 20 08:53:15 user nova-compute[74039]:           <nova:ip type="fixed" address="10.1.1.69" ipVersion="4"/>
Oct 20 08:53:15 user nova-compute[74039]:         </nova:port>
Oct 20 08:53:15 user nova-compute[74039]:         <nova:port uuid="7c0a6d7c-1f14-4014-baf3-784dd0f5ef18">
Oct 20 08:53:15 user nova-compute[74039]:           <nova:ip type="fixed" address="10.1.1.222" ipVersion="4"/>
Oct 20 08:53:15 user nova-compute[74039]:         </nova:port>
Oct 20 08:53:15 user nova-compute[74039]:         <nova:port uuid="90bf8dcb-50f9-4f4b-a743-07754de5bddf">
Oct 20 08:53:15 user nova-compute[74039]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 20 08:53:15 user nova-compute[74039]:         </nova:port>
Oct 20 08:53:15 user nova-compute[74039]:         <nova:port uuid="a2ec0b8d-c5ed-4f71-9b28-76b48949f029">
Oct 20 08:53:15 user nova-compute[74039]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 20 08:53:15 user nova-compute[74039]:         </nova:port>
Oct 20 08:53:15 user nova-compute[74039]:       </nova:ports>
Oct 20 08:53:15 user nova-compute[74039]:     </nova:instance>
Oct 20 08:53:15 user nova-compute[74039]:   </metadata>
Oct 20 08:53:15 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:53:15 user nova-compute[74039]:     <system>
Oct 20 08:53:15 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:53:15 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:53:15 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:53:15 user nova-compute[74039]:       <entry name="serial">70e52f06-4f2a-4431-8149-2228565072e6</entry>
Oct 20 08:53:15 user nova-compute[74039]:       <entry name="uuid">70e52f06-4f2a-4431-8149-2228565072e6</entry>
Oct 20 08:53:15 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:53:15 user nova-compute[74039]:     </system>
Oct 20 08:53:15 user nova-compute[74039]:   </sysinfo>
Oct 20 08:53:15 user nova-compute[74039]:   <os>
Oct 20 08:53:15 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:53:15 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:53:15 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:53:15 user nova-compute[74039]:   </os>
Oct 20 08:53:15 user nova-compute[74039]:   <features>
Oct 20 08:53:15 user nova-compute[74039]:     <acpi/>
Oct 20 08:53:15 user nova-compute[74039]:     <apic/>
Oct 20 08:53:15 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:53:15 user nova-compute[74039]:   </features>
Oct 20 08:53:15 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:53:15 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:53:15 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:53:15 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:53:15 user nova-compute[74039]:   </clock>
Oct 20 08:53:15 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:53:15 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:53:15 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:53:15 user nova-compute[74039]:   </cpu>
Oct 20 08:53:15 user nova-compute[74039]:   <devices>
Oct 20 08:53:15 user nova-compute[74039]:     <disk type="file" device="cdrom">
Oct 20 08:53:15 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 08:53:15 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/70e52f06-4f2a-4431-8149-2228565072e6/disk.config"/>
Oct 20 08:53:15 user nova-compute[74039]:       <target dev="hda" bus="ide"/>
Oct 20 08:53:15 user nova-compute[74039]:     </disk>
Oct 20 08:53:15 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 08:53:15 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:53:15 user nova-compute[74039]:       <source dev="/dev/sdb"/>
Oct 20 08:53:15 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:53:15 user nova-compute[74039]:       <serial>5ddf3a93-eecd-4682-8412-6209c4c708aa</serial>
Oct 20 08:53:15 user nova-compute[74039]:     </disk>
Oct 20 08:53:15 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 08:53:15 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:53:15 user nova-compute[74039]:       <source dev="/dev/sdg"/>
Oct 20 08:53:15 user nova-compute[74039]:       <target dev="vdb" bus="virtio"/>
Oct 20 08:53:15 user nova-compute[74039]:       <serial>e05c25ad-8992-4e59-9b12-2e99c5129e08</serial>
Oct 20 08:53:15 user nova-compute[74039]:     </disk>
Oct 20 08:53:15 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 08:53:15 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:53:15 user nova-compute[74039]:       <source dev="/dev/sdf"/>
Oct 20 08:53:15 user nova-compute[74039]:       <target dev="vdc" bus="virtio"/>
Oct 20 08:53:15 user nova-compute[74039]:       <serial>fba8a764-2e46-40da-b2a3-f766320b5dd7</serial>
Oct 20 08:53:15 user nova-compute[74039]:     </disk>
Oct 20 08:53:15 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:53:15 user nova-compute[74039]:       <mac address="fa:16:3e:63:9f:0c"/>
Oct 20 08:53:15 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:53:15 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:53:15 user nova-compute[74039]:       <target dev="tap559c1e42-8d"/>
Oct 20 08:53:15 user nova-compute[74039]:     </interface>
Oct 20 08:53:15 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:53:15 user nova-compute[74039]:       <mac address="fa:16:3e:36:b9:ef"/>
Oct 20 08:53:15 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:53:15 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:53:15 user nova-compute[74039]:       <target dev="tap1e9c8977-ca"/>
Oct 20 08:53:15 user nova-compute[74039]:     </interface>
Oct 20 08:53:15 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:53:15 user nova-compute[74039]:       <mac address="fa:16:3e:36:6e:69"/>
Oct 20 08:53:15 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:53:15 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:53:15 user nova-compute[74039]:       <target dev="tapaa5d3f5c-ff"/>
Oct 20 08:53:15 user nova-compute[74039]:     </interface>
Oct 20 08:53:15 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:53:15 user nova-compute[74039]:       <mac address="fa:16:3e:ec:24:89"/>
Oct 20 08:53:15 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:53:15 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:53:15 user nova-compute[74039]:       <target dev="tapea5ca163-f5"/>
Oct 20 08:53:15 user nova-compute[74039]:     </interface>
Oct 20 08:53:15 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:53:15 user nova-compute[74039]:       <mac address="fa:16:3e:7d:de:76"/>
Oct 20 08:53:15 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:53:15 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:53:15 user nova-compute[74039]:       <target dev="tap7c0a6d7c-1f"/>
Oct 20 08:53:15 user nova-compute[74039]:     </interface>
Oct 20 08:53:15 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:53:15 user nova-compute[74039]:       <mac address="fa:16:3e:14:f4:6b"/>
Oct 20 08:53:15 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:53:15 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:53:15 user nova-compute[74039]:       <target dev="tap90bf8dcb-50"/>
Oct 20 08:53:15 user nova-compute[74039]:     </interface>
Oct 20 08:53:15 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:53:15 user nova-compute[74039]:       <mac address="fa:16:3e:b7:1c:11"/>
Oct 20 08:53:15 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:53:15 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:53:15 user nova-compute[74039]:       <target dev="tapa2ec0b8d-c5"/>
Oct 20 08:53:15 user nova-compute[74039]:     </interface>
Oct 20 08:53:15 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:53:15 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/70e52f06-4f2a-4431-8149-2228565072e6/console.log" append="off"/>
Oct 20 08:53:15 user nova-compute[74039]:     </serial>
Oct 20 08:53:15 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:53:15 user nova-compute[74039]:     <video>
Oct 20 08:53:15 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:53:15 user nova-compute[74039]:     </video>
Oct 20 08:53:15 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:53:15 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:53:15 user nova-compute[74039]:     </rng>
Oct 20 08:53:15 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:53:15 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:53:15 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:53:15 user nova-compute[74039]:     </memballoon>
Oct 20 08:53:15 user nova-compute[74039]:   </devices>
Oct 20 08:53:15 user nova-compute[74039]: </domain>
Oct 20 08:53:15 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "address": "fa:16:3e:63:9f:0c", "network": {"id": "b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-648216651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559c1e42-8d", "ovs_interfaceid": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "address": "fa:16:3e:63:9f:0c", "network": {"id": "b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-648216651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559c1e42-8d", "ovs_interfaceid": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:9f:0c,bridge_name='br-int',has_traffic_filtering=True,id=559c1e42-8d19-4a1a-b6e9-385cb497a7df,network=Network(b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559c1e42-8d') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG os_vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:9f:0c,bridge_name='br-int',has_traffic_filtering=True,id=559c1e42-8d19-4a1a-b6e9-385cb497a7df,network=Network(b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559c1e42-8d') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93951544-424b-53aa-aa71-1035e3327e8d', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap559c1e42-8d, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap559c1e42-8d, col_values=(('qos', UUID('5b8a2ab4-7c39-45e5-8ddd-e3736223af77')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap559c1e42-8d, col_values=(('external_ids', {'iface-id': '559c1e42-8d19-4a1a-b6e9-385cb497a7df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:9f:0c', 'vm-uuid': '70e52f06-4f2a-4431-8149-2228565072e6'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:15 user nova-compute[74039]: INFO os_vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:9f:0c,bridge_name='br-int',has_traffic_filtering=True,id=559c1e42-8d19-4a1a-b6e9-385cb497a7df,network=Network(b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559c1e42-8d')
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "address": "fa:16:3e:36:b9:ef", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9c8977-ca", "ovs_interfaceid": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "address": "fa:16:3e:36:b9:ef", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9c8977-ca", "ovs_interfaceid": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:b9:ef,bridge_name='br-int',has_traffic_filtering=True,id=1e9c8977-ca97-4285-b762-d5ceb5f701ef,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e9c8977-ca') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG os_vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:b9:ef,bridge_name='br-int',has_traffic_filtering=True,id=1e9c8977-ca97-4285-b762-d5ceb5f701ef,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e9c8977-ca') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25802dad-0be0-599e-ac4e-d2f2b22ffb07', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e9c8977-ca, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e9c8977-ca, col_values=(('qos', UUID('ce6589ed-b32b-444b-af88-eaae85969c9b')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e9c8977-ca, col_values=(('external_ids', {'iface-id': '1e9c8977-ca97-4285-b762-d5ceb5f701ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:b9:ef', 'vm-uuid': '70e52f06-4f2a-4431-8149-2228565072e6'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:15 user nova-compute[74039]: INFO os_vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:b9:ef,bridge_name='br-int',has_traffic_filtering=True,id=1e9c8977-ca97-4285-b762-d5ceb5f701ef,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e9c8977-ca')
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "address": "fa:16:3e:36:6e:69", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5d3f5c-ff", "ovs_interfaceid": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "address": "fa:16:3e:36:6e:69", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5d3f5c-ff", "ovs_interfaceid": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6e:69,bridge_name='br-int',has_traffic_filtering=True,id=aa5d3f5c-ff64-4554-9ecb-b9e14730d29a,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaa5d3f5c-ff') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG os_vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6e:69,bridge_name='br-int',has_traffic_filtering=True,id=aa5d3f5c-ff64-4554-9ecb-b9e14730d29a,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaa5d3f5c-ff') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '511b9484-16b8-5634-8103-8add35310b26', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa5d3f5c-ff, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa5d3f5c-ff, col_values=(('qos', UUID('a8787a14-af6c-44e5-8bb6-7c2ad687a30a')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa5d3f5c-ff, col_values=(('external_ids', {'iface-id': 'aa5d3f5c-ff64-4554-9ecb-b9e14730d29a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:6e:69', 'vm-uuid': '70e52f06-4f2a-4431-8149-2228565072e6'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: INFO os_vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6e:69,bridge_name='br-int',has_traffic_filtering=True,id=aa5d3f5c-ff64-4554-9ecb-b9e14730d29a,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaa5d3f5c-ff')
Oct 20 08:53:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "address": "fa:16:3e:ec:24:89", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ca163-f5", "ovs_interfaceid": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "address": "fa:16:3e:ec:24:89", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ca163-f5", "ovs_interfaceid": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:24:89,bridge_name='br-int',has_traffic_filtering=True,id=ea5ca163-f56a-49dc-ba70-a18ab6e4cd11,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea5ca163-f5') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG os_vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:24:89,bridge_name='br-int',has_traffic_filtering=True,id=ea5ca163-f56a-49dc-ba70-a18ab6e4cd11,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea5ca163-f5') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f7f65bd2-83a4-59fb-8806-cd328400cbbd', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea5ca163-f5, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea5ca163-f5, col_values=(('qos', UUID('00fabe11-2cc0-4247-b456-d1b2713cba7e')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea5ca163-f5, col_values=(('external_ids', {'iface-id': 'ea5ca163-f56a-49dc-ba70-a18ab6e4cd11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:24:89', 'vm-uuid': '70e52f06-4f2a-4431-8149-2228565072e6'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: INFO os_vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:24:89,bridge_name='br-int',has_traffic_filtering=True,id=ea5ca163-f56a-49dc-ba70-a18ab6e4cd11,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea5ca163-f5')
Oct 20 08:53:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "address": "fa:16:3e:7d:de:76", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0a6d7c-1f", "ovs_interfaceid": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "address": "fa:16:3e:7d:de:76", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0a6d7c-1f", "ovs_interfaceid": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:de:76,bridge_name='br-int',has_traffic_filtering=True,id=7c0a6d7c-1f14-4014-baf3-784dd0f5ef18,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0a6d7c-1f') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG os_vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:de:76,bridge_name='br-int',has_traffic_filtering=True,id=7c0a6d7c-1f14-4014-baf3-784dd0f5ef18,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0a6d7c-1f') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dfb9a7c5-dec2-5317-9e69-5419d135e2bf', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c0a6d7c-1f, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c0a6d7c-1f, col_values=(('qos', UUID('cbc28827-c982-41a8-b34f-d669e70ae675')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c0a6d7c-1f, col_values=(('external_ids', {'iface-id': '7c0a6d7c-1f14-4014-baf3-784dd0f5ef18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:de:76', 'vm-uuid': '70e52f06-4f2a-4431-8149-2228565072e6'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: INFO os_vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:de:76,bridge_name='br-int',has_traffic_filtering=True,id=7c0a6d7c-1f14-4014-baf3-784dd0f5ef18,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0a6d7c-1f')
Oct 20 08:53:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "address": "fa:16:3e:14:f4:6b", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bf8dcb-50", "ovs_interfaceid": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "address": "fa:16:3e:14:f4:6b", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bf8dcb-50", "ovs_interfaceid": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=90bf8dcb-50f9-4f4b-a743-07754de5bddf,network=Network(9ca3c2dc-7c79-4df0-938f-ff05c3de9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bf8dcb-50') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG os_vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=90bf8dcb-50f9-4f4b-a743-07754de5bddf,network=Network(9ca3c2dc-7c79-4df0-938f-ff05c3de9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bf8dcb-50') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0222374-1e35-5410-95d1-de1e3664f239', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90bf8dcb-50, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90bf8dcb-50, col_values=(('qos', UUID('c09f2be5-33cb-4760-a918-deb5a105d9f6')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90bf8dcb-50, col_values=(('external_ids', {'iface-id': '90bf8dcb-50f9-4f4b-a743-07754de5bddf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:f4:6b', 'vm-uuid': '70e52f06-4f2a-4431-8149-2228565072e6'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: INFO os_vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=90bf8dcb-50f9-4f4b-a743-07754de5bddf,network=Network(9ca3c2dc-7c79-4df0-938f-ff05c3de9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bf8dcb-50')
Oct 20 08:53:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "address": "fa:16:3e:b7:1c:11", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ec0b8d-c5", "ovs_interfaceid": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "address": "fa:16:3e:b7:1c:11", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ec0b8d-c5", "ovs_interfaceid": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:1c:11,bridge_name='br-int',has_traffic_filtering=True,id=a2ec0b8d-c5ed-4f71-9b28-76b48949f029,network=Network(9ca3c2dc-7c79-4df0-938f-ff05c3de9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ec0b8d-c5') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG os_vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:1c:11,bridge_name='br-int',has_traffic_filtering=True,id=a2ec0b8d-c5ed-4f71-9b28-76b48949f029,network=Network(9ca3c2dc-7c79-4df0-938f-ff05c3de9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ec0b8d-c5') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffa61adc-7818-5351-8f65-538bdcc4c3c3', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2ec0b8d-c5, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2ec0b8d-c5, col_values=(('qos', UUID('e810e511-1857-463b-84dd-2abfe7b299a4')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2ec0b8d-c5, col_values=(('external_ids', {'iface-id': 'a2ec0b8d-c5ed-4f71-9b28-76b48949f029', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:1c:11', 'vm-uuid': '70e52f06-4f2a-4431-8149-2228565072e6'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:16 user nova-compute[74039]: INFO os_vif [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:1c:11,bridge_name='br-int',has_traffic_filtering=True,id=a2ec0b8d-c5ed-4f71-9b28-76b48949f029,network=Network(9ca3c2dc-7c79-4df0-938f-ff05c3de9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ec0b8d-c5')
Oct 20 08:53:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] No BDM found with device name hda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] No VIF found with MAC fa:16:3e:63:9f:0c, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:53:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] No VIF found with MAC fa:16:3e:7d:de:76, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:53:16 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Using config drive
Oct 20 08:53:17 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-500a0ed6-ac37-4274-a8f2-2545c270e24b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-500a0ed6-ac37-4274-a8f2-2545c270e24b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 08:53:17 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Creating config drive at /opt/stack/data/nova/instances/70e52f06-4f2a-4431-8149-2228565072e6/disk.config
Oct 20 08:53:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/70e52f06-4f2a-4431-8149-2228565072e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsv2j7n9b {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/70e52f06-4f2a-4431-8149-2228565072e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsv2j7n9b" returned: 0 in 0.087s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Updating instance_info_cache with network_info: [{"id": "32230627-2f50-465b-a608-a88969f6408e", "address": "fa:16:3e:d0:00:0b", "network": {"id": "0e446eb7-aecd-4543-8e09-3b3805b2a25c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-708280870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96471e080e8d4674aadc99f0892074a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32230627-2f", "ovs_interfaceid": "32230627-2f50-465b-a608-a88969f6408e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-500a0ed6-ac37-4274-a8f2-2545c270e24b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:17 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 08:53:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:19 user nova-compute[74039]: DEBUG nova.compute.manager [req-1c77ea63-4adc-46bd-90e8-56de7a742c1d req-ec827531-6159-4d45-82c6-bf0e084cade9 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-559c1e42-8d19-4a1a-b6e9-385cb497a7df {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1c77ea63-4adc-46bd-90e8-56de7a742c1d req-ec827531-6159-4d45-82c6-bf0e084cade9 service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1c77ea63-4adc-46bd-90e8-56de7a742c1d req-ec827531-6159-4d45-82c6-bf0e084cade9 service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1c77ea63-4adc-46bd-90e8-56de7a742c1d req-ec827531-6159-4d45-82c6-bf0e084cade9 service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:19 user nova-compute[74039]: DEBUG nova.compute.manager [req-1c77ea63-4adc-46bd-90e8-56de7a742c1d req-ec827531-6159-4d45-82c6-bf0e084cade9 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-559c1e42-8d19-4a1a-b6e9-385cb497a7df {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:19 user nova-compute[74039]: WARNING nova.compute.manager [req-1c77ea63-4adc-46bd-90e8-56de7a742c1d req-ec827531-6159-4d45-82c6-bf0e084cade9 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-559c1e42-8d19-4a1a-b6e9-385cb497a7df for instance with vm_state building and task_state spawning.
Oct 20 08:53:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-9bf364e0-0d7c-4024-b7d8-980aa0399226 req-2810f489-614a-41cf-8a2b-0820886d701b service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-7c0a6d7c-1f14-4014-baf3-784dd0f5ef18 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9bf364e0-0d7c-4024-b7d8-980aa0399226 req-2810f489-614a-41cf-8a2b-0820886d701b service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9bf364e0-0d7c-4024-b7d8-980aa0399226 req-2810f489-614a-41cf-8a2b-0820886d701b service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9bf364e0-0d7c-4024-b7d8-980aa0399226 req-2810f489-614a-41cf-8a2b-0820886d701b service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-9bf364e0-0d7c-4024-b7d8-980aa0399226 req-2810f489-614a-41cf-8a2b-0820886d701b service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-7c0a6d7c-1f14-4014-baf3-784dd0f5ef18 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:20 user nova-compute[74039]: WARNING nova.compute.manager [req-9bf364e0-0d7c-4024-b7d8-980aa0399226 req-2810f489-614a-41cf-8a2b-0820886d701b service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-7c0a6d7c-1f14-4014-baf3-784dd0f5ef18 for instance with vm_state building and task_state spawning.
Oct 20 08:53:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-d099be02-cc5f-4bad-a588-3199c25c80af req-853d794a-5c9f-4334-80be-4b9bdec23dd6 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-559c1e42-8d19-4a1a-b6e9-385cb497a7df {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d099be02-cc5f-4bad-a588-3199c25c80af req-853d794a-5c9f-4334-80be-4b9bdec23dd6 service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d099be02-cc5f-4bad-a588-3199c25c80af req-853d794a-5c9f-4334-80be-4b9bdec23dd6 service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d099be02-cc5f-4bad-a588-3199c25c80af req-853d794a-5c9f-4334-80be-4b9bdec23dd6 service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-d099be02-cc5f-4bad-a588-3199c25c80af req-853d794a-5c9f-4334-80be-4b9bdec23dd6 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-559c1e42-8d19-4a1a-b6e9-385cb497a7df {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:21 user nova-compute[74039]: WARNING nova.compute.manager [req-d099be02-cc5f-4bad-a588-3199c25c80af req-853d794a-5c9f-4334-80be-4b9bdec23dd6 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-559c1e42-8d19-4a1a-b6e9-385cb497a7df for instance with vm_state building and task_state spawning.
Oct 20 08:53:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG nova.compute.manager [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:53:22 user nova-compute[74039]: INFO nova.compute.claims [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Claim successful on node user
Oct 20 08:53:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG nova.compute.manager [req-00952aa9-9e4b-405e-a405-6770a8cc15a3 req-e1488166-3684-4f8d-88ae-a0be9f4d1045 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-7c0a6d7c-1f14-4014-baf3-784dd0f5ef18 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-00952aa9-9e4b-405e-a405-6770a8cc15a3 req-e1488166-3684-4f8d-88ae-a0be9f4d1045 service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-00952aa9-9e4b-405e-a405-6770a8cc15a3 req-e1488166-3684-4f8d-88ae-a0be9f4d1045 service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-00952aa9-9e4b-405e-a405-6770a8cc15a3 req-e1488166-3684-4f8d-88ae-a0be9f4d1045 service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG nova.compute.manager [req-00952aa9-9e4b-405e-a405-6770a8cc15a3 req-e1488166-3684-4f8d-88ae-a0be9f4d1045 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-7c0a6d7c-1f14-4014-baf3-784dd0f5ef18 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:22 user nova-compute[74039]: WARNING nova.compute.manager [req-00952aa9-9e4b-405e-a405-6770a8cc15a3 req-e1488166-3684-4f8d-88ae-a0be9f4d1045 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-7c0a6d7c-1f14-4014-baf3-784dd0f5ef18 for instance with vm_state building and task_state spawning.
Oct 20 08:53:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.733s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG nova.compute.manager [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 08:53:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG nova.network.neutron [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:53:23 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 08:53:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG nova.policy [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3e2da79669b41bea6e6a166c7c4a513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb463233344f65b2657a952c24d331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:53:23 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Creating image(s)
Oct 20 08:53:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "/opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "/opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "/opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.197s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.338s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:53:23 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Instance spawned successfully.
Oct 20 08:53:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:53:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.266s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk 1073741824" returned: 0 in 0.111s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:24 user nova-compute[74039]: INFO nova.compute.manager [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Took 13.22 seconds to spawn the instance on the hypervisor.
Oct 20 08:53:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.402s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG nova.compute.manager [req-493761d4-275f-47e8-bff7-0d7da32eb204 req-35b4a572-c14b-42bb-a6af-238094a81a6e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-1e9c8977-ca97-4285-b762-d5ceb5f701ef {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-493761d4-275f-47e8-bff7-0d7da32eb204 req-35b4a572-c14b-42bb-a6af-238094a81a6e service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-493761d4-275f-47e8-bff7-0d7da32eb204 req-35b4a572-c14b-42bb-a6af-238094a81a6e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-493761d4-275f-47e8-bff7-0d7da32eb204 req-35b4a572-c14b-42bb-a6af-238094a81a6e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG nova.compute.manager [req-493761d4-275f-47e8-bff7-0d7da32eb204 req-35b4a572-c14b-42bb-a6af-238094a81a6e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-1e9c8977-ca97-4285-b762-d5ceb5f701ef {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:24 user nova-compute[74039]: WARNING nova.compute.manager [req-493761d4-275f-47e8-bff7-0d7da32eb204 req-35b4a572-c14b-42bb-a6af-238094a81a6e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-1e9c8977-ca97-4285-b762-d5ceb5f701ef for instance with vm_state building and task_state spawning.
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:24 user nova-compute[74039]: INFO nova.compute.manager [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Took 162.86 seconds to build instance.
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.213s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-392e7b4e-0d17-4b29-8aa1-b395762658a2 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "70e52f06-4f2a-4431-8149-2228565072e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 162.991s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Cannot resize image /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Ensure instance console log exists: /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:24 user nova-compute[74039]: DEBUG nova.network.neutron [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Successfully created port: b57e8401-da94-4880-b515-65198826312a {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:53:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk.rescue --force-share --output=json" returned: 0 in 0.315s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk.rescue --force-share --output=json" returned: 0 in 0.265s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:53:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Successfully updated port: b57e8401-da94-4880-b515-65198826312a {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:53:26 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:53:26 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7835MB free_disk=25.76882553100586GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "refresh_cache-3625b19d-4394-4feb-bbe8-55a2d86dd7fb" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquired lock "refresh_cache-3625b19d-4394-4feb-bbe8-55a2d86dd7fb" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-1e9c8977-ca97-4285-b762-d5ceb5f701ef {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-1e9c8977-ca97-4285-b762-d5ceb5f701ef {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:26 user nova-compute[74039]: WARNING nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-1e9c8977-ca97-4285-b762-d5ceb5f701ef for instance with vm_state active and task_state None.
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-aa5d3f5c-ff64-4554-9ecb-b9e14730d29a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-aa5d3f5c-ff64-4554-9ecb-b9e14730d29a {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:26 user nova-compute[74039]: WARNING nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-aa5d3f5c-ff64-4554-9ecb-b9e14730d29a for instance with vm_state active and task_state None.
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-aa5d3f5c-ff64-4554-9ecb-b9e14730d29a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-aa5d3f5c-ff64-4554-9ecb-b9e14730d29a {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:26 user nova-compute[74039]: WARNING nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-aa5d3f5c-ff64-4554-9ecb-b9e14730d29a for instance with vm_state active and task_state None.
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-ea5ca163-f56a-49dc-ba70-a18ab6e4cd11 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-ea5ca163-f56a-49dc-ba70-a18ab6e4cd11 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:26 user nova-compute[74039]: WARNING nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-ea5ca163-f56a-49dc-ba70-a18ab6e4cd11 for instance with vm_state active and task_state None.
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-ea5ca163-f56a-49dc-ba70-a18ab6e4cd11 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-ea5ca163-f56a-49dc-ba70-a18ab6e4cd11 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:26 user nova-compute[74039]: WARNING nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-ea5ca163-f56a-49dc-ba70-a18ab6e4cd11 for instance with vm_state active and task_state None.
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-90bf8dcb-50f9-4f4b-a743-07754de5bddf {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-90bf8dcb-50f9-4f4b-a743-07754de5bddf {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:26 user nova-compute[74039]: WARNING nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-90bf8dcb-50f9-4f4b-a743-07754de5bddf for instance with vm_state active and task_state None.
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-90bf8dcb-50f9-4f4b-a743-07754de5bddf {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-90bf8dcb-50f9-4f4b-a743-07754de5bddf {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:26 user nova-compute[74039]: WARNING nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-90bf8dcb-50f9-4f4b-a743-07754de5bddf for instance with vm_state active and task_state None.
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Received event network-changed-b57e8401-da94-4880-b515-65198826312a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Refreshing instance network info cache due to event network-changed-b57e8401-da94-4880-b515-65198826312a. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Acquiring lock "refresh_cache-3625b19d-4394-4feb-bbe8-55a2d86dd7fb" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 9fe77a96-fcb5-4410-85cc-58d925548e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c8054dbd-c0ae-45d2-af95-dae7d05f8c69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 971fb41b-7fce-4ffe-b785-5d86f435004a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 500a0ed6-ac37-4274-a8f2-2545c270e24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 70e52f06-4f2a-4431-8149-2228565072e6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 913d6d22-a50f-457a-b1d2-9b978838b2a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 3625b19d-4394-4feb-bbe8-55a2d86dd7fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Updating instance_info_cache with network_info: [{"id": "b57e8401-da94-4880-b515-65198826312a", "address": "fa:16:3e:54:60:7c", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57e8401-da", "ovs_interfaceid": "b57e8401-da94-4880-b515-65198826312a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Releasing lock "refresh_cache-3625b19d-4394-4feb-bbe8-55a2d86dd7fb" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Instance network_info: |[{"id": "b57e8401-da94-4880-b515-65198826312a", "address": "fa:16:3e:54:60:7c", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57e8401-da", "ovs_interfaceid": "b57e8401-da94-4880-b515-65198826312a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Acquired lock "refresh_cache-3625b19d-4394-4feb-bbe8-55a2d86dd7fb" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.network.neutron [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Refreshing network info cache for port b57e8401-da94-4880-b515-65198826312a {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Start _get_guest_xml network_info=[{"id": "b57e8401-da94-4880-b515-65198826312a", "address": "fa:16:3e:54:60:7c", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57e8401-da", "ovs_interfaceid": "b57e8401-da94-4880-b515-65198826312a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:53:26 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:53:26 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:53:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-740764200',display_name='tempest-VolumesAdminNegativeTest-server-740764200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-740764200',id=12,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQEp0P+G1VK3fQcfWne/LntHgp/xEIDDIvCcEznYUwgm53tzKdQcw8SsfIGAr4cUYTSXFdzSYeFO4hfki+8D8Q91BWsNK4tJz28pHACQOnDeecjH62qCoHurCO/memc0Q==',key_name='tempest-keypair-148658676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61eb463233344f65b2657a952c24d331',ramdisk_id='',reservation_id='r-b3x25oou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-772182177',owner_user_name='tempest-VolumesAdminNegativeTest-772182177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:53:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3e2da79669b41bea6e6a166c7c4a513',uuid=3625b19d-4394-4feb-bbe8-55a2d86dd7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b57e8401-da94-4880-b515-65198826312a", "address": "fa:16:3e:54:60:7c", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57e8401-da", "ovs_interfaceid": "b57e8401-da94-4880-b515-65198826312a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Converting VIF {"id": "b57e8401-da94-4880-b515-65198826312a", "address": "fa:16:3e:54:60:7c", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57e8401-da", "ovs_interfaceid": "b57e8401-da94-4880-b515-65198826312a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:60:7c,bridge_name='br-int',has_traffic_filtering=True,id=b57e8401-da94-4880-b515-65198826312a,network=Network(5d45b218-0125-40ea-9e08-64f416fc77ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb57e8401-da') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:53:26 user nova-compute[74039]: DEBUG nova.objects.instance [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lazy-loading 'pci_devices' on Instance uuid 3625b19d-4394-4feb-bbe8-55a2d86dd7fb {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:53:27 user nova-compute[74039]:   <uuid>3625b19d-4394-4feb-bbe8-55a2d86dd7fb</uuid>
Oct 20 08:53:27 user nova-compute[74039]:   <name>instance-0000000c</name>
Oct 20 08:53:27 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:53:27 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:53:27 user nova-compute[74039]:   <metadata>
Oct 20 08:53:27 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:53:27 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:53:27 user nova-compute[74039]:       <nova:name>tempest-VolumesAdminNegativeTest-server-740764200</nova:name>
Oct 20 08:53:27 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:53:26</nova:creationTime>
Oct 20 08:53:27 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:53:27 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:53:27 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:53:27 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:53:27 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:53:27 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:53:27 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:53:27 user nova-compute[74039]:       <nova:owner>
Oct 20 08:53:27 user nova-compute[74039]:         <nova:user uuid="d3e2da79669b41bea6e6a166c7c4a513">tempest-VolumesAdminNegativeTest-772182177-project-member</nova:user>
Oct 20 08:53:27 user nova-compute[74039]:         <nova:project uuid="61eb463233344f65b2657a952c24d331">tempest-VolumesAdminNegativeTest-772182177</nova:project>
Oct 20 08:53:27 user nova-compute[74039]:       </nova:owner>
Oct 20 08:53:27 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:53:27 user nova-compute[74039]:       <nova:ports>
Oct 20 08:53:27 user nova-compute[74039]:         <nova:port uuid="b57e8401-da94-4880-b515-65198826312a">
Oct 20 08:53:27 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 08:53:27 user nova-compute[74039]:         </nova:port>
Oct 20 08:53:27 user nova-compute[74039]:       </nova:ports>
Oct 20 08:53:27 user nova-compute[74039]:     </nova:instance>
Oct 20 08:53:27 user nova-compute[74039]:   </metadata>
Oct 20 08:53:27 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:53:27 user nova-compute[74039]:     <system>
Oct 20 08:53:27 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:53:27 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:53:27 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:53:27 user nova-compute[74039]:       <entry name="serial">3625b19d-4394-4feb-bbe8-55a2d86dd7fb</entry>
Oct 20 08:53:27 user nova-compute[74039]:       <entry name="uuid">3625b19d-4394-4feb-bbe8-55a2d86dd7fb</entry>
Oct 20 08:53:27 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:53:27 user nova-compute[74039]:     </system>
Oct 20 08:53:27 user nova-compute[74039]:   </sysinfo>
Oct 20 08:53:27 user nova-compute[74039]:   <os>
Oct 20 08:53:27 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:53:27 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:53:27 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:53:27 user nova-compute[74039]:   </os>
Oct 20 08:53:27 user nova-compute[74039]:   <features>
Oct 20 08:53:27 user nova-compute[74039]:     <acpi/>
Oct 20 08:53:27 user nova-compute[74039]:     <apic/>
Oct 20 08:53:27 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:53:27 user nova-compute[74039]:   </features>
Oct 20 08:53:27 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:53:27 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:53:27 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:53:27 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:53:27 user nova-compute[74039]:   </clock>
Oct 20 08:53:27 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:53:27 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:53:27 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:53:27 user nova-compute[74039]:   </cpu>
Oct 20 08:53:27 user nova-compute[74039]:   <devices>
Oct 20 08:53:27 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:53:27 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:53:27 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk"/>
Oct 20 08:53:27 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:53:27 user nova-compute[74039]:     </disk>
Oct 20 08:53:27 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:53:27 user nova-compute[74039]:       <mac address="fa:16:3e:54:60:7c"/>
Oct 20 08:53:27 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:53:27 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:53:27 user nova-compute[74039]:       <target dev="tapb57e8401-da"/>
Oct 20 08:53:27 user nova-compute[74039]:     </interface>
Oct 20 08:53:27 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:53:27 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/console.log" append="off"/>
Oct 20 08:53:27 user nova-compute[74039]:     </serial>
Oct 20 08:53:27 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:53:27 user nova-compute[74039]:     <video>
Oct 20 08:53:27 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:53:27 user nova-compute[74039]:     </video>
Oct 20 08:53:27 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:53:27 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:53:27 user nova-compute[74039]:     </rng>
Oct 20 08:53:27 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:53:27 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:53:27 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:53:27 user nova-compute[74039]:     </memballoon>
Oct 20 08:53:27 user nova-compute[74039]:   </devices>
Oct 20 08:53:27 user nova-compute[74039]: </domain>
Oct 20 08:53:27 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:53:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-740764200',display_name='tempest-VolumesAdminNegativeTest-server-740764200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-740764200',id=12,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQEp0P+G1VK3fQcfWne/LntHgp/xEIDDIvCcEznYUwgm53tzKdQcw8SsfIGAr4cUYTSXFdzSYeFO4hfki+8D8Q91BWsNK4tJz28pHACQOnDeecjH62qCoHurCO/memc0Q==',key_name='tempest-keypair-148658676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61eb463233344f65b2657a952c24d331',ramdisk_id='',reservation_id='r-b3x25oou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-772182177',owner_user_name='tempest-VolumesAdminNegativeTest-772182177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:53:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3e2da79669b41bea6e6a166c7c4a513',uuid=3625b19d-4394-4feb-bbe8-55a2d86dd7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b57e8401-da94-4880-b515-65198826312a", "address": "fa:16:3e:54:60:7c", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57e8401-da", "ovs_interfaceid": "b57e8401-da94-4880-b515-65198826312a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Converting VIF {"id": "b57e8401-da94-4880-b515-65198826312a", "address": "fa:16:3e:54:60:7c", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57e8401-da", "ovs_interfaceid": "b57e8401-da94-4880-b515-65198826312a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:60:7c,bridge_name='br-int',has_traffic_filtering=True,id=b57e8401-da94-4880-b515-65198826312a,network=Network(5d45b218-0125-40ea-9e08-64f416fc77ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb57e8401-da') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG os_vif [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:60:7c,bridge_name='br-int',has_traffic_filtering=True,id=b57e8401-da94-4880-b515-65198826312a,network=Network(5d45b218-0125-40ea-9e08-64f416fc77ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb57e8401-da') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21aaee31-7e62-5d10-9437-b530620fc41f', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb57e8401-da, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb57e8401-da, col_values=(('qos', UUID('c12d750d-82eb-4368-84f9-824c87d49e0e')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb57e8401-da, col_values=(('external_ids', {'iface-id': 'b57e8401-da94-4880-b515-65198826312a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:60:7c', 'vm-uuid': '3625b19d-4394-4feb-bbe8-55a2d86dd7fb'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:27 user nova-compute[74039]: INFO os_vif [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:60:7c,bridge_name='br-int',has_traffic_filtering=True,id=b57e8401-da94-4880-b515-65198826312a,network=Network(5d45b218-0125-40ea-9e08-64f416fc77ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb57e8401-da')
Oct 20 08:53:27 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.649s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] No VIF found with MAC fa:16:3e:54:60:7c, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG nova.network.neutron [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Updated VIF entry in instance network info cache for port b57e8401-da94-4880-b515-65198826312a. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG nova.network.neutron [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Updating instance_info_cache with network_info: [{"id": "b57e8401-da94-4880-b515-65198826312a", "address": "fa:16:3e:54:60:7c", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57e8401-da", "ovs_interfaceid": "b57e8401-da94-4880-b515-65198826312a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Releasing lock "refresh_cache-3625b19d-4394-4feb-bbe8-55a2d86dd7fb" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-a2ec0b8d-c5ed-4f71-9b28-76b48949f029 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-a2ec0b8d-c5ed-4f71-9b28-76b48949f029 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:27 user nova-compute[74039]: WARNING nova.compute.manager [req-a21a1841-99ab-469f-995e-247308f1b406 req-f3a115fd-ccad-4d20-9ebc-d378e6d9433e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-a2ec0b8d-c5ed-4f71-9b28-76b48949f029 for instance with vm_state active and task_state None.
Oct 20 08:53:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-68cddaaa-b617-48ed-ac81-333b16e47900 req-33c23742-3b86-4b59-ad30-da08841fc2c9 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-a2ec0b8d-c5ed-4f71-9b28-76b48949f029 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-68cddaaa-b617-48ed-ac81-333b16e47900 req-33c23742-3b86-4b59-ad30-da08841fc2c9 service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-68cddaaa-b617-48ed-ac81-333b16e47900 req-33c23742-3b86-4b59-ad30-da08841fc2c9 service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-68cddaaa-b617-48ed-ac81-333b16e47900 req-33c23742-3b86-4b59-ad30-da08841fc2c9 service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-68cddaaa-b617-48ed-ac81-333b16e47900 req-33c23742-3b86-4b59-ad30-da08841fc2c9 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-a2ec0b8d-c5ed-4f71-9b28-76b48949f029 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:28 user nova-compute[74039]: WARNING nova.compute.manager [req-68cddaaa-b617-48ed-ac81-333b16e47900 req-33c23742-3b86-4b59-ad30-da08841fc2c9 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-a2ec0b8d-c5ed-4f71-9b28-76b48949f029 for instance with vm_state active and task_state None.
Oct 20 08:53:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-af0c1261-d83f-4cd7-bac1-d02ec812367c req-07aa384c-7673-4348-a574-82dd0e037f7b service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Received event network-vif-plugged-b57e8401-da94-4880-b515-65198826312a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-af0c1261-d83f-4cd7-bac1-d02ec812367c req-07aa384c-7673-4348-a574-82dd0e037f7b service nova] Acquiring lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-af0c1261-d83f-4cd7-bac1-d02ec812367c req-07aa384c-7673-4348-a574-82dd0e037f7b service nova] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-af0c1261-d83f-4cd7-bac1-d02ec812367c req-07aa384c-7673-4348-a574-82dd0e037f7b service nova] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-af0c1261-d83f-4cd7-bac1-d02ec812367c req-07aa384c-7673-4348-a574-82dd0e037f7b service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] No waiting events found dispatching network-vif-plugged-b57e8401-da94-4880-b515-65198826312a {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:28 user nova-compute[74039]: WARNING nova.compute.manager [req-af0c1261-d83f-4cd7-bac1-d02ec812367c req-07aa384c-7673-4348-a574-82dd0e037f7b service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Received unexpected event network-vif-plugged-b57e8401-da94-4880-b515-65198826312a for instance with vm_state building and task_state spawning.
Oct 20 08:53:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-c7f6f702-c989-4a51-88bc-0a203531aeb1 req-d4691159-5c62-440d-af23-3addad8f00b1 service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Received event network-vif-plugged-b57e8401-da94-4880-b515-65198826312a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c7f6f702-c989-4a51-88bc-0a203531aeb1 req-d4691159-5c62-440d-af23-3addad8f00b1 service nova] Acquiring lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c7f6f702-c989-4a51-88bc-0a203531aeb1 req-d4691159-5c62-440d-af23-3addad8f00b1 service nova] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c7f6f702-c989-4a51-88bc-0a203531aeb1 req-d4691159-5c62-440d-af23-3addad8f00b1 service nova] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-c7f6f702-c989-4a51-88bc-0a203531aeb1 req-d4691159-5c62-440d-af23-3addad8f00b1 service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] No waiting events found dispatching network-vif-plugged-b57e8401-da94-4880-b515-65198826312a {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:30 user nova-compute[74039]: WARNING nova.compute.manager [req-c7f6f702-c989-4a51-88bc-0a203531aeb1 req-d4691159-5c62-440d-af23-3addad8f00b1 service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Received unexpected event network-vif-plugged-b57e8401-da94-4880-b515-65198826312a for instance with vm_state building and task_state spawning.
Oct 20 08:53:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:53:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:53:31 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Instance spawned successfully.
Oct 20 08:53:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:53:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:53:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:53:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:53:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:53:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:53:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:53:31 user nova-compute[74039]: INFO nova.compute.manager [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Took 7.87 seconds to spawn the instance on the hypervisor.
Oct 20 08:53:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:53:31 user nova-compute[74039]: INFO nova.compute.manager [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Took 9.31 seconds to build instance.
Oct 20 08:53:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-06a81ded-42aa-40a5-9b95-9ae9caefb9f8 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.492s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:31 user nova-compute[74039]: DEBUG nova.objects.instance [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lazy-loading 'flavor' on Instance uuid 500a0ed6-ac37-4274-a8f2-2545c270e24b {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:53:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d647854b-af31-40f8-9207-663447d35540 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 39.114s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Acquiring lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Acquiring lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:43 user nova-compute[74039]: INFO nova.compute.manager [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Terminating instance
Oct 20 08:53:43 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 08:53:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG nova.compute.manager [req-075b13b4-039a-44d9-91bd-2a88c343abb7 req-e2e214e2-ea06-480b-8b11-a99720162872 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Received event network-vif-unplugged-32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-075b13b4-039a-44d9-91bd-2a88c343abb7 req-e2e214e2-ea06-480b-8b11-a99720162872 service nova] Acquiring lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-075b13b4-039a-44d9-91bd-2a88c343abb7 req-e2e214e2-ea06-480b-8b11-a99720162872 service nova] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-075b13b4-039a-44d9-91bd-2a88c343abb7 req-e2e214e2-ea06-480b-8b11-a99720162872 service nova] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG nova.compute.manager [req-075b13b4-039a-44d9-91bd-2a88c343abb7 req-e2e214e2-ea06-480b-8b11-a99720162872 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] No waiting events found dispatching network-vif-unplugged-32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG nova.compute.manager [req-075b13b4-039a-44d9-91bd-2a88c343abb7 req-e2e214e2-ea06-480b-8b11-a99720162872 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Received event network-vif-unplugged-32230627-2f50-465b-a608-a88969f6408e for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:44 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Instance destroyed successfully.
Oct 20 08:53:44 user nova-compute[74039]: DEBUG nova.objects.instance [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lazy-loading 'resources' on Instance uuid 500a0ed6-ac37-4274-a8f2-2545c270e24b {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:48:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1172293144',display_name='tempest-TestVolumeSwap-server-1172293144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1172293144',id=6,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRToobScdUtb7+3jcjSVHCJFxZqv94QJIssqH90Y7pl1sV4pKMkmRJsjji0AWhgMeZy/foe0zo/uxuGWroHhJGC83k5pE7k23SX95ebtFtmvCGOnEFWukNkghf9brY2SQ==',key_name='tempest-keypair-1350799647',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:48:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96471e080e8d4674aadc99f0892074a0',ramdisk_id='',reservation_id='r-vqd97vzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2141757371',owner_user_name='tempest-TestVolumeSwap-2141757371-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4558306dac14220ab1b0006eda962de',uuid=500a0ed6-ac37-4274-a8f2-2545c270e24b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32230627-2f50-465b-a608-a88969f6408e", "address": "fa:16:3e:d0:00:0b", "network": {"id": "0e446eb7-aecd-4543-8e09-3b3805b2a25c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-708280870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96471e080e8d4674aadc99f0892074a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32230627-2f", "ovs_interfaceid": "32230627-2f50-465b-a608-a88969f6408e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Converting VIF {"id": "32230627-2f50-465b-a608-a88969f6408e", "address": "fa:16:3e:d0:00:0b", "network": {"id": "0e446eb7-aecd-4543-8e09-3b3805b2a25c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-708280870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96471e080e8d4674aadc99f0892074a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32230627-2f", "ovs_interfaceid": "32230627-2f50-465b-a608-a88969f6408e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:00:0b,bridge_name='br-int',has_traffic_filtering=True,id=32230627-2f50-465b-a608-a88969f6408e,network=Network(0e446eb7-aecd-4543-8e09-3b3805b2a25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32230627-2f') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG os_vif [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:00:0b,bridge_name='br-int',has_traffic_filtering=True,id=32230627-2f50-465b-a608-a88969f6408e,network=Network(0e446eb7-aecd-4543-8e09-3b3805b2a25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32230627-2f') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32230627-2f, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f2b0849-aa36-41f2-8c31-c48f9ebe9cfd) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:44 user nova-compute[74039]: INFO os_vif [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:00:0b,bridge_name='br-int',has_traffic_filtering=True,id=32230627-2f50-465b-a608-a88969f6408e,network=Network(0e446eb7-aecd-4543-8e09-3b3805b2a25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32230627-2f')
Oct 20 08:53:44 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Deleting instance files /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b_del
Oct 20 08:53:44 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Deletion of /opt/stack/data/nova/instances/500a0ed6-ac37-4274-a8f2-2545c270e24b_del complete
Oct 20 08:53:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:44 user nova-compute[74039]: INFO nova.compute.manager [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Took 1.05 seconds to destroy the instance on the hypervisor.
Oct 20 08:53:44 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 08:53:44 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 08:53:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Received event network-vif-plugged-32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] Acquiring lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] No waiting events found dispatching network-vif-plugged-32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:46 user nova-compute[74039]: WARNING nova.compute.manager [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Received unexpected event network-vif-plugged-32230627-2f50-465b-a608-a88969f6408e for instance with vm_state active and task_state deleting.
Oct 20 08:53:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Received event network-vif-plugged-32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] Acquiring lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] No waiting events found dispatching network-vif-plugged-32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:46 user nova-compute[74039]: WARNING nova.compute.manager [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Received unexpected event network-vif-plugged-32230627-2f50-465b-a608-a88969f6408e for instance with vm_state active and task_state deleting.
Oct 20 08:53:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Received event network-vif-plugged-32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] Acquiring lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] No waiting events found dispatching network-vif-plugged-32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:46 user nova-compute[74039]: WARNING nova.compute.manager [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Received unexpected event network-vif-plugged-32230627-2f50-465b-a608-a88969f6408e for instance with vm_state active and task_state deleting.
Oct 20 08:53:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Received event network-vif-unplugged-32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] Acquiring lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] No waiting events found dispatching network-vif-unplugged-32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-eba0bc98-dc0b-4cd6-8a8c-efbb389a1c04 req-d4e1133a-2135-419a-97fb-d61523802a70 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Received event network-vif-unplugged-32230627-2f50-465b-a608-a88969f6408e for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:53:46 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Took 1.65 seconds to deallocate network for instance.
Oct 20 08:53:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:53:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:46 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Deleted allocations for instance 500a0ed6-ac37-4274-a8f2-2545c270e24b
Oct 20 08:53:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4237bc3c-6b00-432f-86ef-405f3b6ffe60 tempest-TestVolumeSwap-2141757371 tempest-TestVolumeSwap-2141757371-project-member] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.212s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:48 user nova-compute[74039]: DEBUG nova.compute.manager [req-4e2602e7-924c-4eb3-bec3-def5fdda0e74 req-e5118843-bf99-4fc1-9a09-196e61b6e293 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Received event network-vif-plugged-32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4e2602e7-924c-4eb3-bec3-def5fdda0e74 req-e5118843-bf99-4fc1-9a09-196e61b6e293 service nova] Acquiring lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:53:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4e2602e7-924c-4eb3-bec3-def5fdda0e74 req-e5118843-bf99-4fc1-9a09-196e61b6e293 service nova] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:53:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4e2602e7-924c-4eb3-bec3-def5fdda0e74 req-e5118843-bf99-4fc1-9a09-196e61b6e293 service nova] Lock "500a0ed6-ac37-4274-a8f2-2545c270e24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:53:48 user nova-compute[74039]: DEBUG nova.compute.manager [req-4e2602e7-924c-4eb3-bec3-def5fdda0e74 req-e5118843-bf99-4fc1-9a09-196e61b6e293 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] No waiting events found dispatching network-vif-plugged-32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:53:48 user nova-compute[74039]: WARNING nova.compute.manager [req-4e2602e7-924c-4eb3-bec3-def5fdda0e74 req-e5118843-bf99-4fc1-9a09-196e61b6e293 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Received unexpected event network-vif-plugged-32230627-2f50-465b-a608-a88969f6408e for instance with vm_state deleted and task_state None.
Oct 20 08:53:48 user nova-compute[74039]: DEBUG nova.compute.manager [req-4e2602e7-924c-4eb3-bec3-def5fdda0e74 req-e5118843-bf99-4fc1-9a09-196e61b6e293 service nova] [instance: 500a0ed6-ac37-4274-a8f2-2545c270e24b] Received event network-vif-deleted-32230627-2f50-465b-a608-a88969f6408e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:53:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:53:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-35fd65c5-1755-4b47-a555-c037ede144cd req-726e2a94-bed5-46b2-ab47-a841fda0e61b service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Received event network-changed-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-35fd65c5-1755-4b47-a555-c037ede144cd req-726e2a94-bed5-46b2-ab47-a841fda0e61b service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Refreshing instance network info cache due to event network-changed-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:54:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-35fd65c5-1755-4b47-a555-c037ede144cd req-726e2a94-bed5-46b2-ab47-a841fda0e61b service nova] Acquiring lock "refresh_cache-54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:54:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-35fd65c5-1755-4b47-a555-c037ede144cd req-726e2a94-bed5-46b2-ab47-a841fda0e61b service nova] Acquired lock "refresh_cache-54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:54:00 user nova-compute[74039]: DEBUG nova.network.neutron [req-35fd65c5-1755-4b47-a555-c037ede144cd req-726e2a94-bed5-46b2-ab47-a841fda0e61b service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Refreshing network info cache for port 8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:54:00 user nova-compute[74039]: DEBUG nova.network.neutron [req-35fd65c5-1755-4b47-a555-c037ede144cd req-726e2a94-bed5-46b2-ab47-a841fda0e61b service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Updated VIF entry in instance network info cache for port 8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:54:00 user nova-compute[74039]: DEBUG nova.network.neutron [req-35fd65c5-1755-4b47-a555-c037ede144cd req-726e2a94-bed5-46b2-ab47-a841fda0e61b service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Updating instance_info_cache with network_info: [{"id": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "address": "fa:16:3e:38:e8:6c", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9df57e-7c", "ovs_interfaceid": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:54:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-35fd65c5-1755-4b47-a555-c037ede144cd req-726e2a94-bed5-46b2-ab47-a841fda0e61b service nova] Releasing lock "refresh_cache-54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:54:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:00 user nova-compute[74039]: DEBUG nova.objects.instance [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lazy-loading 'flavor' on Instance uuid 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:54:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:01 user nova-compute[74039]: INFO nova.compute.manager [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Attaching volume 4e26a4a0-8c25-4f88-915d-503058b5464a to /dev/vdb
Oct 20 08:54:01 user nova-compute[74039]: DEBUG os_brick.utils [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a302d6d9-e60e-4030-89dd-0cafb71300b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc526ed4-e8a3-4e5d-96b2-efcc1ed4e498]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f645fa60-8408-4d83-bbd1-af6c9d874d28]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f74fc9-16b8-4231-9821-15a7cf021f20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:54:01 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:54:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[566ca05f-f816-4365-aef6-4ea25066d076]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG os_brick.utils [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] <== get_connector_properties: return (309ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:54:01 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Updating existing volume attachment record: 3c9e9100-3d51-4a6a-a01b-bb6642cf8b38 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 08:54:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-119bd2c7-8377-4982-8a5a-c89d6d5aa4ef req-be8e4e7a-202c-4d77-9d81-b97e1e983515 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-changed-89a71dec-6bb5-448c-8bc6-81c4c2096518 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-119bd2c7-8377-4982-8a5a-c89d6d5aa4ef req-be8e4e7a-202c-4d77-9d81-b97e1e983515 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Refreshing instance network info cache due to event network-changed-89a71dec-6bb5-448c-8bc6-81c4c2096518. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:54:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-119bd2c7-8377-4982-8a5a-c89d6d5aa4ef req-be8e4e7a-202c-4d77-9d81-b97e1e983515 service nova] Acquiring lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:54:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-119bd2c7-8377-4982-8a5a-c89d6d5aa4ef req-be8e4e7a-202c-4d77-9d81-b97e1e983515 service nova] Acquired lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:54:02 user nova-compute[74039]: DEBUG nova.network.neutron [req-119bd2c7-8377-4982-8a5a-c89d6d5aa4ef req-be8e4e7a-202c-4d77-9d81-b97e1e983515 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Refreshing network info cache for port 89a71dec-6bb5-448c-8bc6-81c4c2096518 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:54:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:03 user nova-compute[74039]: DEBUG nova.network.neutron [req-119bd2c7-8377-4982-8a5a-c89d6d5aa4ef req-be8e4e7a-202c-4d77-9d81-b97e1e983515 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Updated VIF entry in instance network info cache for port 89a71dec-6bb5-448c-8bc6-81c4c2096518. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:54:03 user nova-compute[74039]: DEBUG nova.network.neutron [req-119bd2c7-8377-4982-8a5a-c89d6d5aa4ef req-be8e4e7a-202c-4d77-9d81-b97e1e983515 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Updating instance_info_cache with network_info: [{"id": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "address": "fa:16:3e:27:23:4b", "network": {"id": "723ba7d9-d7fc-4535-a2f6-1b39dc49a17b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915355671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a71dec-6b", "ovs_interfaceid": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1c8f7b72-7806-406d-9d21-a8193be01c97", "address": "fa:16:3e:df:20:46", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8f7b72-78", "ovs_interfaceid": "1c8f7b72-7806-406d-9d21-a8193be01c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "address": "fa:16:3e:7c:fd:34", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25aacf0-64", "ovs_interfaceid": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "address": "fa:16:3e:bf:f8:b5", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dced799-a2", "ovs_interfaceid": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "154a5063-b927-47c2-b08c-9073addff7ce", "address": "fa:16:3e:0b:46:4c", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154a5063-b9", "ovs_interfaceid": "154a5063-b927-47c2-b08c-9073addff7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b722390-36c0-4a62-a055-b8db6a876107", "address": "fa:16:3e:c8:55:48", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b722390-36", "ovs_interfaceid": "7b722390-36c0-4a62-a055-b8db6a876107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "address": "fa:16:3e:8e:3a:c0", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce3df1d-10", "ovs_interfaceid": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:54:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-119bd2c7-8377-4982-8a5a-c89d6d5aa4ef req-be8e4e7a-202c-4d77-9d81-b97e1e983515 service nova] Releasing lock "refresh_cache-913d6d22-a50f-457a-b1d2-9b978838b2a3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:54:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:05 user nova-compute[74039]: INFO nova.compute.manager [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Terminating instance
Oct 20 08:54:05 user nova-compute[74039]: DEBUG nova.compute.manager [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG nova.compute.manager [req-0470511c-a224-4f08-b1bf-48263495e81f req-572633e3-a4af-4aef-a4a9-7d2697b857da service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-unplugged-89a71dec-6bb5-448c-8bc6-81c4c2096518 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0470511c-a224-4f08-b1bf-48263495e81f req-572633e3-a4af-4aef-a4a9-7d2697b857da service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0470511c-a224-4f08-b1bf-48263495e81f req-572633e3-a4af-4aef-a4a9-7d2697b857da service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0470511c-a224-4f08-b1bf-48263495e81f req-572633e3-a4af-4aef-a4a9-7d2697b857da service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG nova.compute.manager [req-0470511c-a224-4f08-b1bf-48263495e81f req-572633e3-a4af-4aef-a4a9-7d2697b857da service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-unplugged-89a71dec-6bb5-448c-8bc6-81c4c2096518 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG nova.compute.manager [req-0470511c-a224-4f08-b1bf-48263495e81f req-572633e3-a4af-4aef-a4a9-7d2697b857da service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-unplugged-89a71dec-6bb5-448c-8bc6-81c4c2096518 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG nova.compute.manager [req-43eacd68-0c87-402d-90d1-5e8ca6f96ee4 req-d18841af-9fb5-4697-a003-8604b7920543 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-unplugged-1c8f7b72-7806-406d-9d21-a8193be01c97 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-43eacd68-0c87-402d-90d1-5e8ca6f96ee4 req-d18841af-9fb5-4697-a003-8604b7920543 service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-43eacd68-0c87-402d-90d1-5e8ca6f96ee4 req-d18841af-9fb5-4697-a003-8604b7920543 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-43eacd68-0c87-402d-90d1-5e8ca6f96ee4 req-d18841af-9fb5-4697-a003-8604b7920543 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG nova.compute.manager [req-43eacd68-0c87-402d-90d1-5e8ca6f96ee4 req-d18841af-9fb5-4697-a003-8604b7920543 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-unplugged-1c8f7b72-7806-406d-9d21-a8193be01c97 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG nova.compute.manager [req-43eacd68-0c87-402d-90d1-5e8ca6f96ee4 req-d18841af-9fb5-4697-a003-8604b7920543 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-unplugged-1c8f7b72-7806-406d-9d21-a8193be01c97 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:06 user nova-compute[74039]: DEBUG nova.compute.manager [req-0b38e90f-f552-474f-95cf-e0b32568bf9c req-b4289549-f5eb-4aa3-855f-81eb408eb24c service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-unplugged-7b722390-36c0-4a62-a055-b8db6a876107 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0b38e90f-f552-474f-95cf-e0b32568bf9c req-b4289549-f5eb-4aa3-855f-81eb408eb24c service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0b38e90f-f552-474f-95cf-e0b32568bf9c req-b4289549-f5eb-4aa3-855f-81eb408eb24c service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0b38e90f-f552-474f-95cf-e0b32568bf9c req-b4289549-f5eb-4aa3-855f-81eb408eb24c service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:06 user nova-compute[74039]: DEBUG nova.compute.manager [req-0b38e90f-f552-474f-95cf-e0b32568bf9c req-b4289549-f5eb-4aa3-855f-81eb408eb24c service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-unplugged-7b722390-36c0-4a62-a055-b8db6a876107 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:06 user nova-compute[74039]: DEBUG nova.compute.manager [req-0b38e90f-f552-474f-95cf-e0b32568bf9c req-b4289549-f5eb-4aa3-855f-81eb408eb24c service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-unplugged-7b722390-36c0-4a62-a055-b8db6a876107 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:54:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Instance destroyed successfully.
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.objects.instance [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lazy-loading 'resources' on Instance uuid 913d6d22-a50f-457a-b1d2-9b978838b2a3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:52:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "address": "fa:16:3e:27:23:4b", "network": {"id": "723ba7d9-d7fc-4535-a2f6-1b39dc49a17b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915355671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a71dec-6b", "ovs_interfaceid": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "address": "fa:16:3e:27:23:4b", "network": {"id": "723ba7d9-d7fc-4535-a2f6-1b39dc49a17b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915355671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a71dec-6b", "ovs_interfaceid": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:23:4b,bridge_name='br-int',has_traffic_filtering=True,id=89a71dec-6bb5-448c-8bc6-81c4c2096518,network=Network(723ba7d9-d7fc-4535-a2f6-1b39dc49a17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a71dec-6b') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:23:4b,bridge_name='br-int',has_traffic_filtering=True,id=89a71dec-6bb5-448c-8bc6-81c4c2096518,network=Network(723ba7d9-d7fc-4535-a2f6-1b39dc49a17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a71dec-6b') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89a71dec-6b, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97c94b87-5de8-4022-be25-8441ad087b6a) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: INFO os_vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:23:4b,bridge_name='br-int',has_traffic_filtering=True,id=89a71dec-6bb5-448c-8bc6-81c4c2096518,network=Network(723ba7d9-d7fc-4535-a2f6-1b39dc49a17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a71dec-6b')
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:52:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c8f7b72-7806-406d-9d21-a8193be01c97", "address": "fa:16:3e:df:20:46", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8f7b72-78", "ovs_interfaceid": "1c8f7b72-7806-406d-9d21-a8193be01c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "1c8f7b72-7806-406d-9d21-a8193be01c97", "address": "fa:16:3e:df:20:46", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8f7b72-78", "ovs_interfaceid": "1c8f7b72-7806-406d-9d21-a8193be01c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:20:46,bridge_name='br-int',has_traffic_filtering=True,id=1c8f7b72-7806-406d-9d21-a8193be01c97,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c8f7b72-78') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:20:46,bridge_name='br-int',has_traffic_filtering=True,id=1c8f7b72-7806-406d-9d21-a8193be01c97,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c8f7b72-78') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c8f7b72-78, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2681360c-8f58-4106-b4d1-b6fe1864e031) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: INFO os_vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:20:46,bridge_name='br-int',has_traffic_filtering=True,id=1c8f7b72-7806-406d-9d21-a8193be01c97,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1c8f7b72-78')
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:52:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "address": "fa:16:3e:7c:fd:34", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25aacf0-64", "ovs_interfaceid": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "address": "fa:16:3e:7c:fd:34", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25aacf0-64", "ovs_interfaceid": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:fd:34,bridge_name='br-int',has_traffic_filtering=True,id=a25aacf0-6498-44b2-aff7-c6aa628dd132,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa25aacf0-64') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:fd:34,bridge_name='br-int',has_traffic_filtering=True,id=a25aacf0-6498-44b2-aff7-c6aa628dd132,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa25aacf0-64') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa25aacf0-64, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7875973-bd37-4532-a0ad-0fad8084b970) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: INFO os_vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:fd:34,bridge_name='br-int',has_traffic_filtering=True,id=a25aacf0-6498-44b2-aff7-c6aa628dd132,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa25aacf0-64')
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:52:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "address": "fa:16:3e:bf:f8:b5", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dced799-a2", "ovs_interfaceid": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "address": "fa:16:3e:bf:f8:b5", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dced799-a2", "ovs_interfaceid": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:f8:b5,bridge_name='br-int',has_traffic_filtering=True,id=4dced799-a2ac-44eb-ac2f-f0f01f78b6c7,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dced799-a2') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:f8:b5,bridge_name='br-int',has_traffic_filtering=True,id=4dced799-a2ac-44eb-ac2f-f0f01f78b6c7,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dced799-a2') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4dced799-a2, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33a58052-6a0e-4b16-84e4-5853ddb329c0) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: INFO os_vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:f8:b5,bridge_name='br-int',has_traffic_filtering=True,id=4dced799-a2ac-44eb-ac2f-f0f01f78b6c7,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dced799-a2')
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:52:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "154a5063-b927-47c2-b08c-9073addff7ce", "address": "fa:16:3e:0b:46:4c", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154a5063-b9", "ovs_interfaceid": "154a5063-b927-47c2-b08c-9073addff7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "154a5063-b927-47c2-b08c-9073addff7ce", "address": "fa:16:3e:0b:46:4c", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154a5063-b9", "ovs_interfaceid": "154a5063-b927-47c2-b08c-9073addff7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:46:4c,bridge_name='br-int',has_traffic_filtering=True,id=154a5063-b927-47c2-b08c-9073addff7ce,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154a5063-b9') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:46:4c,bridge_name='br-int',has_traffic_filtering=True,id=154a5063-b927-47c2-b08c-9073addff7ce,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154a5063-b9') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap154a5063-b9, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=485494ac-7aba-4fed-89d6-e9dabbb3c1af) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-89a71dec-6bb5-448c-8bc6-81c4c2096518 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-89a71dec-6bb5-448c-8bc6-81c4c2096518 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:07 user nova-compute[74039]: WARNING nova.compute.manager [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-89a71dec-6bb5-448c-8bc6-81c4c2096518 for instance with vm_state active and task_state deleting.
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-unplugged-4dced799-a2ac-44eb-ac2f-f0f01f78b6c7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-unplugged-4dced799-a2ac-44eb-ac2f-f0f01f78b6c7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-unplugged-4dced799-a2ac-44eb-ac2f-f0f01f78b6c7 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-4dced799-a2ac-44eb-ac2f-f0f01f78b6c7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-4dced799-a2ac-44eb-ac2f-f0f01f78b6c7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:07 user nova-compute[74039]: WARNING nova.compute.manager [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-4dced799-a2ac-44eb-ac2f-f0f01f78b6c7 for instance with vm_state active and task_state deleting.
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-unplugged-154a5063-b927-47c2-b08c-9073addff7ce {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-unplugged-154a5063-b927-47c2-b08c-9073addff7ce {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-unplugged-154a5063-b927-47c2-b08c-9073addff7ce for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-154a5063-b927-47c2-b08c-9073addff7ce {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-154a5063-b927-47c2-b08c-9073addff7ce {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:07 user nova-compute[74039]: WARNING nova.compute.manager [req-7fa06b49-5976-405b-bcda-2219387875fe req-14318899-b4d9-4fe4-8df3-64039d4fde0b service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-154a5063-b927-47c2-b08c-9073addff7ce for instance with vm_state active and task_state deleting.
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: INFO os_vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:46:4c,bridge_name='br-int',has_traffic_filtering=True,id=154a5063-b927-47c2-b08c-9073addff7ce,network=Network(dbacb5d5-43ea-466e-a342-a903612307c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154a5063-b9')
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:52:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b722390-36c0-4a62-a055-b8db6a876107", "address": "fa:16:3e:c8:55:48", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b722390-36", "ovs_interfaceid": "7b722390-36c0-4a62-a055-b8db6a876107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "7b722390-36c0-4a62-a055-b8db6a876107", "address": "fa:16:3e:c8:55:48", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b722390-36", "ovs_interfaceid": "7b722390-36c0-4a62-a055-b8db6a876107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:55:48,bridge_name='br-int',has_traffic_filtering=True,id=7b722390-36c0-4a62-a055-b8db6a876107,network=Network(138662f4-a000-4df5-833c-fe65e388960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b722390-36') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:55:48,bridge_name='br-int',has_traffic_filtering=True,id=7b722390-36c0-4a62-a055-b8db6a876107,network=Network(138662f4-a000-4df5-833c-fe65e388960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b722390-36') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b722390-36, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f7fcc98-8122-4142-89c8-b100cc532e5a) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: INFO os_vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:55:48,bridge_name='br-int',has_traffic_filtering=True,id=7b722390-36c0-4a62-a055-b8db6a876107,network=Network(138662f4-a000-4df5-833c-fe65e388960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b722390-36')
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1592859451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1592859451',id=10,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp+jJWNA30Omg+JcS++YrcGZtMW8ULlejHmMnbv1JBavYcgPQlmglh5QNkftY9kdlRXm+zVgkmJvO7sk4ILCpnPMIZVKJ+ir8/xOvdzqazLhqEhUviMR+jlJ+FgysCIng==',key_name='tempest-keypair-1165899487',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:52:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a813e975532746078989fb217f969a33',ramdisk_id='',reservation_id='r-ojaghf68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-72787988',owner_user_name='tempest-TaggedBootDevicesTest_v242-72787988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf9b8efde2e542e490d56ab047ab1d60',uuid=913d6d22-a50f-457a-b1d2-9b978838b2a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "address": "fa:16:3e:8e:3a:c0", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce3df1d-10", "ovs_interfaceid": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converting VIF {"id": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "address": "fa:16:3e:8e:3a:c0", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce3df1d-10", "ovs_interfaceid": "2ce3df1d-107d-4fd0-9443-d143cd17dfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:3a:c0,bridge_name='br-int',has_traffic_filtering=True,id=2ce3df1d-107d-4fd0-9443-d143cd17dfe5,network=Network(138662f4-a000-4df5-833c-fe65e388960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce3df1d-10') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:3a:c0,bridge_name='br-int',has_traffic_filtering=True,id=2ce3df1d-107d-4fd0-9443-d143cd17dfe5,network=Network(138662f4-a000-4df5-833c-fe65e388960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce3df1d-10') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ce3df1d-10, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10635127-6afc-4ec1-a14b-b5b4295be0bd) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: INFO os_vif [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:3a:c0,bridge_name='br-int',has_traffic_filtering=True,id=2ce3df1d-107d-4fd0-9443-d143cd17dfe5,network=Network(138662f4-a000-4df5-833c-fe65e388960f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce3df1d-10')
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgwayPoi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:54:07 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46db7e2-0084-4c7d-b10b-09b77ad33a6a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 08:54:07 user nova-compute[74039]: No targets found.
Oct 20 08:54:07 user nova-compute[74039]: iSNS:
Oct 20 08:54:07 user nova-compute[74039]: No targets found.
Oct 20 08:54:07 user nova-compute[74039]: STATIC:
Oct 20 08:54:07 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08
Oct 20 08:54:07 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:54:07 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:54:07 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf
Oct 20 08:54:07 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:54:07 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:54:07 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d
Oct 20 08:54:07 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:54:07 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:54:07 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa
Oct 20 08:54:07 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:54:07 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:54:07 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7
Oct 20 08:54:07 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:54:07 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:54:07 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9
Oct 20 08:54:07 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:54:07 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:54:07 user nova-compute[74039]: FIRMWARE:
Oct 20 08:54:07 user nova-compute[74039]: No targets found.
Oct 20 08:54:07 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 08:54:07 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 08:54:07 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c692abf-c40a-4da0-b580-4ecca07debb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-b1ee8ef2-f089-459a-a263-4f975b53bf31 req-3bde408b-8457-4607-8f7e-2d30375b544c service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-1c8f7b72-7806-406d-9d21-a8193be01c97 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b1ee8ef2-f089-459a-a263-4f975b53bf31 req-3bde408b-8457-4607-8f7e-2d30375b544c service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b1ee8ef2-f089-459a-a263-4f975b53bf31 req-3bde408b-8457-4607-8f7e-2d30375b544c service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b1ee8ef2-f089-459a-a263-4f975b53bf31 req-3bde408b-8457-4607-8f7e-2d30375b544c service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-b1ee8ef2-f089-459a-a263-4f975b53bf31 req-3bde408b-8457-4607-8f7e-2d30375b544c service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-1c8f7b72-7806-406d-9d21-a8193be01c97 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:07 user nova-compute[74039]: WARNING nova.compute.manager [req-b1ee8ef2-f089-459a-a263-4f975b53bf31 req-3bde408b-8457-4607-8f7e-2d30375b544c service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-1c8f7b72-7806-406d-9d21-a8193be01c97 for instance with vm_state active and task_state deleting.
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-b1ee8ef2-f089-459a-a263-4f975b53bf31 req-3bde408b-8457-4607-8f7e-2d30375b544c service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-unplugged-a25aacf0-6498-44b2-aff7-c6aa628dd132 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b1ee8ef2-f089-459a-a263-4f975b53bf31 req-3bde408b-8457-4607-8f7e-2d30375b544c service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b1ee8ef2-f089-459a-a263-4f975b53bf31 req-3bde408b-8457-4607-8f7e-2d30375b544c service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b1ee8ef2-f089-459a-a263-4f975b53bf31 req-3bde408b-8457-4607-8f7e-2d30375b544c service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-b1ee8ef2-f089-459a-a263-4f975b53bf31 req-3bde408b-8457-4607-8f7e-2d30375b544c service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-unplugged-a25aacf0-6498-44b2-aff7-c6aa628dd132 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-b1ee8ef2-f089-459a-a263-4f975b53bf31 req-3bde408b-8457-4607-8f7e-2d30375b544c service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-unplugged-a25aacf0-6498-44b2-aff7-c6aa628dd132 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-b1ee8ef2-f089-459a-a263-4f975b53bf31 req-3bde408b-8457-4607-8f7e-2d30375b544c service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-a25aacf0-6498-44b2-aff7-c6aa628dd132 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b1ee8ef2-f089-459a-a263-4f975b53bf31 req-3bde408b-8457-4607-8f7e-2d30375b544c service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b1ee8ef2-f089-459a-a263-4f975b53bf31 req-3bde408b-8457-4607-8f7e-2d30375b544c service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b1ee8ef2-f089-459a-a263-4f975b53bf31 req-3bde408b-8457-4607-8f7e-2d30375b544c service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-b1ee8ef2-f089-459a-a263-4f975b53bf31 req-3bde408b-8457-4607-8f7e-2d30375b544c service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-a25aacf0-6498-44b2-aff7-c6aa628dd132 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:07 user nova-compute[74039]: WARNING nova.compute.manager [req-b1ee8ef2-f089-459a-a263-4f975b53bf31 req-3bde408b-8457-4607-8f7e-2d30375b544c service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-a25aacf0-6498-44b2-aff7-c6aa628dd132 for instance with vm_state active and task_state deleting.
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14ada0e-19fe-4f62-bbeb-1a153b06ee38]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)
Oct 20 08:54:07 user nova-compute[74039]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)
Oct 20 08:54:07 user nova-compute[74039]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)
Oct 20 08:54:07 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:54:07 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:54:07 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:54:07 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)
Oct 20 08:54:07 user nova-compute[74039]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)
Oct 20 08:54:07 user nova-compute[74039]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)
Oct 20 08:54:07 user nova-compute[74039]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d (non-flash)
Oct 20 08:54:07 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:54:07 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:54:07 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae8456cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d'): ({'sdc'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Removing single pathed devices sdc {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[41adcb0b-9497-4604-9685-7402429968a5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e621110-fbda-4f60-b2eb-dbf9c800c53c]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Flushing IO for device /dev/sdc {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dd5ec9-58b4-411f-8085-b1980540ab54]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[059bcb84-0510-4bc7-90c9-710f1c16b30d]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a00f6ef-1235-4f30-a1d6-8e95f602da2a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a5b7ed-6956-44ae-927a-8190c9317913]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d, portal: 172.16.0.220,3260]
Oct 20 08:54:07 user nova-compute[74039]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d, portal: 172.16.0.220,3260] successful.
Oct 20 08:54:07 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:54:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fbfa24f-aeef-4cda-ac1e-6a051a2e6c5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[04231824-a10b-4753-831a-be85bfd6bb5a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] <== disconnect_volume: return (332ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etxbDzUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:54:08 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf07d32-b6a7-4db8-bf6e-c00a002cb8dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 08:54:08 user nova-compute[74039]: No targets found.
Oct 20 08:54:08 user nova-compute[74039]: iSNS:
Oct 20 08:54:08 user nova-compute[74039]: No targets found.
Oct 20 08:54:08 user nova-compute[74039]: STATIC:
Oct 20 08:54:08 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08
Oct 20 08:54:08 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:54:08 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:54:08 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf
Oct 20 08:54:08 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:54:08 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:54:08 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa
Oct 20 08:54:08 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:54:08 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:54:08 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7
Oct 20 08:54:08 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:54:08 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:54:08 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9
Oct 20 08:54:08 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:54:08 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:54:08 user nova-compute[74039]: FIRMWARE:
Oct 20 08:54:08 user nova-compute[74039]: No targets found.
Oct 20 08:54:08 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 08:54:08 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 08:54:08 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee80ff7-b9cf-4517-b533-f53e957780bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab98b5d-fca0-4816-8b3b-5c7d381192dc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)
Oct 20 08:54:08 user nova-compute[74039]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)
Oct 20 08:54:08 user nova-compute[74039]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)
Oct 20 08:54:08 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:54:08 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:54:08 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)
Oct 20 08:54:08 user nova-compute[74039]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)
Oct 20 08:54:08 user nova-compute[74039]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)
Oct 20 08:54:08 user nova-compute[74039]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf (non-flash)
Oct 20 08:54:08 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:54:08 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae8456cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf'): ({'sdd'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Removing single pathed devices sdd {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[660e30d7-a155-47d8-8812-6a1cd9891900]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2f702d-5741-4068-9d56-1e17dae381c9]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Flushing IO for device /dev/sdd {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2545c96e-6ea7-4554-ac2a-0e33e25e1bab]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[be68168d-7948-4917-8c2d-1e9dae5918f0]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[90308aac-07ff-4736-9d11-bdb43f260085]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.128s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[277da6ec-9f8a-412a-aa25-aadb7e684ce6]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf, portal: 172.16.0.220,3260]
Oct 20 08:54:08 user nova-compute[74039]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf, portal: 172.16.0.220,3260] successful.
Oct 20 08:54:08 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-d8a3cea8-43f8-495b-a99f-cee4c70e1388 req-842c2b22-e4e4-4078-9bde-1cb91c21e1b9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-7b722390-36c0-4a62-a055-b8db6a876107 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d8a3cea8-43f8-495b-a99f-cee4c70e1388 req-842c2b22-e4e4-4078-9bde-1cb91c21e1b9 service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d8a3cea8-43f8-495b-a99f-cee4c70e1388 req-842c2b22-e4e4-4078-9bde-1cb91c21e1b9 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d8a3cea8-43f8-495b-a99f-cee4c70e1388 req-842c2b22-e4e4-4078-9bde-1cb91c21e1b9 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-d8a3cea8-43f8-495b-a99f-cee4c70e1388 req-842c2b22-e4e4-4078-9bde-1cb91c21e1b9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-7b722390-36c0-4a62-a055-b8db6a876107 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:08 user nova-compute[74039]: WARNING nova.compute.manager [req-d8a3cea8-43f8-495b-a99f-cee4c70e1388 req-842c2b22-e4e4-4078-9bde-1cb91c21e1b9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-7b722390-36c0-4a62-a055-b8db6a876107 for instance with vm_state active and task_state deleting.
Oct 20 08:54:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-d8a3cea8-43f8-495b-a99f-cee4c70e1388 req-842c2b22-e4e4-4078-9bde-1cb91c21e1b9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-unplugged-2ce3df1d-107d-4fd0-9443-d143cd17dfe5 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d8a3cea8-43f8-495b-a99f-cee4c70e1388 req-842c2b22-e4e4-4078-9bde-1cb91c21e1b9 service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d8a3cea8-43f8-495b-a99f-cee4c70e1388 req-842c2b22-e4e4-4078-9bde-1cb91c21e1b9 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d8a3cea8-43f8-495b-a99f-cee4c70e1388 req-842c2b22-e4e4-4078-9bde-1cb91c21e1b9 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-d8a3cea8-43f8-495b-a99f-cee4c70e1388 req-842c2b22-e4e4-4078-9bde-1cb91c21e1b9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-unplugged-2ce3df1d-107d-4fd0-9443-d143cd17dfe5 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-d8a3cea8-43f8-495b-a99f-cee4c70e1388 req-842c2b22-e4e4-4078-9bde-1cb91c21e1b9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-unplugged-2ce3df1d-107d-4fd0-9443-d143cd17dfe5 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-d8a3cea8-43f8-495b-a99f-cee4c70e1388 req-842c2b22-e4e4-4078-9bde-1cb91c21e1b9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-plugged-2ce3df1d-107d-4fd0-9443-d143cd17dfe5 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d8a3cea8-43f8-495b-a99f-cee4c70e1388 req-842c2b22-e4e4-4078-9bde-1cb91c21e1b9 service nova] Acquiring lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d8a3cea8-43f8-495b-a99f-cee4c70e1388 req-842c2b22-e4e4-4078-9bde-1cb91c21e1b9 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d8a3cea8-43f8-495b-a99f-cee4c70e1388 req-842c2b22-e4e4-4078-9bde-1cb91c21e1b9 service nova] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-d8a3cea8-43f8-495b-a99f-cee4c70e1388 req-842c2b22-e4e4-4078-9bde-1cb91c21e1b9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] No waiting events found dispatching network-vif-plugged-2ce3df1d-107d-4fd0-9443-d143cd17dfe5 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:08 user nova-compute[74039]: WARNING nova.compute.manager [req-d8a3cea8-43f8-495b-a99f-cee4c70e1388 req-842c2b22-e4e4-4078-9bde-1cb91c21e1b9 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received unexpected event network-vif-plugged-2ce3df1d-107d-4fd0-9443-d143cd17dfe5 for instance with vm_state active and task_state deleting.
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0edc0db-2f45-4846-9357-4aec238a54cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.081s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76eeae6-2a7f-44f0-a317-bdbe8d7b8ad1]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.447s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] <== disconnect_volume: return (448ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNMmcXaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:54:08 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[483ddb08-79a3-4b3d-8a96-7cdca502ae61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 08:54:08 user nova-compute[74039]: No targets found.
Oct 20 08:54:08 user nova-compute[74039]: iSNS:
Oct 20 08:54:08 user nova-compute[74039]: No targets found.
Oct 20 08:54:08 user nova-compute[74039]: STATIC:
Oct 20 08:54:08 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08
Oct 20 08:54:08 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:54:08 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:54:08 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa
Oct 20 08:54:08 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:54:08 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:54:08 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7
Oct 20 08:54:08 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:54:08 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:54:08 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9
Oct 20 08:54:08 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:54:08 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:54:08 user nova-compute[74039]: FIRMWARE:
Oct 20 08:54:08 user nova-compute[74039]: No targets found.
Oct 20 08:54:08 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 08:54:08 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 08:54:08 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87d8e43-e4f5-421f-a212-56c5635176ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a54543-d7b8-4e5b-827b-d6f11fb8a165]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)
Oct 20 08:54:08 user nova-compute[74039]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)
Oct 20 08:54:08 user nova-compute[74039]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)
Oct 20 08:54:08 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:54:08 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)
Oct 20 08:54:08 user nova-compute[74039]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)
Oct 20 08:54:08 user nova-compute[74039]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)
Oct 20 08:54:08 user nova-compute[74039]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 (non-flash)
Oct 20 08:54:08 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae841e2050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9'): ({'sde'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Removing single pathed devices sde {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae36cb5-0cdd-4dd3-b4f2-d213b4bbe7e1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7571ca73-0034-442e-942a-2992dd0784a4]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Flushing IO for device /dev/sde {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d802f2e1-a517-41db-b094-e1472e1e7474]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[992a0e12-dd52-4db1-b71c-845ab398285c]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] SCSI volumes sde have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b90b06-b8de-4505-aa8e-8727c6b2f857]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28cd474-2a86-4727-a2fa-ec560441943e]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9, portal: 172.16.0.220,3260]
Oct 20 08:54:08 user nova-compute[74039]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9, portal: 172.16.0.220,3260] successful.
Oct 20 08:54:08 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2afe51e-0277-429a-b298-bf51979c57c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f8ff90-64c2-4468-939d-ac0e04b29212]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] <== disconnect_volume: return (332ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 08:54:08 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Deleting instance files /opt/stack/data/nova/instances/913d6d22-a50f-457a-b1d2-9b978838b2a3_del
Oct 20 08:54:08 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Deletion of /opt/stack/data/nova/instances/913d6d22-a50f-457a-b1d2-9b978838b2a3_del complete
Oct 20 08:54:08 user nova-compute[74039]: INFO nova.compute.manager [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Took 3.70 seconds to destroy the instance on the hypervisor.
Oct 20 08:54:08 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 08:54:08 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 08:54:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:09 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:54:09 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Cleaning up deleted instances {{(pid=74039) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 08:54:09 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] There are 0 instances to clean {{(pid=74039) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 08:54:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-627e46e9-07b5-415b-8e9b-503d05e810b3 req-37b195e7-0e07-4d62-b89e-a19ae51c5e23 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-deleted-2ce3df1d-107d-4fd0-9443-d143cd17dfe5 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:11 user nova-compute[74039]: INFO nova.compute.manager [req-627e46e9-07b5-415b-8e9b-503d05e810b3 req-37b195e7-0e07-4d62-b89e-a19ae51c5e23 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Neutron deleted interface 2ce3df1d-107d-4fd0-9443-d143cd17dfe5; detaching it from the instance and deleting it from the info cache
Oct 20 08:54:11 user nova-compute[74039]: DEBUG nova.network.neutron [req-627e46e9-07b5-415b-8e9b-503d05e810b3 req-37b195e7-0e07-4d62-b89e-a19ae51c5e23 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Updating instance_info_cache with network_info: [{"id": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "address": "fa:16:3e:27:23:4b", "network": {"id": "723ba7d9-d7fc-4535-a2f6-1b39dc49a17b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1915355671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a71dec-6b", "ovs_interfaceid": "89a71dec-6bb5-448c-8bc6-81c4c2096518", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1c8f7b72-7806-406d-9d21-a8193be01c97", "address": "fa:16:3e:df:20:46", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8f7b72-78", "ovs_interfaceid": "1c8f7b72-7806-406d-9d21-a8193be01c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "address": "fa:16:3e:7c:fd:34", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25aacf0-64", "ovs_interfaceid": "a25aacf0-6498-44b2-aff7-c6aa628dd132", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "address": "fa:16:3e:bf:f8:b5", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dced799-a2", "ovs_interfaceid": "4dced799-a2ac-44eb-ac2f-f0f01f78b6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "154a5063-b927-47c2-b08c-9073addff7ce", "address": "fa:16:3e:0b:46:4c", "network": {"id": "dbacb5d5-43ea-466e-a342-a903612307c2", "bridge": "br-int", "label": "tempest-device-tagging-net1-1013030707", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154a5063-b9", "ovs_interfaceid": "154a5063-b927-47c2-b08c-9073addff7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b722390-36c0-4a62-a055-b8db6a876107", "address": "fa:16:3e:c8:55:48", "network": {"id": "138662f4-a000-4df5-833c-fe65e388960f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1039455975", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a813e975532746078989fb217f969a33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b722390-36", "ovs_interfaceid": "7b722390-36c0-4a62-a055-b8db6a876107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:54:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-627e46e9-07b5-415b-8e9b-503d05e810b3 req-37b195e7-0e07-4d62-b89e-a19ae51c5e23 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Detach interface failed, port_id=2ce3df1d-107d-4fd0-9443-d143cd17dfe5, reason: Instance 913d6d22-a50f-457a-b1d2-9b978838b2a3 could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 08:54:11 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:54:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:12 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:54:12 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:54:12 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:54:12 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Took 3.90 seconds to deallocate network for instance.
Oct 20 08:54:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-df313450-1673-4f4a-8745-8c60561914ad req-a23e267a-8a54-46ce-8c3e-89abfb1f0881 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-deleted-154a5063-b927-47c2-b08c-9073addff7ce {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-df313450-1673-4f4a-8745-8c60561914ad req-a23e267a-8a54-46ce-8c3e-89abfb1f0881 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-deleted-89a71dec-6bb5-448c-8bc6-81c4c2096518 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-df313450-1673-4f4a-8745-8c60561914ad req-a23e267a-8a54-46ce-8c3e-89abfb1f0881 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-deleted-4dced799-a2ac-44eb-ac2f-f0f01f78b6c7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-df313450-1673-4f4a-8745-8c60561914ad req-a23e267a-8a54-46ce-8c3e-89abfb1f0881 service nova] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Received event network-vif-deleted-7b722390-36c0-4a62-a055-b8db6a876107 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:13 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:54:13 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:54:13 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:54:13 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 08:54:14 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:54:14 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 08:54:14 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Didn't find any instances for network info cache update. {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 08:54:15 user nova-compute[74039]: INFO nova.compute.manager [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] [instance: 913d6d22-a50f-457a-b1d2-9b978838b2a3] Took 2.57 seconds to detach 3 volumes for instance.
Oct 20 08:54:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:15 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:54:15 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:54:15 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:54:16 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:54:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.600s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:16 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Deleted allocations for instance 913d6d22-a50f-457a-b1d2-9b978838b2a3
Oct 20 08:54:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-bf108ca0-b245-46a1-8d2a-f162c4fee8b6 tempest-TaggedBootDevicesTest_v242-72787988 tempest-TaggedBootDevicesTest_v242-72787988-project-member] Lock "913d6d22-a50f-457a-b1d2-9b978838b2a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.964s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:18 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:54:18 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:54:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:18 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 08:54:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 08:54:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 08:54:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 08:54:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:54:22 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:54:22 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:54:22 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7749MB free_disk=25.75323486328125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 08:54:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:23 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 9fe77a96-fcb5-4410-85cc-58d925548e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:54:23 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c8054dbd-c0ae-45d2-af95-dae7d05f8c69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:54:23 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:54:23 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 971fb41b-7fce-4ffe-b785-5d86f435004a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:54:23 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 70e52f06-4f2a-4431-8149-2228565072e6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:54:23 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:54:23 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 3625b19d-4394-4feb-bbe8-55a2d86dd7fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:54:23 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 08:54:23 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 08:54:23 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:54:23 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:54:23 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 08:54:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:23 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:54:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74039) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 08:54:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "385b3191-b427-4e5e-af5b-d929fceef331" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "385b3191-b427-4e5e-af5b-d929fceef331" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:25 user nova-compute[74039]: DEBUG nova.compute.manager [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 08:54:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:54:25 user nova-compute[74039]: INFO nova.compute.claims [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Claim successful on node user
Oct 20 08:54:26 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:54:26 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:54:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 08:54:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 08:54:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:54:26 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 08:54:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 08:54:26 user nova-compute[74039]: DEBUG nova.policy [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '907a4bffd1d34559b3dd1ede3be227ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39bff5237c144002a806235775eda215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:54:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 08:54:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:54:26 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Creating image(s)
Oct 20 08:54:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "/opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "/opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "/opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.179s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk 1073741824" returned: 0 in 0.053s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG nova.network.neutron [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Successfully created port: 29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.198s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Checking if we can resize image /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Cannot resize image /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Ensure instance console log exists: /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG nova.network.neutron [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Successfully updated port: 29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "refresh_cache-385b3191-b427-4e5e-af5b-d929fceef331" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquired lock "refresh_cache-385b3191-b427-4e5e-af5b-d929fceef331" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG nova.network.neutron [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-4d1d1880-64af-43ad-93f9-09facce28ea1 req-4e266f8f-6870-481c-8e9f-096c58e9a1d5 service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Received event network-changed-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-4d1d1880-64af-43ad-93f9-09facce28ea1 req-4e266f8f-6870-481c-8e9f-096c58e9a1d5 service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Refreshing instance network info cache due to event network-changed-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4d1d1880-64af-43ad-93f9-09facce28ea1 req-4e266f8f-6870-481c-8e9f-096c58e9a1d5 service nova] Acquiring lock "refresh_cache-385b3191-b427-4e5e-af5b-d929fceef331" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG nova.network.neutron [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.network.neutron [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Updating instance_info_cache with network_info: [{"id": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "address": "fa:16:3e:9e:9f:f3", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29dcf3b3-10", "ovs_interfaceid": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Releasing lock "refresh_cache-385b3191-b427-4e5e-af5b-d929fceef331" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.compute.manager [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Instance network_info: |[{"id": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "address": "fa:16:3e:9e:9f:f3", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29dcf3b3-10", "ovs_interfaceid": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4d1d1880-64af-43ad-93f9-09facce28ea1 req-4e266f8f-6870-481c-8e9f-096c58e9a1d5 service nova] Acquired lock "refresh_cache-385b3191-b427-4e5e-af5b-d929fceef331" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.network.neutron [req-4d1d1880-64af-43ad-93f9-09facce28ea1 req-4e266f8f-6870-481c-8e9f-096c58e9a1d5 service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Refreshing network info cache for port 29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Start _get_guest_xml network_info=[{"id": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "address": "fa:16:3e:9e:9f:f3", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29dcf3b3-10", "ovs_interfaceid": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:54:28 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:54:28 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:54:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-504878641',display_name='tempest-AttachVolumeTestJSON-server-504878641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-504878641',id=13,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLS3l701zIWi6t7ikkUcypzWlohXMgEFdpYdszeQ2nU4VwrrWO8ypzkHJVXJYcI9nq1J6R8qzBqHONtT5AefhEkpXdP5ub4OpujENRBAQBMdVyBMgQiKU91gOtT0KJ5ZzA==',key_name='tempest-keypair-659986505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39bff5237c144002a806235775eda215',ramdisk_id='',reservation_id='r-psy0n3r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1630150217',owner_user_name='tempest-AttachVolumeTestJSON-1630150217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:54:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='907a4bffd1d34559b3dd1ede3be227ee',uuid=385b3191-b427-4e5e-af5b-d929fceef331,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "address": "fa:16:3e:9e:9f:f3", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29dcf3b3-10", "ovs_interfaceid": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Converting VIF {"id": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "address": "fa:16:3e:9e:9f:f3", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29dcf3b3-10", "ovs_interfaceid": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9f:f3,bridge_name='br-int',has_traffic_filtering=True,id=29dcf3b3-1006-42c8-9cb1-5ed5cb792b06,network=Network(07b19de8-22c5-4d12-86ed-3e443540c21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29dcf3b3-10') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.objects.instance [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lazy-loading 'pci_devices' on Instance uuid 385b3191-b427-4e5e-af5b-d929fceef331 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:54:28 user nova-compute[74039]:   <uuid>385b3191-b427-4e5e-af5b-d929fceef331</uuid>
Oct 20 08:54:28 user nova-compute[74039]:   <name>instance-0000000d</name>
Oct 20 08:54:28 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:54:28 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:54:28 user nova-compute[74039]:   <metadata>
Oct 20 08:54:28 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:54:28 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:54:28 user nova-compute[74039]:       <nova:name>tempest-AttachVolumeTestJSON-server-504878641</nova:name>
Oct 20 08:54:28 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:54:28</nova:creationTime>
Oct 20 08:54:28 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:54:28 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:54:28 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:54:28 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:54:28 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:54:28 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:54:28 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:54:28 user nova-compute[74039]:       <nova:owner>
Oct 20 08:54:28 user nova-compute[74039]:         <nova:user uuid="907a4bffd1d34559b3dd1ede3be227ee">tempest-AttachVolumeTestJSON-1630150217-project-member</nova:user>
Oct 20 08:54:28 user nova-compute[74039]:         <nova:project uuid="39bff5237c144002a806235775eda215">tempest-AttachVolumeTestJSON-1630150217</nova:project>
Oct 20 08:54:28 user nova-compute[74039]:       </nova:owner>
Oct 20 08:54:28 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:54:28 user nova-compute[74039]:       <nova:ports>
Oct 20 08:54:28 user nova-compute[74039]:         <nova:port uuid="29dcf3b3-1006-42c8-9cb1-5ed5cb792b06">
Oct 20 08:54:28 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 08:54:28 user nova-compute[74039]:         </nova:port>
Oct 20 08:54:28 user nova-compute[74039]:       </nova:ports>
Oct 20 08:54:28 user nova-compute[74039]:     </nova:instance>
Oct 20 08:54:28 user nova-compute[74039]:   </metadata>
Oct 20 08:54:28 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:54:28 user nova-compute[74039]:     <system>
Oct 20 08:54:28 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:54:28 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:54:28 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:54:28 user nova-compute[74039]:       <entry name="serial">385b3191-b427-4e5e-af5b-d929fceef331</entry>
Oct 20 08:54:28 user nova-compute[74039]:       <entry name="uuid">385b3191-b427-4e5e-af5b-d929fceef331</entry>
Oct 20 08:54:28 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:54:28 user nova-compute[74039]:     </system>
Oct 20 08:54:28 user nova-compute[74039]:   </sysinfo>
Oct 20 08:54:28 user nova-compute[74039]:   <os>
Oct 20 08:54:28 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:54:28 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:54:28 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:54:28 user nova-compute[74039]:   </os>
Oct 20 08:54:28 user nova-compute[74039]:   <features>
Oct 20 08:54:28 user nova-compute[74039]:     <acpi/>
Oct 20 08:54:28 user nova-compute[74039]:     <apic/>
Oct 20 08:54:28 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:54:28 user nova-compute[74039]:   </features>
Oct 20 08:54:28 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:54:28 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:54:28 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:54:28 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:54:28 user nova-compute[74039]:   </clock>
Oct 20 08:54:28 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:54:28 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:54:28 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:54:28 user nova-compute[74039]:   </cpu>
Oct 20 08:54:28 user nova-compute[74039]:   <devices>
Oct 20 08:54:28 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:54:28 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:54:28 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk"/>
Oct 20 08:54:28 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:54:28 user nova-compute[74039]:     </disk>
Oct 20 08:54:28 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:54:28 user nova-compute[74039]:       <mac address="fa:16:3e:9e:9f:f3"/>
Oct 20 08:54:28 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:54:28 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:54:28 user nova-compute[74039]:       <target dev="tap29dcf3b3-10"/>
Oct 20 08:54:28 user nova-compute[74039]:     </interface>
Oct 20 08:54:28 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:54:28 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/console.log" append="off"/>
Oct 20 08:54:28 user nova-compute[74039]:     </serial>
Oct 20 08:54:28 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:54:28 user nova-compute[74039]:     <video>
Oct 20 08:54:28 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:54:28 user nova-compute[74039]:     </video>
Oct 20 08:54:28 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:54:28 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:54:28 user nova-compute[74039]:     </rng>
Oct 20 08:54:28 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:54:28 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:54:28 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:54:28 user nova-compute[74039]:     </memballoon>
Oct 20 08:54:28 user nova-compute[74039]:   </devices>
Oct 20 08:54:28 user nova-compute[74039]: </domain>
Oct 20 08:54:28 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:54:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-504878641',display_name='tempest-AttachVolumeTestJSON-server-504878641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-504878641',id=13,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLS3l701zIWi6t7ikkUcypzWlohXMgEFdpYdszeQ2nU4VwrrWO8ypzkHJVXJYcI9nq1J6R8qzBqHONtT5AefhEkpXdP5ub4OpujENRBAQBMdVyBMgQiKU91gOtT0KJ5ZzA==',key_name='tempest-keypair-659986505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39bff5237c144002a806235775eda215',ramdisk_id='',reservation_id='r-psy0n3r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1630150217',owner_user_name='tempest-AttachVolumeTestJSON-1630150217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:54:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='907a4bffd1d34559b3dd1ede3be227ee',uuid=385b3191-b427-4e5e-af5b-d929fceef331,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "address": "fa:16:3e:9e:9f:f3", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29dcf3b3-10", "ovs_interfaceid": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Converting VIF {"id": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "address": "fa:16:3e:9e:9f:f3", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29dcf3b3-10", "ovs_interfaceid": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9f:f3,bridge_name='br-int',has_traffic_filtering=True,id=29dcf3b3-1006-42c8-9cb1-5ed5cb792b06,network=Network(07b19de8-22c5-4d12-86ed-3e443540c21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29dcf3b3-10') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG os_vif [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9f:f3,bridge_name='br-int',has_traffic_filtering=True,id=29dcf3b3-1006-42c8-9cb1-5ed5cb792b06,network=Network(07b19de8-22c5-4d12-86ed-3e443540c21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29dcf3b3-10') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11ffc58b-3103-5b34-95da-2fa245af2d96', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29dcf3b3-10, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29dcf3b3-10, col_values=(('qos', UUID('c88abb1f-f5b3-4223-a828-0c95ec6fdd37')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29dcf3b3-10, col_values=(('external_ids', {'iface-id': '29dcf3b3-1006-42c8-9cb1-5ed5cb792b06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:9f:f3', 'vm-uuid': '385b3191-b427-4e5e-af5b-d929fceef331'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:28 user nova-compute[74039]: INFO os_vif [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9f:f3,bridge_name='br-int',has_traffic_filtering=True,id=29dcf3b3-1006-42c8-9cb1-5ed5cb792b06,network=Network(07b19de8-22c5-4d12-86ed-3e443540c21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29dcf3b3-10')
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] No VIF found with MAC fa:16:3e:9e:9f:f3, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.network.neutron [req-4d1d1880-64af-43ad-93f9-09facce28ea1 req-4e266f8f-6870-481c-8e9f-096c58e9a1d5 service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Updated VIF entry in instance network info cache for port 29dcf3b3-1006-42c8-9cb1-5ed5cb792b06. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG nova.network.neutron [req-4d1d1880-64af-43ad-93f9-09facce28ea1 req-4e266f8f-6870-481c-8e9f-096c58e9a1d5 service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Updating instance_info_cache with network_info: [{"id": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "address": "fa:16:3e:9e:9f:f3", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29dcf3b3-10", "ovs_interfaceid": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:54:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4d1d1880-64af-43ad-93f9-09facce28ea1 req-4e266f8f-6870-481c-8e9f-096c58e9a1d5 service nova] Releasing lock "refresh_cache-385b3191-b427-4e5e-af5b-d929fceef331" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:54:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-a27a4e41-d292-4df3-a405-ef96d83b4723 req-9de9da3f-feda-4561-bda9-ff7e3198efdd service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Received event network-vif-plugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a27a4e41-d292-4df3-a405-ef96d83b4723 req-9de9da3f-feda-4561-bda9-ff7e3198efdd service nova] Acquiring lock "385b3191-b427-4e5e-af5b-d929fceef331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a27a4e41-d292-4df3-a405-ef96d83b4723 req-9de9da3f-feda-4561-bda9-ff7e3198efdd service nova] Lock "385b3191-b427-4e5e-af5b-d929fceef331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a27a4e41-d292-4df3-a405-ef96d83b4723 req-9de9da3f-feda-4561-bda9-ff7e3198efdd service nova] Lock "385b3191-b427-4e5e-af5b-d929fceef331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-a27a4e41-d292-4df3-a405-ef96d83b4723 req-9de9da3f-feda-4561-bda9-ff7e3198efdd service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] No waiting events found dispatching network-vif-plugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:29 user nova-compute[74039]: WARNING nova.compute.manager [req-a27a4e41-d292-4df3-a405-ef96d83b4723 req-9de9da3f-feda-4561-bda9-ff7e3198efdd service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Received unexpected event network-vif-plugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 for instance with vm_state building and task_state spawning.
Oct 20 08:54:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:54:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:54:31 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Instance spawned successfully.
Oct 20 08:54:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:54:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:54:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:54:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:54:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:54:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:54:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:54:31 user nova-compute[74039]: INFO nova.compute.manager [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Took 5.21 seconds to spawn the instance on the hypervisor.
Oct 20 08:54:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:54:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-6cc36c69-ce29-4fcb-b71f-6eb315187d39 req-80f22af0-cab3-4056-b848-8f9a13004c8c service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Received event network-vif-plugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6cc36c69-ce29-4fcb-b71f-6eb315187d39 req-80f22af0-cab3-4056-b848-8f9a13004c8c service nova] Acquiring lock "385b3191-b427-4e5e-af5b-d929fceef331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6cc36c69-ce29-4fcb-b71f-6eb315187d39 req-80f22af0-cab3-4056-b848-8f9a13004c8c service nova] Lock "385b3191-b427-4e5e-af5b-d929fceef331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6cc36c69-ce29-4fcb-b71f-6eb315187d39 req-80f22af0-cab3-4056-b848-8f9a13004c8c service nova] Lock "385b3191-b427-4e5e-af5b-d929fceef331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-6cc36c69-ce29-4fcb-b71f-6eb315187d39 req-80f22af0-cab3-4056-b848-8f9a13004c8c service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] No waiting events found dispatching network-vif-plugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:31 user nova-compute[74039]: WARNING nova.compute.manager [req-6cc36c69-ce29-4fcb-b71f-6eb315187d39 req-80f22af0-cab3-4056-b848-8f9a13004c8c service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Received unexpected event network-vif-plugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 for instance with vm_state building and task_state spawning.
Oct 20 08:54:31 user nova-compute[74039]: INFO nova.compute.manager [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Took 5.90 seconds to build instance.
Oct 20 08:54:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-851c3d6a-2841-4802-9ec5-6576c1169331 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "385b3191-b427-4e5e-af5b-d929fceef331" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.991s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:54:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 08:54:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 08:54:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 08:54:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid 9fe77a96-fcb5-4410-85cc-58d925548e03 {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid c8054dbd-c0ae-45d2-af95-dae7d05f8c69 {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid 971fb41b-7fce-4ffe-b785-5d86f435004a {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid 70e52f06-4f2a-4431-8149-2228565072e6 {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid 3625b19d-4394-4feb-bbe8-55a2d86dd7fb {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid 385b3191-b427-4e5e-af5b-d929fceef331 {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "971fb41b-7fce-4ffe-b785-5d86f435004a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "971fb41b-7fce-4ffe-b785-5d86f435004a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "70e52f06-4f2a-4431-8149-2228565072e6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "385b3191-b427-4e5e-af5b-d929fceef331" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "385b3191-b427-4e5e-af5b-d929fceef331" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "971fb41b-7fce-4ffe-b785-5d86f435004a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "385b3191-b427-4e5e-af5b-d929fceef331" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "70e52f06-4f2a-4431-8149-2228565072e6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.142s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:56 user nova-compute[74039]: INFO nova.compute.manager [None req-7a701097-23a7-4984-833f-da3af3a2799d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Unrescuing
Oct 20 08:54:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7a701097-23a7-4984-833f-da3af3a2799d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:54:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7a701097-23a7-4984-833f-da3af3a2799d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquired lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:54:56 user nova-compute[74039]: DEBUG nova.network.neutron [None req-7a701097-23a7-4984-833f-da3af3a2799d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:54:56 user nova-compute[74039]: DEBUG nova.network.neutron [None req-7a701097-23a7-4984-833f-da3af3a2799d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Updating instance_info_cache with network_info: [{"id": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "address": "fa:16:3e:63:75:a3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9fe7711-d5", "ovs_interfaceid": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:54:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7a701097-23a7-4984-833f-da3af3a2799d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Releasing lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:54:56 user nova-compute[74039]: DEBUG nova.objects.instance [None req-7a701097-23a7-4984-833f-da3af3a2799d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'flavor' on Instance uuid 9fe77a96-fcb5-4410-85cc-58d925548e03 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:54:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:57 user nova-compute[74039]: DEBUG nova.compute.manager [req-eafa657c-ba3e-4b74-ab72-b78f01c85afe req-ee52579d-467a-414e-8260-ac9a5736defd service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received event network-vif-unplugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eafa657c-ba3e-4b74-ab72-b78f01c85afe req-ee52579d-467a-414e-8260-ac9a5736defd service nova] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eafa657c-ba3e-4b74-ab72-b78f01c85afe req-ee52579d-467a-414e-8260-ac9a5736defd service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eafa657c-ba3e-4b74-ab72-b78f01c85afe req-ee52579d-467a-414e-8260-ac9a5736defd service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:57 user nova-compute[74039]: DEBUG nova.compute.manager [req-eafa657c-ba3e-4b74-ab72-b78f01c85afe req-ee52579d-467a-414e-8260-ac9a5736defd service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] No waiting events found dispatching network-vif-unplugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:57 user nova-compute[74039]: WARNING nova.compute.manager [req-eafa657c-ba3e-4b74-ab72-b78f01c85afe req-ee52579d-467a-414e-8260-ac9a5736defd service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received unexpected event network-vif-unplugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 for instance with vm_state rescued and task_state unrescuing.
Oct 20 08:54:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:57 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Instance destroyed successfully.
Oct 20 08:54:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] No waiting events found dispatching network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:59 user nova-compute[74039]: WARNING nova.compute.manager [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received unexpected event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 for instance with vm_state rescued and task_state unrescuing.
Oct 20 08:54:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] No waiting events found dispatching network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:59 user nova-compute[74039]: WARNING nova.compute.manager [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received unexpected event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 for instance with vm_state rescued and task_state unrescuing.
Oct 20 08:54:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] No waiting events found dispatching network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:59 user nova-compute[74039]: WARNING nova.compute.manager [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received unexpected event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 for instance with vm_state rescued and task_state unrescuing.
Oct 20 08:54:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received event network-vif-unplugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] No waiting events found dispatching network-vif-unplugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:59 user nova-compute[74039]: WARNING nova.compute.manager [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received unexpected event network-vif-unplugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 for instance with vm_state rescued and task_state unrescuing.
Oct 20 08:54:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] No waiting events found dispatching network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:59 user nova-compute[74039]: WARNING nova.compute.manager [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received unexpected event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 for instance with vm_state rescued and task_state unrescuing.
Oct 20 08:54:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:54:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] No waiting events found dispatching network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:54:59 user nova-compute[74039]: WARNING nova.compute.manager [req-3dbb984c-c6f4-4ec7-ac04-c274b357196d req-d04dcce2-56cc-4517-a035-c0e07dc9b831 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received unexpected event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 for instance with vm_state rescued and task_state unrescuing.
Oct 20 08:55:01 user nova-compute[74039]: DEBUG nova.compute.manager [None req-7a701097-23a7-4984-833f-da3af3a2799d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:55:01 user nova-compute[74039]: DEBUG nova.compute.manager [req-86e26c35-6e0b-432a-9fd1-95d309b5e82c req-0463bb9b-d068-49ce-bc13-12f187c22d92 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-86e26c35-6e0b-432a-9fd1-95d309b5e82c req-0463bb9b-d068-49ce-bc13-12f187c22d92 service nova] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-86e26c35-6e0b-432a-9fd1-95d309b5e82c req-0463bb9b-d068-49ce-bc13-12f187c22d92 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-86e26c35-6e0b-432a-9fd1-95d309b5e82c req-0463bb9b-d068-49ce-bc13-12f187c22d92 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:01 user nova-compute[74039]: DEBUG nova.compute.manager [req-86e26c35-6e0b-432a-9fd1-95d309b5e82c req-0463bb9b-d068-49ce-bc13-12f187c22d92 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] No waiting events found dispatching network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:01 user nova-compute[74039]: WARNING nova.compute.manager [req-86e26c35-6e0b-432a-9fd1-95d309b5e82c req-0463bb9b-d068-49ce-bc13-12f187c22d92 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received unexpected event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 for instance with vm_state rescued and task_state unrescuing.
Oct 20 08:55:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:04 user nova-compute[74039]: DEBUG nova.compute.manager [req-73d04a76-2cdb-40e3-8380-92a19885264a req-570ced77-de89-4de0-98c5-8ab2571b9c30 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-changed-559c1e42-8d19-4a1a-b6e9-385cb497a7df {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:04 user nova-compute[74039]: DEBUG nova.compute.manager [req-73d04a76-2cdb-40e3-8380-92a19885264a req-570ced77-de89-4de0-98c5-8ab2571b9c30 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Refreshing instance network info cache due to event network-changed-559c1e42-8d19-4a1a-b6e9-385cb497a7df. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:55:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-73d04a76-2cdb-40e3-8380-92a19885264a req-570ced77-de89-4de0-98c5-8ab2571b9c30 service nova] Acquiring lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:55:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-73d04a76-2cdb-40e3-8380-92a19885264a req-570ced77-de89-4de0-98c5-8ab2571b9c30 service nova] Acquired lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:55:04 user nova-compute[74039]: DEBUG nova.network.neutron [req-73d04a76-2cdb-40e3-8380-92a19885264a req-570ced77-de89-4de0-98c5-8ab2571b9c30 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Refreshing network info cache for port 559c1e42-8d19-4a1a-b6e9-385cb497a7df {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:55:05 user nova-compute[74039]: DEBUG nova.network.neutron [req-73d04a76-2cdb-40e3-8380-92a19885264a req-570ced77-de89-4de0-98c5-8ab2571b9c30 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Updated VIF entry in instance network info cache for port 559c1e42-8d19-4a1a-b6e9-385cb497a7df. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:55:05 user nova-compute[74039]: DEBUG nova.network.neutron [req-73d04a76-2cdb-40e3-8380-92a19885264a req-570ced77-de89-4de0-98c5-8ab2571b9c30 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Updating instance_info_cache with network_info: [{"id": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "address": "fa:16:3e:63:9f:0c", "network": {"id": "b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-648216651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559c1e42-8d", "ovs_interfaceid": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "address": "fa:16:3e:36:b9:ef", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9c8977-ca", "ovs_interfaceid": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "address": "fa:16:3e:36:6e:69", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5d3f5c-ff", "ovs_interfaceid": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "address": "fa:16:3e:ec:24:89", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ca163-f5", "ovs_interfaceid": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "address": "fa:16:3e:7d:de:76", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0a6d7c-1f", "ovs_interfaceid": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "address": "fa:16:3e:14:f4:6b", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bf8dcb-50", "ovs_interfaceid": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "address": "fa:16:3e:b7:1c:11", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ec0b8d-c5", "ovs_interfaceid": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:55:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-73d04a76-2cdb-40e3-8380-92a19885264a req-570ced77-de89-4de0-98c5-8ab2571b9c30 service nova] Releasing lock "refresh_cache-70e52f06-4f2a-4431-8149-2228565072e6" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:55:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "70e52f06-4f2a-4431-8149-2228565072e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:07 user nova-compute[74039]: INFO nova.compute.manager [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Terminating instance
Oct 20 08:55:08 user nova-compute[74039]: DEBUG nova.compute.manager [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-e5c76ea4-1486-41b1-bca7-d8cc22bdd111 req-a8096a46-26bc-414a-9086-aba99f529416 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-unplugged-559c1e42-8d19-4a1a-b6e9-385cb497a7df {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e5c76ea4-1486-41b1-bca7-d8cc22bdd111 req-a8096a46-26bc-414a-9086-aba99f529416 service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e5c76ea4-1486-41b1-bca7-d8cc22bdd111 req-a8096a46-26bc-414a-9086-aba99f529416 service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e5c76ea4-1486-41b1-bca7-d8cc22bdd111 req-a8096a46-26bc-414a-9086-aba99f529416 service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-e5c76ea4-1486-41b1-bca7-d8cc22bdd111 req-a8096a46-26bc-414a-9086-aba99f529416 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-unplugged-559c1e42-8d19-4a1a-b6e9-385cb497a7df {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-e5c76ea4-1486-41b1-bca7-d8cc22bdd111 req-a8096a46-26bc-414a-9086-aba99f529416 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-unplugged-559c1e42-8d19-4a1a-b6e9-385cb497a7df for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-66d46ab4-9afc-471d-a3bf-53e190b013c5 req-98fe4b38-8606-4fad-9055-64610addd62f service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-unplugged-1e9c8977-ca97-4285-b762-d5ceb5f701ef {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-66d46ab4-9afc-471d-a3bf-53e190b013c5 req-98fe4b38-8606-4fad-9055-64610addd62f service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-66d46ab4-9afc-471d-a3bf-53e190b013c5 req-98fe4b38-8606-4fad-9055-64610addd62f service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-66d46ab4-9afc-471d-a3bf-53e190b013c5 req-98fe4b38-8606-4fad-9055-64610addd62f service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-66d46ab4-9afc-471d-a3bf-53e190b013c5 req-98fe4b38-8606-4fad-9055-64610addd62f service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-unplugged-1e9c8977-ca97-4285-b762-d5ceb5f701ef {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-66d46ab4-9afc-471d-a3bf-53e190b013c5 req-98fe4b38-8606-4fad-9055-64610addd62f service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-unplugged-1e9c8977-ca97-4285-b762-d5ceb5f701ef for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-0731dbf3-47aa-44fd-b72e-068d807916ad req-1c3769fc-8b6d-4396-884f-d21b8de0cfb1 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-unplugged-7c0a6d7c-1f14-4014-baf3-784dd0f5ef18 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0731dbf3-47aa-44fd-b72e-068d807916ad req-1c3769fc-8b6d-4396-884f-d21b8de0cfb1 service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0731dbf3-47aa-44fd-b72e-068d807916ad req-1c3769fc-8b6d-4396-884f-d21b8de0cfb1 service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0731dbf3-47aa-44fd-b72e-068d807916ad req-1c3769fc-8b6d-4396-884f-d21b8de0cfb1 service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-0731dbf3-47aa-44fd-b72e-068d807916ad req-1c3769fc-8b6d-4396-884f-d21b8de0cfb1 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-unplugged-7c0a6d7c-1f14-4014-baf3-784dd0f5ef18 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-0731dbf3-47aa-44fd-b72e-068d807916ad req-1c3769fc-8b6d-4396-884f-d21b8de0cfb1 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-unplugged-7c0a6d7c-1f14-4014-baf3-784dd0f5ef18 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:55:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:09 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Instance destroyed successfully.
Oct 20 08:55:09 user nova-compute[74039]: DEBUG nova.objects.instance [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lazy-loading 'resources' on Instance uuid 70e52f06-4f2a-4431-8149-2228565072e6 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:53:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "address": "fa:16:3e:63:9f:0c", "network": {"id": "b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-648216651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559c1e42-8d", "ovs_interfaceid": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "address": "fa:16:3e:63:9f:0c", "network": {"id": "b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-648216651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559c1e42-8d", "ovs_interfaceid": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:9f:0c,bridge_name='br-int',has_traffic_filtering=True,id=559c1e42-8d19-4a1a-b6e9-385cb497a7df,network=Network(b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559c1e42-8d') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG os_vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:9f:0c,bridge_name='br-int',has_traffic_filtering=True,id=559c1e42-8d19-4a1a-b6e9-385cb497a7df,network=Network(b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559c1e42-8d') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap559c1e42-8d, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b8a2ab4-7c39-45e5-8ddd-e3736223af77) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: INFO os_vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:9f:0c,bridge_name='br-int',has_traffic_filtering=True,id=559c1e42-8d19-4a1a-b6e9-385cb497a7df,network=Network(b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap559c1e42-8d')
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:53:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "address": "fa:16:3e:36:b9:ef", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9c8977-ca", "ovs_interfaceid": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "address": "fa:16:3e:36:b9:ef", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9c8977-ca", "ovs_interfaceid": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:b9:ef,bridge_name='br-int',has_traffic_filtering=True,id=1e9c8977-ca97-4285-b762-d5ceb5f701ef,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e9c8977-ca') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG os_vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:b9:ef,bridge_name='br-int',has_traffic_filtering=True,id=1e9c8977-ca97-4285-b762-d5ceb5f701ef,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e9c8977-ca') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e9c8977-ca, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce6589ed-b32b-444b-af88-eaae85969c9b) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: INFO os_vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:b9:ef,bridge_name='br-int',has_traffic_filtering=True,id=1e9c8977-ca97-4285-b762-d5ceb5f701ef,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e9c8977-ca')
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:53:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "address": "fa:16:3e:36:6e:69", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5d3f5c-ff", "ovs_interfaceid": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "address": "fa:16:3e:36:6e:69", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5d3f5c-ff", "ovs_interfaceid": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6e:69,bridge_name='br-int',has_traffic_filtering=True,id=aa5d3f5c-ff64-4554-9ecb-b9e14730d29a,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaa5d3f5c-ff') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG os_vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6e:69,bridge_name='br-int',has_traffic_filtering=True,id=aa5d3f5c-ff64-4554-9ecb-b9e14730d29a,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaa5d3f5c-ff') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa5d3f5c-ff, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-24a5b305-93b5-4f3a-b9b3-ac21040038cd req-28f62fb0-dae5-4c2f-8eeb-01f19ef5bbcd service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-559c1e42-8d19-4a1a-b6e9-385cb497a7df {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-24a5b305-93b5-4f3a-b9b3-ac21040038cd req-28f62fb0-dae5-4c2f-8eeb-01f19ef5bbcd service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-24a5b305-93b5-4f3a-b9b3-ac21040038cd req-28f62fb0-dae5-4c2f-8eeb-01f19ef5bbcd service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-24a5b305-93b5-4f3a-b9b3-ac21040038cd req-28f62fb0-dae5-4c2f-8eeb-01f19ef5bbcd service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-24a5b305-93b5-4f3a-b9b3-ac21040038cd req-28f62fb0-dae5-4c2f-8eeb-01f19ef5bbcd service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-559c1e42-8d19-4a1a-b6e9-385cb497a7df {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:10 user nova-compute[74039]: WARNING nova.compute.manager [req-24a5b305-93b5-4f3a-b9b3-ac21040038cd req-28f62fb0-dae5-4c2f-8eeb-01f19ef5bbcd service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-559c1e42-8d19-4a1a-b6e9-385cb497a7df for instance with vm_state active and task_state deleting.
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8787a14-af6c-44e5-8bb6-7c2ad687a30a) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: INFO os_vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6e:69,bridge_name='br-int',has_traffic_filtering=True,id=aa5d3f5c-ff64-4554-9ecb-b9e14730d29a,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaa5d3f5c-ff')
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:53:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "address": "fa:16:3e:ec:24:89", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ca163-f5", "ovs_interfaceid": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "address": "fa:16:3e:ec:24:89", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea5ca163-f5", "ovs_interfaceid": "ea5ca163-f56a-49dc-ba70-a18ab6e4cd11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:24:89,bridge_name='br-int',has_traffic_filtering=True,id=ea5ca163-f56a-49dc-ba70-a18ab6e4cd11,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea5ca163-f5') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG os_vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:24:89,bridge_name='br-int',has_traffic_filtering=True,id=ea5ca163-f56a-49dc-ba70-a18ab6e4cd11,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea5ca163-f5') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea5ca163-f5, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00fabe11-2cc0-4247-b456-d1b2713cba7e) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: INFO os_vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:24:89,bridge_name='br-int',has_traffic_filtering=True,id=ea5ca163-f56a-49dc-ba70-a18ab6e4cd11,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea5ca163-f5')
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:53:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "address": "fa:16:3e:7d:de:76", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0a6d7c-1f", "ovs_interfaceid": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "address": "fa:16:3e:7d:de:76", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0a6d7c-1f", "ovs_interfaceid": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:de:76,bridge_name='br-int',has_traffic_filtering=True,id=7c0a6d7c-1f14-4014-baf3-784dd0f5ef18,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0a6d7c-1f') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG os_vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:de:76,bridge_name='br-int',has_traffic_filtering=True,id=7c0a6d7c-1f14-4014-baf3-784dd0f5ef18,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0a6d7c-1f') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c0a6d7c-1f, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-1e9c8977-ca97-4285-b762-d5ceb5f701ef {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-1e9c8977-ca97-4285-b762-d5ceb5f701ef {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:10 user nova-compute[74039]: WARNING nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-1e9c8977-ca97-4285-b762-d5ceb5f701ef for instance with vm_state active and task_state deleting.
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-unplugged-aa5d3f5c-ff64-4554-9ecb-b9e14730d29a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-unplugged-aa5d3f5c-ff64-4554-9ecb-b9e14730d29a {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-unplugged-aa5d3f5c-ff64-4554-9ecb-b9e14730d29a for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-aa5d3f5c-ff64-4554-9ecb-b9e14730d29a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-aa5d3f5c-ff64-4554-9ecb-b9e14730d29a {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:10 user nova-compute[74039]: WARNING nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-aa5d3f5c-ff64-4554-9ecb-b9e14730d29a for instance with vm_state active and task_state deleting.
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-unplugged-ea5ca163-f56a-49dc-ba70-a18ab6e4cd11 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-unplugged-ea5ca163-f56a-49dc-ba70-a18ab6e4cd11 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-unplugged-ea5ca163-f56a-49dc-ba70-a18ab6e4cd11 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-ea5ca163-f56a-49dc-ba70-a18ab6e4cd11 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-ea5ca163-f56a-49dc-ba70-a18ab6e4cd11 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:10 user nova-compute[74039]: WARNING nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-ea5ca163-f56a-49dc-ba70-a18ab6e4cd11 for instance with vm_state active and task_state deleting.
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-unplugged-90bf8dcb-50f9-4f4b-a743-07754de5bddf {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-unplugged-90bf8dcb-50f9-4f4b-a743-07754de5bddf {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-unplugged-90bf8dcb-50f9-4f4b-a743-07754de5bddf for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-90bf8dcb-50f9-4f4b-a743-07754de5bddf {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-90bf8dcb-50f9-4f4b-a743-07754de5bddf {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:10 user nova-compute[74039]: WARNING nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-90bf8dcb-50f9-4f4b-a743-07754de5bddf for instance with vm_state active and task_state deleting.
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-unplugged-a2ec0b8d-c5ed-4f71-9b28-76b48949f029 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-unplugged-a2ec0b8d-c5ed-4f71-9b28-76b48949f029 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-unplugged-a2ec0b8d-c5ed-4f71-9b28-76b48949f029 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-a2ec0b8d-c5ed-4f71-9b28-76b48949f029 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-a2ec0b8d-c5ed-4f71-9b28-76b48949f029 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:10 user nova-compute[74039]: WARNING nova.compute.manager [req-62c82258-64bb-4030-98ce-23f14b2697f0 req-534e98cb-c7d3-4620-b496-d77144b3604e service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-a2ec0b8d-c5ed-4f71-9b28-76b48949f029 for instance with vm_state active and task_state deleting.
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbc28827-c982-41a8-b34f-d669e70ae675) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: INFO os_vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:de:76,bridge_name='br-int',has_traffic_filtering=True,id=7c0a6d7c-1f14-4014-baf3-784dd0f5ef18,network=Network(5a5c165a-7276-4770-9f04-4bdfbd906361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0a6d7c-1f')
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:53:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "address": "fa:16:3e:14:f4:6b", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bf8dcb-50", "ovs_interfaceid": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "address": "fa:16:3e:14:f4:6b", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bf8dcb-50", "ovs_interfaceid": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=90bf8dcb-50f9-4f4b-a743-07754de5bddf,network=Network(9ca3c2dc-7c79-4df0-938f-ff05c3de9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bf8dcb-50') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG os_vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=90bf8dcb-50f9-4f4b-a743-07754de5bddf,network=Network(9ca3c2dc-7c79-4df0-938f-ff05c3de9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bf8dcb-50') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90bf8dcb-50, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c09f2be5-33cb-4760-a918-deb5a105d9f6) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: INFO os_vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=90bf8dcb-50f9-4f4b-a743-07754de5bddf,network=Network(9ca3c2dc-7c79-4df0-938f-ff05c3de9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bf8dcb-50')
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T08:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-503202872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-503202872',id=9,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtbQ+m92sSlbaGFOfS3huvtWWW/NGwUkXszW4G6Q4D7bI1xKqoxUUu7QKgHtVqDpRIJ+0780WYuhqZqIPKlHnEl1hQPnip66HstATT+SNUMtO4BEuP+VEWNgzFL37Xysw==',key_name='tempest-keypair-979694353',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:53:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b602fae310894282bb68869684db4965',ramdisk_id='',reservation_id='r-3y83oknb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1640177090',owner_user_name='tempest-TaggedBootDevicesTest-1640177090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dabfaebbed414fe1bddedb1b4e02d358',uuid=70e52f06-4f2a-4431-8149-2228565072e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "address": "fa:16:3e:b7:1c:11", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ec0b8d-c5", "ovs_interfaceid": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converting VIF {"id": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "address": "fa:16:3e:b7:1c:11", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ec0b8d-c5", "ovs_interfaceid": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:1c:11,bridge_name='br-int',has_traffic_filtering=True,id=a2ec0b8d-c5ed-4f71-9b28-76b48949f029,network=Network(9ca3c2dc-7c79-4df0-938f-ff05c3de9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ec0b8d-c5') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG os_vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:1c:11,bridge_name='br-int',has_traffic_filtering=True,id=a2ec0b8d-c5ed-4f71-9b28-76b48949f029,network=Network(9ca3c2dc-7c79-4df0-938f-ff05c3de9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ec0b8d-c5') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2ec0b8d-c5, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e810e511-1857-463b-84dd-2abfe7b299a4) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:10 user nova-compute[74039]: INFO os_vif [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:1c:11,bridge_name='br-int',has_traffic_filtering=True,id=a2ec0b8d-c5ed-4f71-9b28-76b48949f029,network=Network(9ca3c2dc-7c79-4df0-938f-ff05c3de9192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ec0b8d-c5')
Oct 20 08:55:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxOUZclt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:55:10 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:55:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[064f36eb-e20d-443d-996c-d631d95956a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 08:55:10 user nova-compute[74039]: No targets found.
Oct 20 08:55:10 user nova-compute[74039]: iSNS:
Oct 20 08:55:10 user nova-compute[74039]: No targets found.
Oct 20 08:55:10 user nova-compute[74039]: STATIC:
Oct 20 08:55:10 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08
Oct 20 08:55:10 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:55:10 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:55:10 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa
Oct 20 08:55:10 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:55:10 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:55:10 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7
Oct 20 08:55:10 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:55:10 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:55:10 user nova-compute[74039]: FIRMWARE:
Oct 20 08:55:10 user nova-compute[74039]: No targets found.
Oct 20 08:55:10 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 08:55:10 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 08:55:10 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[06787df5-5525-44d7-a058-60b665bff738]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[82597d42-dfe9-46aa-a61a-fab64e9fcb40]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)
Oct 20 08:55:10 user nova-compute[74039]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)
Oct 20 08:55:10 user nova-compute[74039]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)
Oct 20 08:55:10 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa (non-flash)
Oct 20 08:55:10 user nova-compute[74039]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)
Oct 20 08:55:10 user nova-compute[74039]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)
Oct 20 08:55:10 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae7c188a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa'): ({'sdb'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Removing single pathed devices sdb {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3c67ef-fa0f-4662-baf5-e9e96eeb932a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87d9250-f7fa-4a8e-947e-64bbbe46afda]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Flushing IO for device /dev/sdb {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[db90db76-126b-4c92-9562-c46ea175571e]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 08:55:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac9991c-b13c-415e-89fa-be39bcad2c16]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-f8eda12b-7960-4d65-be8d-1569933ff5d1 req-b5b8562c-de30-472d-b23b-9d6f38abae58 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-plugged-7c0a6d7c-1f14-4014-baf3-784dd0f5ef18 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f8eda12b-7960-4d65-be8d-1569933ff5d1 req-b5b8562c-de30-472d-b23b-9d6f38abae58 service nova] Acquiring lock "70e52f06-4f2a-4431-8149-2228565072e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f8eda12b-7960-4d65-be8d-1569933ff5d1 req-b5b8562c-de30-472d-b23b-9d6f38abae58 service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f8eda12b-7960-4d65-be8d-1569933ff5d1 req-b5b8562c-de30-472d-b23b-9d6f38abae58 service nova] Lock "70e52f06-4f2a-4431-8149-2228565072e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-f8eda12b-7960-4d65-be8d-1569933ff5d1 req-b5b8562c-de30-472d-b23b-9d6f38abae58 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] No waiting events found dispatching network-vif-plugged-7c0a6d7c-1f14-4014-baf3-784dd0f5ef18 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:11 user nova-compute[74039]: WARNING nova.compute.manager [req-f8eda12b-7960-4d65-be8d-1569933ff5d1 req-b5b8562c-de30-472d-b23b-9d6f38abae58 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received unexpected event network-vif-plugged-7c0a6d7c-1f14-4014-baf3-784dd0f5ef18 for instance with vm_state active and task_state deleting.
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[320a2ce9-772b-4df0-a15b-1d418db64fde]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13e0885-8edb-484d-8e24-8545c1e8f36e]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa, portal: 172.16.0.220,3260]
Oct 20 08:55:11 user nova-compute[74039]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa, portal: 172.16.0.220,3260] successful.
Oct 20 08:55:11 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ddf3a93-eecd-4682-8412-6209c4c708aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fade59c-2049-40c5-8f8d-ed236c0e63b0]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] <== disconnect_volume: return (364ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxMGztOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:55:11 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d67c79-1330-4764-8499-14f676549a3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 08:55:11 user nova-compute[74039]: No targets found.
Oct 20 08:55:11 user nova-compute[74039]: iSNS:
Oct 20 08:55:11 user nova-compute[74039]: No targets found.
Oct 20 08:55:11 user nova-compute[74039]: STATIC:
Oct 20 08:55:11 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08
Oct 20 08:55:11 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:55:11 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:55:11 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7
Oct 20 08:55:11 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:55:11 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:55:11 user nova-compute[74039]: FIRMWARE:
Oct 20 08:55:11 user nova-compute[74039]: No targets found.
Oct 20 08:55:11 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 08:55:11 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 08:55:11 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[23efde0b-121a-46a6-8f6d-b78e800c23a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca2647c-be26-49d6-b6cf-091f8b95733b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)
Oct 20 08:55:11 user nova-compute[74039]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)
Oct 20 08:55:11 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 (non-flash)
Oct 20 08:55:11 user nova-compute[74039]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)
Oct 20 08:55:11 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae7c188a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08'): ({'sdg'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Removing single pathed devices sdg {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbc29cd-afc0-4735-9db7-ff921d94e7fb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bc5b87-5ef3-4177-b21a-97d87ecc5b55]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Flushing IO for device /dev/sdg {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[821a3bfd-0471-49ad-bdaf-8b842965ea28]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaac50ed-a8fb-4d89-8495-92fd6a5c21bb]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] SCSI volumes sdg have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3767161-4813-4586-ac78-37b03661c136]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[438e01d9-b48f-45fd-8d8d-2bbdac2b3790]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08, portal: 172.16.0.220,3260]
Oct 20 08:55:11 user nova-compute[74039]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08, portal: 172.16.0.220,3260] successful.
Oct 20 08:55:11 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c25ad-8992-4e59-9b12-2e99c5129e08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa4b9d4-c990-4931-9b1e-efd2b4028b55]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] <== disconnect_volume: return (333ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNigOxWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:55:11 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9124325e-7b47-47ef-8bfa-45cdb65cdaab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 08:55:11 user nova-compute[74039]: No targets found.
Oct 20 08:55:11 user nova-compute[74039]: iSNS:
Oct 20 08:55:11 user nova-compute[74039]: No targets found.
Oct 20 08:55:11 user nova-compute[74039]: STATIC:
Oct 20 08:55:11 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7
Oct 20 08:55:11 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:55:11 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:55:11 user nova-compute[74039]: FIRMWARE:
Oct 20 08:55:11 user nova-compute[74039]: No targets found.
Oct 20 08:55:11 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 08:55:11 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 08:55:11 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1559c54-c222-41f8-b5e9-460ad9482a1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[809b3a12-fc25-4bbe-a990-3de9362d9e0d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)
Oct 20 08:55:11 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 (non-flash)
Oct 20 08:55:11 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae8445dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7'): ({'sdf'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Removing single pathed devices sdf {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e4f6ee-a68e-4e18-92ae-836f5ebe95a4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2797da-38d4-41ae-a722-141bfb42253a]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Flushing IO for device /dev/sdf {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54e9d56-029b-43b2-b90a-64dc3a850e1b]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cecfa0-542e-42cc-8019-02981f0624b1]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] SCSI volumes sdf have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6754b2-8223-498c-8b08-fa1ac3974ff9]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4006df0c-18fc-41f9-ad11-ba7022308ea9]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7, portal: 172.16.0.220,3260]
Oct 20 08:55:11 user nova-compute[74039]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7, portal: 172.16.0.220,3260] successful.
Oct 20 08:55:11 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba8a764-2e46-40da-b2a3-f766320b5dd7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf1938b-4690-4320-aa84-7ae81ef262d9]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] <== disconnect_volume: return (333ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 08:55:11 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Deleting instance files /opt/stack/data/nova/instances/70e52f06-4f2a-4431-8149-2228565072e6_del
Oct 20 08:55:11 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Deletion of /opt/stack/data/nova/instances/70e52f06-4f2a-4431-8149-2228565072e6_del complete
Oct 20 08:55:11 user nova-compute[74039]: INFO nova.compute.manager [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Took 3.89 seconds to destroy the instance on the hypervisor.
Oct 20 08:55:11 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 08:55:11 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 08:55:12 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:55:12 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:55:12 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:55:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-062622c8-9883-4a0d-ad08-4971f2595af4 req-e2dd945f-f146-4dcb-9c16-b36f5072d5f9 service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Received event network-changed-b57e8401-da94-4880-b515-65198826312a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-062622c8-9883-4a0d-ad08-4971f2595af4 req-e2dd945f-f146-4dcb-9c16-b36f5072d5f9 service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Refreshing instance network info cache due to event network-changed-b57e8401-da94-4880-b515-65198826312a. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:55:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-062622c8-9883-4a0d-ad08-4971f2595af4 req-e2dd945f-f146-4dcb-9c16-b36f5072d5f9 service nova] Acquiring lock "refresh_cache-3625b19d-4394-4feb-bbe8-55a2d86dd7fb" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:55:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-062622c8-9883-4a0d-ad08-4971f2595af4 req-e2dd945f-f146-4dcb-9c16-b36f5072d5f9 service nova] Acquired lock "refresh_cache-3625b19d-4394-4feb-bbe8-55a2d86dd7fb" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:55:13 user nova-compute[74039]: DEBUG nova.network.neutron [req-062622c8-9883-4a0d-ad08-4971f2595af4 req-e2dd945f-f146-4dcb-9c16-b36f5072d5f9 service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Refreshing network info cache for port b57e8401-da94-4880-b515-65198826312a {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:55:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:13 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:55:13 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:55:13 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 08:55:14 user nova-compute[74039]: DEBUG nova.network.neutron [req-062622c8-9883-4a0d-ad08-4971f2595af4 req-e2dd945f-f146-4dcb-9c16-b36f5072d5f9 service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Updated VIF entry in instance network info cache for port b57e8401-da94-4880-b515-65198826312a. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:55:14 user nova-compute[74039]: DEBUG nova.network.neutron [req-062622c8-9883-4a0d-ad08-4971f2595af4 req-e2dd945f-f146-4dcb-9c16-b36f5072d5f9 service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Updating instance_info_cache with network_info: [{"id": "b57e8401-da94-4880-b515-65198826312a", "address": "fa:16:3e:54:60:7c", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57e8401-da", "ovs_interfaceid": "b57e8401-da94-4880-b515-65198826312a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:55:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-062622c8-9883-4a0d-ad08-4971f2595af4 req-e2dd945f-f146-4dcb-9c16-b36f5072d5f9 service nova] Releasing lock "refresh_cache-3625b19d-4394-4feb-bbe8-55a2d86dd7fb" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:55:14 user nova-compute[74039]: DEBUG nova.compute.manager [req-cf41525a-a296-4226-8b81-c36bbfc70cc3 req-9fee12ca-8245-444e-a1b3-b722c9789067 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-deleted-ea5ca163-f56a-49dc-ba70-a18ab6e4cd11 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:14 user nova-compute[74039]: INFO nova.compute.manager [req-cf41525a-a296-4226-8b81-c36bbfc70cc3 req-9fee12ca-8245-444e-a1b3-b722c9789067 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Neutron deleted interface ea5ca163-f56a-49dc-ba70-a18ab6e4cd11; detaching it from the instance and deleting it from the info cache
Oct 20 08:55:14 user nova-compute[74039]: DEBUG nova.network.neutron [req-cf41525a-a296-4226-8b81-c36bbfc70cc3 req-9fee12ca-8245-444e-a1b3-b722c9789067 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Updating instance_info_cache with network_info: [{"id": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "address": "fa:16:3e:63:9f:0c", "network": {"id": "b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-648216651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559c1e42-8d", "ovs_interfaceid": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "address": "fa:16:3e:36:b9:ef", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9c8977-ca", "ovs_interfaceid": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "address": "fa:16:3e:36:6e:69", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5d3f5c-ff", "ovs_interfaceid": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "address": "fa:16:3e:7d:de:76", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0a6d7c-1f", "ovs_interfaceid": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "address": "fa:16:3e:14:f4:6b", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bf8dcb-50", "ovs_interfaceid": "90bf8dcb-50f9-4f4b-a743-07754de5bddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "address": "fa:16:3e:b7:1c:11", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ec0b8d-c5", "ovs_interfaceid": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:55:14 user nova-compute[74039]: DEBUG nova.compute.manager [req-cf41525a-a296-4226-8b81-c36bbfc70cc3 req-9fee12ca-8245-444e-a1b3-b722c9789067 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Detach interface failed, port_id=ea5ca163-f56a-49dc-ba70-a18ab6e4cd11, reason: Instance 70e52f06-4f2a-4431-8149-2228565072e6 could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 08:55:14 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:55:14 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 08:55:14 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Rebuilding the list of instances to heal {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 08:55:14 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Skipping network cache update for instance because it is being deleted. {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 20 08:55:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:55:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:55:14 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 08:55:14 user nova-compute[74039]: DEBUG nova.objects.instance [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lazy-loading 'info_cache' on Instance uuid 9fe77a96-fcb5-4410-85cc-58d925548e03 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:55:15 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Updating instance_info_cache with network_info: [{"id": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "address": "fa:16:3e:63:75:a3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9fe7711-d5", "ovs_interfaceid": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:55:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:55:15 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 08:55:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:16 user nova-compute[74039]: DEBUG nova.compute.manager [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 08:55:16 user nova-compute[74039]: DEBUG nova.compute.manager [req-8737f518-358f-4649-8e78-25184c1a090c req-c12fe048-43cc-4b76-a969-14cff6065c54 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-deleted-90bf8dcb-50f9-4f4b-a743-07754de5bddf {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:16 user nova-compute[74039]: INFO nova.compute.manager [req-8737f518-358f-4649-8e78-25184c1a090c req-c12fe048-43cc-4b76-a969-14cff6065c54 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Neutron deleted interface 90bf8dcb-50f9-4f4b-a743-07754de5bddf; detaching it from the instance and deleting it from the info cache
Oct 20 08:55:16 user nova-compute[74039]: DEBUG nova.network.neutron [req-8737f518-358f-4649-8e78-25184c1a090c req-c12fe048-43cc-4b76-a969-14cff6065c54 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Updating instance_info_cache with network_info: [{"id": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "address": "fa:16:3e:63:9f:0c", "network": {"id": "b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-648216651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559c1e42-8d", "ovs_interfaceid": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "address": "fa:16:3e:36:b9:ef", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9c8977-ca", "ovs_interfaceid": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "address": "fa:16:3e:36:6e:69", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5d3f5c-ff", "ovs_interfaceid": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "address": "fa:16:3e:7d:de:76", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0a6d7c-1f", "ovs_interfaceid": "7c0a6d7c-1f14-4014-baf3-784dd0f5ef18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "address": "fa:16:3e:b7:1c:11", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ec0b8d-c5", "ovs_interfaceid": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:55:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:16 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:55:16 user nova-compute[74039]: INFO nova.compute.claims [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Claim successful on node user
Oct 20 08:55:16 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:55:16 user nova-compute[74039]: DEBUG nova.compute.manager [req-8737f518-358f-4649-8e78-25184c1a090c req-c12fe048-43cc-4b76-a969-14cff6065c54 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Detach interface failed, port_id=90bf8dcb-50f9-4f4b-a743-07754de5bddf, reason: Instance 70e52f06-4f2a-4431-8149-2228565072e6 could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 08:55:16 user nova-compute[74039]: DEBUG nova.compute.manager [req-8737f518-358f-4649-8e78-25184c1a090c req-c12fe048-43cc-4b76-a969-14cff6065c54 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-deleted-7c0a6d7c-1f14-4014-baf3-784dd0f5ef18 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:16 user nova-compute[74039]: INFO nova.compute.manager [req-8737f518-358f-4649-8e78-25184c1a090c req-c12fe048-43cc-4b76-a969-14cff6065c54 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Neutron deleted interface 7c0a6d7c-1f14-4014-baf3-784dd0f5ef18; detaching it from the instance and deleting it from the info cache
Oct 20 08:55:16 user nova-compute[74039]: DEBUG nova.network.neutron [req-8737f518-358f-4649-8e78-25184c1a090c req-c12fe048-43cc-4b76-a969-14cff6065c54 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Updating instance_info_cache with network_info: [{"id": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "address": "fa:16:3e:63:9f:0c", "network": {"id": "b0fe61b9-e9b1-4fd0-8af6-1797f480a6d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-648216651-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap559c1e42-8d", "ovs_interfaceid": "559c1e42-8d19-4a1a-b6e9-385cb497a7df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "address": "fa:16:3e:36:b9:ef", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9c8977-ca", "ovs_interfaceid": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "address": "fa:16:3e:36:6e:69", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5d3f5c-ff", "ovs_interfaceid": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "address": "fa:16:3e:b7:1c:11", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ec0b8d-c5", "ovs_interfaceid": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:55:16 user nova-compute[74039]: DEBUG nova.compute.manager [req-8737f518-358f-4649-8e78-25184c1a090c req-c12fe048-43cc-4b76-a969-14cff6065c54 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Detach interface failed, port_id=7c0a6d7c-1f14-4014-baf3-784dd0f5ef18, reason: Instance 70e52f06-4f2a-4431-8149-2228565072e6 could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 08:55:16 user nova-compute[74039]: DEBUG nova.compute.manager [req-8737f518-358f-4649-8e78-25184c1a090c req-c12fe048-43cc-4b76-a969-14cff6065c54 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-deleted-559c1e42-8d19-4a1a-b6e9-385cb497a7df {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:16 user nova-compute[74039]: INFO nova.compute.manager [req-8737f518-358f-4649-8e78-25184c1a090c req-c12fe048-43cc-4b76-a969-14cff6065c54 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Neutron deleted interface 559c1e42-8d19-4a1a-b6e9-385cb497a7df; detaching it from the instance and deleting it from the info cache
Oct 20 08:55:16 user nova-compute[74039]: DEBUG nova.network.neutron [req-8737f518-358f-4649-8e78-25184c1a090c req-c12fe048-43cc-4b76-a969-14cff6065c54 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Updating instance_info_cache with network_info: [{"id": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "address": "fa:16:3e:36:b9:ef", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9c8977-ca", "ovs_interfaceid": "1e9c8977-ca97-4285-b762-d5ceb5f701ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "address": "fa:16:3e:36:6e:69", "network": {"id": "5a5c165a-7276-4770-9f04-4bdfbd906361", "bridge": "br-int", "label": "tempest-device-tagging-net1-1085389845", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5d3f5c-ff", "ovs_interfaceid": "aa5d3f5c-ff64-4554-9ecb-b9e14730d29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "address": "fa:16:3e:b7:1c:11", "network": {"id": "9ca3c2dc-7c79-4df0-938f-ff05c3de9192", "bridge": "br-int", "label": "tempest-device-tagging-net2-237436193", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b602fae310894282bb68869684db4965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ec0b8d-c5", "ovs_interfaceid": "a2ec0b8d-c5ed-4f71-9b28-76b48949f029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:55:16 user nova-compute[74039]: DEBUG nova.compute.manager [req-8737f518-358f-4649-8e78-25184c1a090c req-c12fe048-43cc-4b76-a969-14cff6065c54 service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Detach interface failed, port_id=559c1e42-8d19-4a1a-b6e9-385cb497a7df, reason: Instance 70e52f06-4f2a-4431-8149-2228565072e6 could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:55:17 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Took 5.19 seconds to deallocate network for instance.
Oct 20 08:55:17 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG nova.compute.manager [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG nova.compute.manager [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG nova.network.neutron [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:55:17 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 08:55:17 user nova-compute[74039]: DEBUG nova.compute.manager [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG nova.policy [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '994701e77d9740f4a7a18390f9438996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da44286b6f5b45fe9ccbd881754a9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG nova.compute.manager [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:55:17 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Creating image(s)
Oct 20 08:55:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "/opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "/opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "/opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.196s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.211s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk 1073741824" returned: 0 in 0.055s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:18 user nova-compute[74039]: DEBUG nova.network.neutron [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Successfully created port: e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:55:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.202s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:18 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 08:55:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:18 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Cannot resize image /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 08:55:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:55:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Ensure instance console log exists: /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:55:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:18 user nova-compute[74039]: DEBUG nova.compute.manager [req-d94649df-a7f1-495f-99c5-1216ad74a80c req-f3fa8173-807d-482e-ab31-093da082790b service nova] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Received event network-vif-deleted-a2ec0b8d-c5ed-4f71-9b28-76b48949f029 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:18 user nova-compute[74039]: DEBUG nova.network.neutron [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Successfully updated port: e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:55:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:55:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquired lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:55:18 user nova-compute[74039]: DEBUG nova.network.neutron [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:55:18 user nova-compute[74039]: DEBUG nova.network.neutron [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.network.neutron [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Updating instance_info_cache with network_info: [{"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Releasing lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.compute.manager [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Instance network_info: |[{"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Start _get_guest_xml network_info=[{"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:55:19 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:55:19 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-981664831',display_name='tempest-ServerActionsTestOtherB-server-981664831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-981664831',id=14,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLks5fH3OqnFIJYbiqhEyJYFZHff7b4Ae9JDwAsMmBzcCMiYxaXPw5gTAg3NjSBwdB4e4WBubdaiWR0mkFHpfIFMVWW5rKzlKquVWH/exNlZL5M7mfGJM5jL4+NyXysGbg==',key_name='tempest-keypair-748521120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da44286b6f5b45fe9ccbd881754a9b3c',ramdisk_id='',reservation_id='r-2fnz9nzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1010421968',owner_user_name='tempest-ServerActionsTestOtherB-1010421968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:55:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='994701e77d9740f4a7a18390f9438996',uuid=ebaa4804-32e5-4fff-9562-0587ff7ca4ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Converting VIF {"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.objects.instance [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lazy-loading 'pci_devices' on Instance uuid ebaa4804-32e5-4fff-9562-0587ff7ca4ed {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:55:19 user nova-compute[74039]:   <uuid>ebaa4804-32e5-4fff-9562-0587ff7ca4ed</uuid>
Oct 20 08:55:19 user nova-compute[74039]:   <name>instance-0000000e</name>
Oct 20 08:55:19 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:55:19 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:55:19 user nova-compute[74039]:   <metadata>
Oct 20 08:55:19 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:55:19 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:55:19 user nova-compute[74039]:       <nova:name>tempest-ServerActionsTestOtherB-server-981664831</nova:name>
Oct 20 08:55:19 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:55:19</nova:creationTime>
Oct 20 08:55:19 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:55:19 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:55:19 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:55:19 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:55:19 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:55:19 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:55:19 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:55:19 user nova-compute[74039]:       <nova:owner>
Oct 20 08:55:19 user nova-compute[74039]:         <nova:user uuid="994701e77d9740f4a7a18390f9438996">tempest-ServerActionsTestOtherB-1010421968-project-member</nova:user>
Oct 20 08:55:19 user nova-compute[74039]:         <nova:project uuid="da44286b6f5b45fe9ccbd881754a9b3c">tempest-ServerActionsTestOtherB-1010421968</nova:project>
Oct 20 08:55:19 user nova-compute[74039]:       </nova:owner>
Oct 20 08:55:19 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:55:19 user nova-compute[74039]:       <nova:ports>
Oct 20 08:55:19 user nova-compute[74039]:         <nova:port uuid="e7d9d83f-1522-47f7-ac4c-7dd56facfea7">
Oct 20 08:55:19 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 08:55:19 user nova-compute[74039]:         </nova:port>
Oct 20 08:55:19 user nova-compute[74039]:       </nova:ports>
Oct 20 08:55:19 user nova-compute[74039]:     </nova:instance>
Oct 20 08:55:19 user nova-compute[74039]:   </metadata>
Oct 20 08:55:19 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:55:19 user nova-compute[74039]:     <system>
Oct 20 08:55:19 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:55:19 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:55:19 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:55:19 user nova-compute[74039]:       <entry name="serial">ebaa4804-32e5-4fff-9562-0587ff7ca4ed</entry>
Oct 20 08:55:19 user nova-compute[74039]:       <entry name="uuid">ebaa4804-32e5-4fff-9562-0587ff7ca4ed</entry>
Oct 20 08:55:19 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:55:19 user nova-compute[74039]:     </system>
Oct 20 08:55:19 user nova-compute[74039]:   </sysinfo>
Oct 20 08:55:19 user nova-compute[74039]:   <os>
Oct 20 08:55:19 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:55:19 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:55:19 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:55:19 user nova-compute[74039]:   </os>
Oct 20 08:55:19 user nova-compute[74039]:   <features>
Oct 20 08:55:19 user nova-compute[74039]:     <acpi/>
Oct 20 08:55:19 user nova-compute[74039]:     <apic/>
Oct 20 08:55:19 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:55:19 user nova-compute[74039]:   </features>
Oct 20 08:55:19 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:55:19 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:55:19 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:55:19 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:55:19 user nova-compute[74039]:   </clock>
Oct 20 08:55:19 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:55:19 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:55:19 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:55:19 user nova-compute[74039]:   </cpu>
Oct 20 08:55:19 user nova-compute[74039]:   <devices>
Oct 20 08:55:19 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:55:19 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:55:19 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk"/>
Oct 20 08:55:19 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:55:19 user nova-compute[74039]:     </disk>
Oct 20 08:55:19 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:55:19 user nova-compute[74039]:       <mac address="fa:16:3e:0d:87:c4"/>
Oct 20 08:55:19 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:55:19 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:55:19 user nova-compute[74039]:       <target dev="tape7d9d83f-15"/>
Oct 20 08:55:19 user nova-compute[74039]:     </interface>
Oct 20 08:55:19 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:55:19 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/console.log" append="off"/>
Oct 20 08:55:19 user nova-compute[74039]:     </serial>
Oct 20 08:55:19 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:55:19 user nova-compute[74039]:     <video>
Oct 20 08:55:19 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:55:19 user nova-compute[74039]:     </video>
Oct 20 08:55:19 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:55:19 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:55:19 user nova-compute[74039]:     </rng>
Oct 20 08:55:19 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:55:19 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:55:19 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:55:19 user nova-compute[74039]:     </memballoon>
Oct 20 08:55:19 user nova-compute[74039]:   </devices>
Oct 20 08:55:19 user nova-compute[74039]: </domain>
Oct 20 08:55:19 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-981664831',display_name='tempest-ServerActionsTestOtherB-server-981664831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-981664831',id=14,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLks5fH3OqnFIJYbiqhEyJYFZHff7b4Ae9JDwAsMmBzcCMiYxaXPw5gTAg3NjSBwdB4e4WBubdaiWR0mkFHpfIFMVWW5rKzlKquVWH/exNlZL5M7mfGJM5jL4+NyXysGbg==',key_name='tempest-keypair-748521120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da44286b6f5b45fe9ccbd881754a9b3c',ramdisk_id='',reservation_id='r-2fnz9nzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1010421968',owner_user_name='tempest-ServerActionsTestOtherB-1010421968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:55:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='994701e77d9740f4a7a18390f9438996',uuid=ebaa4804-32e5-4fff-9562-0587ff7ca4ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Converting VIF {"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG os_vif [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5add5f42-8609-5905-a571-e6b6f840a84e', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7d9d83f-15, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7d9d83f-15, col_values=(('qos', UUID('687359e5-a7a0-498a-9ce3-0bf7cd72d0d6')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7d9d83f-15, col_values=(('external_ids', {'iface-id': 'e7d9d83f-1522-47f7-ac4c-7dd56facfea7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:87:c4', 'vm-uuid': 'ebaa4804-32e5-4fff-9562-0587ff7ca4ed'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:19 user nova-compute[74039]: INFO os_vif [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15')
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] No VIF found with MAC fa:16:3e:0d:87:c4, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:55:19 user nova-compute[74039]: INFO nova.compute.manager [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] [instance: 70e52f06-4f2a-4431-8149-2228565072e6] Took 2.77 seconds to detach 3 volumes for instance.
Oct 20 08:55:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:19 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Refreshing inventories for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Updating ProviderTree inventory for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Updating inventory in ProviderTree for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Refreshing aggregate associations for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb, aggregates: None {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Refreshing trait associations for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.594s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:20 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Deleted allocations for instance 70e52f06-4f2a-4431-8149-2228565072e6
Oct 20 08:55:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c767445d-000e-41df-a71d-6158b94cdd54 tempest-TaggedBootDevicesTest-1640177090 tempest-TaggedBootDevicesTest-1640177090-project-member] Lock "70e52f06-4f2a-4431-8149-2228565072e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.720s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-fdba8d76-69d5-4b20-acf2-6f0678643297 req-a3d39bc0-cf66-466d-bf8e-41440dd3b8d9 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received event network-changed-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-fdba8d76-69d5-4b20-acf2-6f0678643297 req-a3d39bc0-cf66-466d-bf8e-41440dd3b8d9 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Refreshing instance network info cache due to event network-changed-e7d9d83f-1522-47f7-ac4c-7dd56facfea7. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-fdba8d76-69d5-4b20-acf2-6f0678643297 req-a3d39bc0-cf66-466d-bf8e-41440dd3b8d9 service nova] Acquiring lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-fdba8d76-69d5-4b20-acf2-6f0678643297 req-a3d39bc0-cf66-466d-bf8e-41440dd3b8d9 service nova] Acquired lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG nova.network.neutron [req-fdba8d76-69d5-4b20-acf2-6f0678643297 req-a3d39bc0-cf66-466d-bf8e-41440dd3b8d9 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Refreshing network info cache for port e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-12bfafbd-1cbf-4c24-8ab8-13161fc759de req-d3db321a-30fb-43c3-99aa-28a6899b490c service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received event network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-12bfafbd-1cbf-4c24-8ab8-13161fc759de req-d3db321a-30fb-43c3-99aa-28a6899b490c service nova] Acquiring lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-12bfafbd-1cbf-4c24-8ab8-13161fc759de req-d3db321a-30fb-43c3-99aa-28a6899b490c service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-12bfafbd-1cbf-4c24-8ab8-13161fc759de req-d3db321a-30fb-43c3-99aa-28a6899b490c service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-12bfafbd-1cbf-4c24-8ab8-13161fc759de req-d3db321a-30fb-43c3-99aa-28a6899b490c service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] No waiting events found dispatching network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:21 user nova-compute[74039]: WARNING nova.compute.manager [req-12bfafbd-1cbf-4c24-8ab8-13161fc759de req-d3db321a-30fb-43c3-99aa-28a6899b490c service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received unexpected event network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 for instance with vm_state building and task_state spawning.
Oct 20 08:55:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:21 user nova-compute[74039]: DEBUG nova.network.neutron [req-fdba8d76-69d5-4b20-acf2-6f0678643297 req-a3d39bc0-cf66-466d-bf8e-41440dd3b8d9 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Updated VIF entry in instance network info cache for port e7d9d83f-1522-47f7-ac4c-7dd56facfea7. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:55:21 user nova-compute[74039]: DEBUG nova.network.neutron [req-fdba8d76-69d5-4b20-acf2-6f0678643297 req-a3d39bc0-cf66-466d-bf8e-41440dd3b8d9 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Updating instance_info_cache with network_info: [{"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:55:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-fdba8d76-69d5-4b20-acf2-6f0678643297 req-a3d39bc0-cf66-466d-bf8e-41440dd3b8d9 service nova] Releasing lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:55:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-ee231f6f-bf2b-492a-8f32-0217936324be req-b882c607-e131-45cd-a416-d30bbb769965 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received event network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ee231f6f-bf2b-492a-8f32-0217936324be req-b882c607-e131-45cd-a416-d30bbb769965 service nova] Acquiring lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ee231f6f-bf2b-492a-8f32-0217936324be req-b882c607-e131-45cd-a416-d30bbb769965 service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ee231f6f-bf2b-492a-8f32-0217936324be req-b882c607-e131-45cd-a416-d30bbb769965 service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-ee231f6f-bf2b-492a-8f32-0217936324be req-b882c607-e131-45cd-a416-d30bbb769965 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] No waiting events found dispatching network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:23 user nova-compute[74039]: WARNING nova.compute.manager [req-ee231f6f-bf2b-492a-8f32-0217936324be req-b882c607-e131-45cd-a416-d30bbb769965 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received unexpected event network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 for instance with vm_state building and task_state spawning.
Oct 20 08:55:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:55:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:55:23 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Instance spawned successfully.
Oct 20 08:55:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:55:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:55:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:55:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:55:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:55:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:55:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:55:23 user nova-compute[74039]: INFO nova.compute.manager [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Took 6.07 seconds to spawn the instance on the hypervisor.
Oct 20 08:55:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:55:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:23 user nova-compute[74039]: INFO nova.compute.manager [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Took 6.98 seconds to build instance.
Oct 20 08:55:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1c610762-5c1a-4e8b-84e0-2b4a0f73a40e tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.099s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.378s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.275s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:28 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:55:28 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:55:28 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7766MB free_disk=25.708759307861328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 08:55:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:28 user nova-compute[74039]: DEBUG nova.objects.instance [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lazy-loading 'flavor' on Instance uuid 3625b19d-4394-4feb-bbe8-55a2d86dd7fb {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:55:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.203s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 9fe77a96-fcb5-4410-85cc-58d925548e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c8054dbd-c0ae-45d2-af95-dae7d05f8c69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 971fb41b-7fce-4ffe-b785-5d86f435004a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 3625b19d-4394-4feb-bbe8-55a2d86dd7fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 385b3191-b427-4e5e-af5b-d929fceef331 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance ebaa4804-32e5-4fff-9562-0587ff7ca4ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:29 user nova-compute[74039]: INFO nova.compute.manager [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Attaching volume 5adb8f90-53cf-4513-b73e-ef48fcf82408 to /dev/vdb
Oct 20 08:55:29 user nova-compute[74039]: DEBUG os_brick.utils [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc6ea1a-bcb9-4135-9044-8fc27d5f60b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[44be5f84-7013-4e88-ad12-1663b9cb54bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[869998f0-d3be-48b3-b1bb-c65997e6ad1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7eea53b-a34e-4b75-b67c-473eb1d6726c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.798s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:55:29 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee5fb72-d125-4d22-82ca-bd24d17eff7c]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG os_brick.utils [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Updating existing volume attachment record: da2c612b-b682-45ee-b0a4-6d727a94d04a {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Acquiring lock "971fb41b-7fce-4ffe-b785-5d86f435004a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lock "971fb41b-7fce-4ffe-b785-5d86f435004a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Acquiring lock "971fb41b-7fce-4ffe-b785-5d86f435004a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lock "971fb41b-7fce-4ffe-b785-5d86f435004a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lock "971fb41b-7fce-4ffe-b785-5d86f435004a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:29 user nova-compute[74039]: INFO nova.compute.manager [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Terminating instance
Oct 20 08:55:29 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-347738bb-85e4-451c-9bb5-fbb07fc6b70d req-3b37738d-e7d6-4cc7-ba62-01b408c5fd0a service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Received event network-vif-unplugged-903853f8-c5ee-49d4-9896-b50b043842c6 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-347738bb-85e4-451c-9bb5-fbb07fc6b70d req-3b37738d-e7d6-4cc7-ba62-01b408c5fd0a service nova] Acquiring lock "971fb41b-7fce-4ffe-b785-5d86f435004a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-347738bb-85e4-451c-9bb5-fbb07fc6b70d req-3b37738d-e7d6-4cc7-ba62-01b408c5fd0a service nova] Lock "971fb41b-7fce-4ffe-b785-5d86f435004a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-347738bb-85e4-451c-9bb5-fbb07fc6b70d req-3b37738d-e7d6-4cc7-ba62-01b408c5fd0a service nova] Lock "971fb41b-7fce-4ffe-b785-5d86f435004a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-347738bb-85e4-451c-9bb5-fbb07fc6b70d req-3b37738d-e7d6-4cc7-ba62-01b408c5fd0a service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] No waiting events found dispatching network-vif-unplugged-903853f8-c5ee-49d4-9896-b50b043842c6 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-347738bb-85e4-451c-9bb5-fbb07fc6b70d req-3b37738d-e7d6-4cc7-ba62-01b408c5fd0a service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Received event network-vif-unplugged-903853f8-c5ee-49d4-9896-b50b043842c6 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:55:30 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Instance destroyed successfully.
Oct 20 08:55:30 user nova-compute[74039]: DEBUG nova.objects.instance [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lazy-loading 'resources' on Instance uuid 971fb41b-7fce-4ffe-b785-5d86f435004a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:48:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-356284458',display_name='tempest-ServerStableDeviceRescueTest-server-356284458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-356284458',id=4,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJT6FK2nhGTdlNkREBn5eMAKyz3qTKNW0EHGg+clbn3CqVv1EVcSfz812n6Was/ZqxpV8bACdIlrFOPm+Iaow1Gv76MgRztK8cKPzP4Gl+n8K2P7JhSfNr1eBo6tooy5Pg==',key_name='tempest-keypair-1573659215',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:48:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b7efa953a4a4049925485acdb855247',ramdisk_id='',reservation_id='r-la35b7v7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-767632424',owner_user_name='tempest-ServerStableDeviceRescueTest-767632424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:50:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09534beb690444d6bf63e532958db714',uuid=971fb41b-7fce-4ffe-b785-5d86f435004a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "903853f8-c5ee-49d4-9896-b50b043842c6", "address": "fa:16:3e:58:48:ef", "network": {"id": "298357dd-0031-4c33-8c72-269e894c8d86", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-324557364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7efa953a4a4049925485acdb855247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903853f8-c5", "ovs_interfaceid": "903853f8-c5ee-49d4-9896-b50b043842c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Converting VIF {"id": "903853f8-c5ee-49d4-9896-b50b043842c6", "address": "fa:16:3e:58:48:ef", "network": {"id": "298357dd-0031-4c33-8c72-269e894c8d86", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-324557364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b7efa953a4a4049925485acdb855247", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903853f8-c5", "ovs_interfaceid": "903853f8-c5ee-49d4-9896-b50b043842c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:48:ef,bridge_name='br-int',has_traffic_filtering=True,id=903853f8-c5ee-49d4-9896-b50b043842c6,network=Network(298357dd-0031-4c33-8c72-269e894c8d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903853f8-c5') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG os_vif [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:48:ef,bridge_name='br-int',has_traffic_filtering=True,id=903853f8-c5ee-49d4-9896-b50b043842c6,network=Network(298357dd-0031-4c33-8c72-269e894c8d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903853f8-c5') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap903853f8-c5, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4baa333-0ee7-4794-8499-16a943dffbb5) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:55:30 user nova-compute[74039]: INFO os_vif [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:48:ef,bridge_name='br-int',has_traffic_filtering=True,id=903853f8-c5ee-49d4-9896-b50b043842c6,network=Network(298357dd-0031-4c33-8c72-269e894c8d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903853f8-c5')
Oct 20 08:55:30 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Deleting instance files /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a_del
Oct 20 08:55:30 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Deletion of /opt/stack/data/nova/instances/971fb41b-7fce-4ffe-b785-5d86f435004a_del complete
Oct 20 08:55:30 user nova-compute[74039]: INFO nova.compute.manager [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 20 08:55:30 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 08:55:30 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 08:55:31 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:55:31 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Took 0.88 seconds to deallocate network for instance.
Oct 20 08:55:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-3bb3b0d9-27e5-44fb-995c-60017c0cc323 req-d1b577bd-a3cc-4648-a5d4-c3df863d6145 service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Received event network-vif-deleted-903853f8-c5ee-49d4-9896-b50b043842c6 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:31 user nova-compute[74039]: INFO nova.compute.manager [req-3bb3b0d9-27e5-44fb-995c-60017c0cc323 req-d1b577bd-a3cc-4648-a5d4-c3df863d6145 service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Neutron deleted interface 903853f8-c5ee-49d4-9896-b50b043842c6; detaching it from the instance and deleting it from the info cache
Oct 20 08:55:31 user nova-compute[74039]: DEBUG nova.network.neutron [req-3bb3b0d9-27e5-44fb-995c-60017c0cc323 req-d1b577bd-a3cc-4648-a5d4-c3df863d6145 service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:55:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-3bb3b0d9-27e5-44fb-995c-60017c0cc323 req-d1b577bd-a3cc-4648-a5d4-c3df863d6145 service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Detach interface failed, port_id=903853f8-c5ee-49d4-9896-b50b043842c6, reason: Instance 971fb41b-7fce-4ffe-b785-5d86f435004a could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 08:55:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:32 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:55:32 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:55:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:32 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Deleted allocations for instance 971fb41b-7fce-4ffe-b785-5d86f435004a
Oct 20 08:55:32 user nova-compute[74039]: DEBUG nova.compute.manager [req-a335f285-bf73-42ed-9e2c-41470029f37e req-e6ce69a5-ca0b-42c8-9f50-d7010212889f service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Received event network-vif-plugged-903853f8-c5ee-49d4-9896-b50b043842c6 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a335f285-bf73-42ed-9e2c-41470029f37e req-e6ce69a5-ca0b-42c8-9f50-d7010212889f service nova] Acquiring lock "971fb41b-7fce-4ffe-b785-5d86f435004a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a335f285-bf73-42ed-9e2c-41470029f37e req-e6ce69a5-ca0b-42c8-9f50-d7010212889f service nova] Lock "971fb41b-7fce-4ffe-b785-5d86f435004a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a335f285-bf73-42ed-9e2c-41470029f37e req-e6ce69a5-ca0b-42c8-9f50-d7010212889f service nova] Lock "971fb41b-7fce-4ffe-b785-5d86f435004a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:32 user nova-compute[74039]: DEBUG nova.compute.manager [req-a335f285-bf73-42ed-9e2c-41470029f37e req-e6ce69a5-ca0b-42c8-9f50-d7010212889f service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] No waiting events found dispatching network-vif-plugged-903853f8-c5ee-49d4-9896-b50b043842c6 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:32 user nova-compute[74039]: WARNING nova.compute.manager [req-a335f285-bf73-42ed-9e2c-41470029f37e req-e6ce69a5-ca0b-42c8-9f50-d7010212889f service nova] [instance: 971fb41b-7fce-4ffe-b785-5d86f435004a] Received unexpected event network-vif-plugged-903853f8-c5ee-49d4-9896-b50b043842c6 for instance with vm_state deleted and task_state None.
Oct 20 08:55:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f255e572-17d1-440d-ad01-fd983cafaa2d tempest-ServerStableDeviceRescueTest-767632424 tempest-ServerStableDeviceRescueTest-767632424-project-member] Lock "971fb41b-7fce-4ffe-b785-5d86f435004a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.581s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDUXuOSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:55:37 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:55:37 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:55:37 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8aba427-b73e-4949-bb6d-ece1e2207d49]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 08:55:37 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b605af6d-8121-4382-9052-98f3e9eae3c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a] added
Oct 20 08:55:37 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[00aa41f6-cb77-414f-83d8-558f02e69871]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e26c62-f7ae-409d-884c-ab860c7961db]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CDUXuOSq {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CDUXuOSq" returned: 0 in 0.067s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cea5d96-6105-4e2d-a57f-878e97594836]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CDUXuOSq'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcb68d2-a8c3-4553-a7e6-1d6cfe4c0b9f]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1227270-b123-4dd3-9668-00b757425330]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 08:55:37 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 08:55:37 user nova-compute[74039]:  {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:55:37 user nova-compute[74039]: WARNING os_brick.initiator.connectors.iscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 08:55:37 user nova-compute[74039]: 
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3eaf6e-d42d-4a08-9971-9d6416d7e7d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a, portal: 172.16.0.220,3260]
Oct 20 08:55:37 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a, portal: 172.16.0.220,3260] successful.
Oct 20 08:55:37 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4011e23f-b11a-4f7a-b3f6-e5e1cf2579dc]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8939b8f6-0c68-4a9c-8cbf-dbed9bf59046]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)
Oct 20 08:55:37 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)
Oct 20 08:55:37 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[79379c19-89a1-4d69-bc3f-f6c7575ed02f]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:55:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDUXuOSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 08:55:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:55:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23332666562323462', 'path': '/dev/sdb'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:55:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332666562323462', 'path': '/dev/sdb'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 08:55:38 user nova-compute[74039]: DEBUG nova.objects.instance [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lazy-loading 'flavor' on Instance uuid 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:55:39 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 08:55:39 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:55:39 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 08:55:39 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 08:55:39 user nova-compute[74039]:   <serial>4e26a4a0-8c25-4f88-915d-503058b5464a</serial>
Oct 20 08:55:39 user nova-compute[74039]: </disk>
Oct 20 08:55:39 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 08:55:39 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:55:39 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:55:39 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] No VIF found with MAC fa:16:3e:38:e8:6c, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:55:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-89b89e73-c706-464f-9a1a-4b7e3fc87028 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 98.548s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 47.233s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:40 user nova-compute[74039]: INFO nova.compute.manager [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Rebuilding instance
Oct 20 08:55:40 user nova-compute[74039]: DEBUG nova.compute.manager [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG nova.compute.manager [req-34a46ab1-03de-447b-92fe-4e7dc1c741da req-729ef873-457a-4932-a469-d640483588a1 service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Received event network-vif-unplugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-34a46ab1-03de-447b-92fe-4e7dc1c741da req-729ef873-457a-4932-a469-d640483588a1 service nova] Acquiring lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-34a46ab1-03de-447b-92fe-4e7dc1c741da req-729ef873-457a-4932-a469-d640483588a1 service nova] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-34a46ab1-03de-447b-92fe-4e7dc1c741da req-729ef873-457a-4932-a469-d640483588a1 service nova] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG nova.compute.manager [req-34a46ab1-03de-447b-92fe-4e7dc1c741da req-729ef873-457a-4932-a469-d640483588a1 service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] No waiting events found dispatching network-vif-unplugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:41 user nova-compute[74039]: WARNING nova.compute.manager [req-34a46ab1-03de-447b-92fe-4e7dc1c741da req-729ef873-457a-4932-a469-d640483588a1 service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Received unexpected event network-vif-unplugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d for instance with vm_state active and task_state rebuilding.
Oct 20 08:55:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:41 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Instance destroyed successfully.
Oct 20 08:55:41 user nova-compute[74039]: INFO nova.compute.manager [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Detaching volume 4e26a4a0-8c25-4f88-915d-503058b5464a
Oct 20 08:55:41 user nova-compute[74039]: INFO nova.virt.block_device [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Attempting to driver detach volume 4e26a4a0-8c25-4f88-915d-503058b5464a from mountpoint /dev/vdb
Oct 20 08:55:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Attempting to detach device vdb from instance 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 08:55:41 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:55:41 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 08:55:41 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 08:55:41 user nova-compute[74039]:   <serial>4e26a4a0-8c25-4f88-915d-503058b5464a</serial>
Oct 20 08:55:41 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 08:55:41 user nova-compute[74039]: </disk>
Oct 20 08:55:41 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 08:55:41 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Successfully detached device vdb from instance 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 from the persistent domain config.
Oct 20 08:55:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDUXuOSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:55:41 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 08:55:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a37c31d-9519-42e5-a07b-cd66d25eaa7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 08:55:41 user nova-compute[74039]: No targets found.
Oct 20 08:55:41 user nova-compute[74039]: iSNS:
Oct 20 08:55:41 user nova-compute[74039]: No targets found.
Oct 20 08:55:41 user nova-compute[74039]: STATIC:
Oct 20 08:55:41 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a
Oct 20 08:55:41 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:55:41 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:55:41 user nova-compute[74039]: FIRMWARE:
Oct 20 08:55:41 user nova-compute[74039]: No targets found.
Oct 20 08:55:41 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 08:55:41 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 08:55:41 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e06dd73-18e5-4407-b2fb-9140c8d50eb6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f496a2-84c7-498a-9219-ddb58b13699d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)
Oct 20 08:55:42 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)
Oct 20 08:55:42 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae7c1471c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a'): ({'sdb'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Removing single pathed devices sdb {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bf867c-6af6-47c1-a94f-7d3adc452691]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a2c7da-2d30-4b30-b552-d5098172bd2e]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Flushing IO for device /dev/sdb {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f090b6c8-76c5-4ce2-9a1c-e01751a21596]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9550207c-192b-4484-b968-d21e9edb169f]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5430b8e-3d58-4605-a791-884eed2718b7]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ab1d54-0f75-45f2-982f-06ca260fe62d]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a, portal: 172.16.0.220,3260]
Oct 20 08:55:42 user nova-compute[74039]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a, portal: 172.16.0.220,3260] successful.
Oct 20 08:55:42 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bb1a3a-c6c7-426b-b2f9-5bd7d43c13f0]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] <== disconnect_volume: return (298ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:55:42 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:43 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Instance destroyed successfully.
Oct 20 08:55:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1458942537',display_name='tempest-ServerActionsTestOtherA-server-1019279431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1458942537',id=11,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTUpP2s33VfTl03H4wvNfWkRjE/JJ83tB47a0/XPOlnK2KS6d8iUtfaEnWynmonaIFqIQH11WXYG7tk5jqZm5Ea/itjl2zitoH8eHQjsIO5JMBUmZ70QQYY8ASvSrGQlA==',key_name='tempest-keypair-1150525820',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:52:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='88a58985dce3491d8e45e6e468e0e549',ramdisk_id='',reservation_id='r-y9rntpk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1138208404',owner_user_name='tempest-ServerActionsTestOtherA-1138208404-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:55:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb823f0374a04657be729eb153160659',uuid=54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "address": "fa:16:3e:38:e8:6c", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9df57e-7c", "ovs_interfaceid": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converting VIF {"id": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "address": "fa:16:3e:38:e8:6c", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9df57e-7c", "ovs_interfaceid": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9df57e-7c') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG os_vif [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9df57e-7c') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b9df57e-7c, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bce59743-5d31-4605-af30-2dc4c3ce3872) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:55:43 user nova-compute[74039]: INFO os_vif [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9df57e-7c')
Oct 20 08:55:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDUXuOSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:55:43 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 08:55:43 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[5c2fdc9b-a1c7-42f3-afea-a92b31a4b26a]: Unexpected error while running command.
Oct 20 08:55:43 user nova-compute[74039]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 08:55:43 user nova-compute[74039]: Exit code: 21
Oct 20 08:55:43 user nova-compute[74039]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 08:55:43 user nova-compute[74039]: Stderr: '' {{(pid=85466) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 20 08:55:43 user nova-compute[74039]: Traceback (most recent call last):
Oct 20 08:55:43 user nova-compute[74039]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 20 08:55:43 user nova-compute[74039]:     ret = func(*f_args, **f_kwargs)
Oct 20 08:55:43 user nova-compute[74039]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 20 08:55:43 user nova-compute[74039]:     return func(*args, **kwargs)
Oct 20 08:55:43 user nova-compute[74039]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 20 08:55:43 user nova-compute[74039]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 20 08:55:43 user nova-compute[74039]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 20 08:55:43 user nova-compute[74039]:     return putils.execute(on_execute=on_execute,
Oct 20 08:55:43 user nova-compute[74039]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 20 08:55:43 user nova-compute[74039]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 20 08:55:43 user nova-compute[74039]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 08:55:43 user nova-compute[74039]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 08:55:43 user nova-compute[74039]: Exit code: 21
Oct 20 08:55:43 user nova-compute[74039]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 08:55:43 user nova-compute[74039]: Stderr: ''
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2fdc9b-a1c7-42f3-afea-a92b31a4b26a]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 08:55:43 user nova-compute[74039]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 08:55:43 user nova-compute[74039]: Exit code: 21
Oct 20 08:55:43 user nova-compute[74039]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 08:55:43 user nova-compute[74039]: Stderr: ''
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/compute/manager.py", line 4131, in _do_rebuild_instance
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi     self.driver.rebuild(**kwargs)
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi     raise NotImplementedError()
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi NotImplementedError
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi 
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi During handling of the above exception, another exception occurred:
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi 
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 20 08:55:43 user nova-compute[74039]: ERROR os_brick.initiator.connectors.iscsi 
Oct 20 08:55:43 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74039) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.034s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] <== disconnect_volume: return (35ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 08:55:43 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Deleting instance files /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11_del
Oct 20 08:55:43 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Deletion of /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11_del complete
Oct 20 08:55:43 user nova-compute[74039]: INFO nova.virt.block_device [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Booting with volume 4e26a4a0-8c25-4f88-915d-503058b5464a at /dev/vdb
Oct 20 08:55:43 user nova-compute[74039]: DEBUG nova.compute.manager [req-96f25df9-9c50-4a79-acf7-e041a720ed33 req-9ed5d4c9-f530-4bcf-850a-11c8d1ac3dac service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Received event network-vif-plugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-96f25df9-9c50-4a79-acf7-e041a720ed33 req-9ed5d4c9-f530-4bcf-850a-11c8d1ac3dac service nova] Acquiring lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-96f25df9-9c50-4a79-acf7-e041a720ed33 req-9ed5d4c9-f530-4bcf-850a-11c8d1ac3dac service nova] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-96f25df9-9c50-4a79-acf7-e041a720ed33 req-9ed5d4c9-f530-4bcf-850a-11c8d1ac3dac service nova] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG nova.compute.manager [req-96f25df9-9c50-4a79-acf7-e041a720ed33 req-9ed5d4c9-f530-4bcf-850a-11c8d1ac3dac service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] No waiting events found dispatching network-vif-plugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:55:43 user nova-compute[74039]: WARNING nova.compute.manager [req-96f25df9-9c50-4a79-acf7-e041a720ed33 req-9ed5d4c9-f530-4bcf-850a-11c8d1ac3dac service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Received unexpected event network-vif-plugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d for instance with vm_state active and task_state rebuild_block_device_mapping.
Oct 20 08:55:43 user nova-compute[74039]: DEBUG os_brick.utils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c44296-bced-41d7-a9a5-dcc7d5ed1b88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3ae9d2-6f54-47ad-a577-cdd423743219]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aa3a16-7ec6-43b7-97ea-edee09e70e8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba11c007-4947-4f2f-8ae4-71efe8189a57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:55:43 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:55:43 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3565a7d7-7e7e-4919-8738-eae0d18e8f28]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG os_brick.utils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:55:43 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Updating existing volume attachment record: 355d6a32-43c4-4074-9f1f-3cc040ef1982 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 08:55:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:55:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:56:01 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:56:01 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Creating image(s)
Oct 20 08:56:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "/opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "/opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "/opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.198s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.168s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk 1073741824" returned: 0 in 0.056s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.196s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:01 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 08:56:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Cannot resize image /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Ensure instance console log exists: /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Start _get_guest_xml network_info=[{"id": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "address": "fa:16:3e:38:e8:6c", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9df57e-7c", "ovs_interfaceid": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '355d6a32-43c4-4074-9f1f-3cc040ef1982', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDUXuOSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11', 'attached_at': '', 'detached_at': '', 'volume_id': '4e26a4a0-8c25-4f88-915d-503058b5464a', 'serial': '4e26a4a0-8c25-4f88-915d-503058b5464a'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:56:02 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 08:56:02 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.objects.instance [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lazy-loading 'vcpu_model' on Instance uuid 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDUXuOSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:56:02 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:56:02 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:56:02 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fb8e70-7f58-4bea-b80c-95dba489b44c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 08:56:02 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65e7ebe-0c84-4092-ac69-11cf642a6ab4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a] added
Oct 20 08:56:02 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f9fe1c-e40c-4cce-9086-14a9f6244bc2]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9c0b4c-07ec-4045-8f66-2f031cace2ce]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CDUXuOSq {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CDUXuOSq" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[312b3145-f529-4944-b6b8-059b6dead252]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CDUXuOSq'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4214d259-3e6f-4e23-8a01-cd76ed4a2b89]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ab48aa-0814-463c-a43d-8073b1f02a27]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 08:56:02 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 08:56:02 user nova-compute[74039]:  {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:56:02 user nova-compute[74039]: WARNING os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 08:56:02 user nova-compute[74039]: : NotImplementedError
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb27f1d-f284-4c6f-b1db-4770b16c0f5c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a, portal: 172.16.0.220,3260]
Oct 20 08:56:02 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a, portal: 172.16.0.220,3260] successful.
Oct 20 08:56:02 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c40acc-dbf5-4f87-808b-b67ab8847419]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f23fb8-f99f-4e61-aa59-cd51a8b468f9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)
Oct 20 08:56:02 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)
Oct 20 08:56:02 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b3bbbc-cb7d-4dee-b0ea-98df366283de]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:02 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDUXuOSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23332666562323462', 'path': '/dev/sdb'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332666562323462', 'path': '/dev/sdb'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T08:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1458942537',display_name='tempest-ServerActionsTestOtherA-server-1019279431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1458942537',id=11,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTUpP2s33VfTl03H4wvNfWkRjE/JJ83tB47a0/XPOlnK2KS6d8iUtfaEnWynmonaIFqIQH11WXYG7tk5jqZm5Ea/itjl2zitoH8eHQjsIO5JMBUmZ70QQYY8ASvSrGQlA==',key_name='tempest-keypair-1150525820',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:52:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='88a58985dce3491d8e45e6e468e0e549',ramdisk_id='',reservation_id='r-y9rntpk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1138208404',owner_user_name='tempest-ServerActionsTestOtherA-1138208404-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:55:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb823f0374a04657be729eb153160659',uuid=54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "address": "fa:16:3e:38:e8:6c", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9df57e-7c", "ovs_interfaceid": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converting VIF {"id": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "address": "fa:16:3e:38:e8:6c", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9df57e-7c", "ovs_interfaceid": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9df57e-7c') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:56:03 user nova-compute[74039]:   <uuid>54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11</uuid>
Oct 20 08:56:03 user nova-compute[74039]:   <name>instance-0000000b</name>
Oct 20 08:56:03 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:56:03 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:56:03 user nova-compute[74039]:   <metadata>
Oct 20 08:56:03 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:56:03 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:56:03 user nova-compute[74039]:       <nova:name>tempest-ServerActionsTestOtherA-server-1019279431</nova:name>
Oct 20 08:56:03 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:56:02</nova:creationTime>
Oct 20 08:56:03 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:56:03 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:56:03 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:56:03 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:56:03 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:56:03 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:56:03 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:56:03 user nova-compute[74039]:       <nova:owner>
Oct 20 08:56:03 user nova-compute[74039]:         <nova:user uuid="cb823f0374a04657be729eb153160659">tempest-ServerActionsTestOtherA-1138208404-project-member</nova:user>
Oct 20 08:56:03 user nova-compute[74039]:         <nova:project uuid="88a58985dce3491d8e45e6e468e0e549">tempest-ServerActionsTestOtherA-1138208404</nova:project>
Oct 20 08:56:03 user nova-compute[74039]:       </nova:owner>
Oct 20 08:56:03 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:56:03 user nova-compute[74039]:       <nova:ports>
Oct 20 08:56:03 user nova-compute[74039]:         <nova:port uuid="8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d">
Oct 20 08:56:03 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 08:56:03 user nova-compute[74039]:         </nova:port>
Oct 20 08:56:03 user nova-compute[74039]:       </nova:ports>
Oct 20 08:56:03 user nova-compute[74039]:     </nova:instance>
Oct 20 08:56:03 user nova-compute[74039]:   </metadata>
Oct 20 08:56:03 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:56:03 user nova-compute[74039]:     <system>
Oct 20 08:56:03 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:56:03 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:56:03 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:56:03 user nova-compute[74039]:       <entry name="serial">54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11</entry>
Oct 20 08:56:03 user nova-compute[74039]:       <entry name="uuid">54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11</entry>
Oct 20 08:56:03 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:56:03 user nova-compute[74039]:     </system>
Oct 20 08:56:03 user nova-compute[74039]:   </sysinfo>
Oct 20 08:56:03 user nova-compute[74039]:   <os>
Oct 20 08:56:03 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:56:03 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:56:03 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:56:03 user nova-compute[74039]:   </os>
Oct 20 08:56:03 user nova-compute[74039]:   <features>
Oct 20 08:56:03 user nova-compute[74039]:     <acpi/>
Oct 20 08:56:03 user nova-compute[74039]:     <apic/>
Oct 20 08:56:03 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:56:03 user nova-compute[74039]:   </features>
Oct 20 08:56:03 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:56:03 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:56:03 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:56:03 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:56:03 user nova-compute[74039]:   </clock>
Oct 20 08:56:03 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:56:03 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:56:03 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:56:03 user nova-compute[74039]:   </cpu>
Oct 20 08:56:03 user nova-compute[74039]:   <devices>
Oct 20 08:56:03 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:56:03 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:56:03 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk"/>
Oct 20 08:56:03 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:56:03 user nova-compute[74039]:     </disk>
Oct 20 08:56:03 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 08:56:03 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:56:03 user nova-compute[74039]:       <source dev="/dev/sdb"/>
Oct 20 08:56:03 user nova-compute[74039]:       <target dev="vdb" bus="virtio"/>
Oct 20 08:56:03 user nova-compute[74039]:       <serial>4e26a4a0-8c25-4f88-915d-503058b5464a</serial>
Oct 20 08:56:03 user nova-compute[74039]:     </disk>
Oct 20 08:56:03 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:56:03 user nova-compute[74039]:       <mac address="fa:16:3e:38:e8:6c"/>
Oct 20 08:56:03 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:56:03 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:56:03 user nova-compute[74039]:       <target dev="tap8b9df57e-7c"/>
Oct 20 08:56:03 user nova-compute[74039]:     </interface>
Oct 20 08:56:03 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:56:03 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/console.log" append="off"/>
Oct 20 08:56:03 user nova-compute[74039]:     </serial>
Oct 20 08:56:03 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:56:03 user nova-compute[74039]:     <video>
Oct 20 08:56:03 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:56:03 user nova-compute[74039]:     </video>
Oct 20 08:56:03 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:56:03 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:56:03 user nova-compute[74039]:     </rng>
Oct 20 08:56:03 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:56:03 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:56:03 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:56:03 user nova-compute[74039]:     </memballoon>
Oct 20 08:56:03 user nova-compute[74039]:   </devices>
Oct 20 08:56:03 user nova-compute[74039]: </domain>
Oct 20 08:56:03 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T08:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1458942537',display_name='tempest-ServerActionsTestOtherA-server-1019279431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1458942537',id=11,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTUpP2s33VfTl03H4wvNfWkRjE/JJ83tB47a0/XPOlnK2KS6d8iUtfaEnWynmonaIFqIQH11WXYG7tk5jqZm5Ea/itjl2zitoH8eHQjsIO5JMBUmZ70QQYY8ASvSrGQlA==',key_name='tempest-keypair-1150525820',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:52:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='88a58985dce3491d8e45e6e468e0e549',ramdisk_id='',reservation_id='r-y9rntpk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1138208404',owner_user_name='tempest-ServerActionsTestOtherA-1138208404-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:55:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb823f0374a04657be729eb153160659',uuid=54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "address": "fa:16:3e:38:e8:6c", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9df57e-7c", "ovs_interfaceid": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converting VIF {"id": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "address": "fa:16:3e:38:e8:6c", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9df57e-7c", "ovs_interfaceid": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9df57e-7c') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG os_vif [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9df57e-7c') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '881b0480-767e-56b2-b961-a9b5ebae4e69', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b9df57e-7c, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b9df57e-7c, col_values=(('qos', UUID('f23c45ca-d68a-4775-ac5c-23be8f1eaeba')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b9df57e-7c, col_values=(('external_ids', {'iface-id': '8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:e8:6c', 'vm-uuid': '54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:03 user nova-compute[74039]: INFO os_vif [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9df57e-7c')
Oct 20 08:56:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:56:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] No VIF found with MAC fa:16:3e:38:e8:6c, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:56:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:05 user nova-compute[74039]: DEBUG nova.compute.manager [req-173b3944-23c1-412a-9809-e533fd7706d6 req-4bafb7c5-d670-4f27-bffc-dc75bc0873d4 service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Received event network-vif-plugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:56:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-173b3944-23c1-412a-9809-e533fd7706d6 req-4bafb7c5-d670-4f27-bffc-dc75bc0873d4 service nova] Acquiring lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-173b3944-23c1-412a-9809-e533fd7706d6 req-4bafb7c5-d670-4f27-bffc-dc75bc0873d4 service nova] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-173b3944-23c1-412a-9809-e533fd7706d6 req-4bafb7c5-d670-4f27-bffc-dc75bc0873d4 service nova] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:05 user nova-compute[74039]: DEBUG nova.compute.manager [req-173b3944-23c1-412a-9809-e533fd7706d6 req-4bafb7c5-d670-4f27-bffc-dc75bc0873d4 service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] No waiting events found dispatching network-vif-plugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:56:05 user nova-compute[74039]: WARNING nova.compute.manager [req-173b3944-23c1-412a-9809-e533fd7706d6 req-4bafb7c5-d670-4f27-bffc-dc75bc0873d4 service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Received unexpected event network-vif-plugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d for instance with vm_state active and task_state rebuild_spawning.
Oct 20 08:56:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-c1578934-4c80-4b3b-881e-9052e3925611 req-2951c02e-6175-4969-a7b3-b5780636c87a service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Received event network-vif-plugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:56:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c1578934-4c80-4b3b-881e-9052e3925611 req-2951c02e-6175-4969-a7b3-b5780636c87a service nova] Acquiring lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c1578934-4c80-4b3b-881e-9052e3925611 req-2951c02e-6175-4969-a7b3-b5780636c87a service nova] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c1578934-4c80-4b3b-881e-9052e3925611 req-2951c02e-6175-4969-a7b3-b5780636c87a service nova] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-c1578934-4c80-4b3b-881e-9052e3925611 req-2951c02e-6175-4969-a7b3-b5780636c87a service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] No waiting events found dispatching network-vif-plugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:56:07 user nova-compute[74039]: WARNING nova.compute.manager [req-c1578934-4c80-4b3b-881e-9052e3925611 req-2951c02e-6175-4969-a7b3-b5780636c87a service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Received unexpected event network-vif-plugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d for instance with vm_state active and task_state rebuild_spawning.
Oct 20 08:56:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:56:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:56:07 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Instance spawned successfully.
Oct 20 08:56:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:56:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:56:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:56:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:56:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:56:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:56:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:56:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:56:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:07 user nova-compute[74039]: DEBUG nova.objects.instance [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74039) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 20 08:56:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-152191e1-cc28-43b0-8952-20cef625b232 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.070s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:56:17 user nova-compute[74039]: DEBUG nova.compute.manager [req-c0a30621-2858-4bfc-a6e6-c63e61f48c56 req-e8452678-35b6-4805-b808-d13d522dbb55 service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Received event network-changed-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:56:17 user nova-compute[74039]: DEBUG nova.compute.manager [req-c0a30621-2858-4bfc-a6e6-c63e61f48c56 req-e8452678-35b6-4805-b808-d13d522dbb55 service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Refreshing instance network info cache due to event network-changed-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:56:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c0a30621-2858-4bfc-a6e6-c63e61f48c56 req-e8452678-35b6-4805-b808-d13d522dbb55 service nova] Acquiring lock "refresh_cache-385b3191-b427-4e5e-af5b-d929fceef331" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:56:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c0a30621-2858-4bfc-a6e6-c63e61f48c56 req-e8452678-35b6-4805-b808-d13d522dbb55 service nova] Acquired lock "refresh_cache-385b3191-b427-4e5e-af5b-d929fceef331" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:56:17 user nova-compute[74039]: DEBUG nova.network.neutron [req-c0a30621-2858-4bfc-a6e6-c63e61f48c56 req-e8452678-35b6-4805-b808-d13d522dbb55 service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Refreshing network info cache for port 29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:56:17 user nova-compute[74039]: DEBUG nova.network.neutron [req-c0a30621-2858-4bfc-a6e6-c63e61f48c56 req-e8452678-35b6-4805-b808-d13d522dbb55 service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Updated VIF entry in instance network info cache for port 29dcf3b3-1006-42c8-9cb1-5ed5cb792b06. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:56:17 user nova-compute[74039]: DEBUG nova.network.neutron [req-c0a30621-2858-4bfc-a6e6-c63e61f48c56 req-e8452678-35b6-4805-b808-d13d522dbb55 service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Updating instance_info_cache with network_info: [{"id": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "address": "fa:16:3e:9e:9f:f3", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29dcf3b3-10", "ovs_interfaceid": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:56:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c0a30621-2858-4bfc-a6e6-c63e61f48c56 req-e8452678-35b6-4805-b808-d13d522dbb55 service nova] Releasing lock "refresh_cache-385b3191-b427-4e5e-af5b-d929fceef331" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:56:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:21 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:56:21 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:56:21 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:56:21 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 08:56:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-c8054dbd-c0ae-45d2-af95-dae7d05f8c69" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:56:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-c8054dbd-c0ae-45d2-af95-dae7d05f8c69" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:56:21 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 08:56:22 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Updating instance_info_cache with network_info: [{"id": "24716055-5932-4507-8742-840afce654a2", "address": "fa:16:3e:3e:2e:b3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24716055-59", "ovs_interfaceid": "24716055-5932-4507-8742-840afce654a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:56:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-c8054dbd-c0ae-45d2-af95-dae7d05f8c69" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:56:22 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 08:56:22 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:56:22 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:56:22 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:56:22 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:56:22 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:56:22 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:56:22 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 08:56:22 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:56:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:22 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 08:56:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 08:56:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:25 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:56:25 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:56:25 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7863MB free_disk=25.727508544921875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 08:56:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 9fe77a96-fcb5-4410-85cc-58d925548e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:56:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c8054dbd-c0ae-45d2-af95-dae7d05f8c69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:56:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:56:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:56:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 3625b19d-4394-4feb-bbe8-55a2d86dd7fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:56:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 385b3191-b427-4e5e-af5b-d929fceef331 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:56:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance ebaa4804-32e5-4fff-9562-0587ff7ca4ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:56:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 08:56:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 08:56:26 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:56:26 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:56:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 08:56:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjbZigYR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:56:36 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:56:36 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:56:36 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d821489b-3b12-41f4-b0f3-277fe2ca6226]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 08:56:36 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f8d04a-736c-4b27-977a-9941dd2f1f59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408] added
Oct 20 08:56:36 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[261862ac-1f09-44d8-816f-dec57d9ba74a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[704b7972-9132-47e4-a515-48e893384ee1]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qjbZigYR {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qjbZigYR" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3f35bb-9efe-439d-894f-e750a58742e8]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qjbZigYR'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[758078f0-a7cf-40f4-8bc2-0da031f0b51e]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad616927-8830-44f7-81d6-f287f1a3cec9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)
Oct 20 08:56:36 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)
Oct 20 08:56:36 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[601b8cf4-900b-40a3-b6ac-22535254e2fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408, portal: 172.16.0.220,3260]
Oct 20 08:56:36 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408, portal: 172.16.0.220,3260] successful.
Oct 20 08:56:36 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8da4806-519e-4ea8-b319-14c0d05814e1]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dab48e-ba54-4bea-9fb9-0f7ba359ec49]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)
Oct 20 08:56:36 user nova-compute[74039]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 (non-flash)
Oct 20 08:56:36 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)
Oct 20 08:56:36 user nova-compute[74039]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 (non-flash)
Oct 20 08:56:36 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2736a976-6b0e-45df-9243-ad93482cf3ef]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:56:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjbZigYR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d57afaa2-dea8-4f31-a9b0-ea0371c6f5ca tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "385b3191-b427-4e5e-af5b-d929fceef331" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d57afaa2-dea8-4f31-a9b0-ea0371c6f5ca tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "385b3191-b427-4e5e-af5b-d929fceef331" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG nova.objects.instance [None req-d57afaa2-dea8-4f31-a9b0-ea0371c6f5ca tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lazy-loading 'flavor' on Instance uuid 385b3191-b427-4e5e-af5b-d929fceef331 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d57afaa2-dea8-4f31-a9b0-ea0371c6f5ca tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "385b3191-b427-4e5e-af5b-d929fceef331" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d57afaa2-dea8-4f31-a9b0-ea0371c6f5ca tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "385b3191-b427-4e5e-af5b-d929fceef331" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d57afaa2-dea8-4f31-a9b0-ea0371c6f5ca tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "385b3191-b427-4e5e-af5b-d929fceef331" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:37 user nova-compute[74039]: INFO nova.compute.manager [None req-d57afaa2-dea8-4f31-a9b0-ea0371c6f5ca tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Attaching volume 2b8970f8-893d-4890-baf2-2576089722f1 to /dev/vdb
Oct 20 08:56:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23564356132386135', 'path': '/dev/sdc'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564356132386135', 'path': '/dev/sdc'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG nova.objects.instance [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lazy-loading 'flavor' on Instance uuid 3625b19d-4394-4feb-bbe8-55a2d86dd7fb {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 08:56:37 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:56:37 user nova-compute[74039]:   <source dev="/dev/sdc"/>
Oct 20 08:56:37 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 08:56:37 user nova-compute[74039]:   <serial>5adb8f90-53cf-4513-b73e-ef48fcf82408</serial>
Oct 20 08:56:37 user nova-compute[74039]: </disk>
Oct 20 08:56:37 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG os_brick.utils [None req-d57afaa2-dea8-4f31-a9b0-ea0371c6f5ca tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4d7c08-42ab-4067-b1b7-bd4e33759c30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7448a7c1-6ccb-4293-8808-0f8ebf4151ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9618bcf5-6ef5-43e2-a779-8336ea529ecd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0216ccb8-56f7-4ecb-97b7-9a037280d250]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d57afaa2-dea8-4f31-a9b0-ea0371c6f5ca tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d57afaa2-dea8-4f31-a9b0-ea0371c6f5ca tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d57afaa2-dea8-4f31-a9b0-ea0371c6f5ca tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:56:37 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:56:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb77560-3ecd-4c0c-a3b4-f3e47b29c50b]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:56:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-d57afaa2-dea8-4f31-a9b0-ea0371c6f5ca tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:56:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-d57afaa2-dea8-4f31-a9b0-ea0371c6f5ca tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:56:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-d57afaa2-dea8-4f31-a9b0-ea0371c6f5ca tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:56:38 user nova-compute[74039]: DEBUG os_brick.utils [None req-d57afaa2-dea8-4f31-a9b0-ea0371c6f5ca tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:56:38 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-d57afaa2-dea8-4f31-a9b0-ea0371c6f5ca tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Updating existing volume attachment record: b35472b5-6f70-4aba-b4f2-e9301460d225 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 08:56:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:56:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:56:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] No VIF found with MAC fa:16:3e:54:60:7c, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:56:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c68dcff4-572d-45c6-ba07-34415a4dc268 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 69.165s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:40 user nova-compute[74039]: INFO nova.compute.manager [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Detaching volume 5adb8f90-53cf-4513-b73e-ef48fcf82408
Oct 20 08:56:40 user nova-compute[74039]: INFO nova.virt.block_device [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Attempting to driver detach volume 5adb8f90-53cf-4513-b73e-ef48fcf82408 from mountpoint /dev/vdb
Oct 20 08:56:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Attempting to detach device vdb from instance 3625b19d-4394-4feb-bbe8-55a2d86dd7fb from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 08:56:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 08:56:40 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:56:40 user nova-compute[74039]:   <source dev="/dev/sdc"/>
Oct 20 08:56:40 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 08:56:40 user nova-compute[74039]:   <serial>5adb8f90-53cf-4513-b73e-ef48fcf82408</serial>
Oct 20 08:56:40 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 08:56:40 user nova-compute[74039]: </disk>
Oct 20 08:56:40 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 08:56:40 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Successfully detached device vdb from instance 3625b19d-4394-4feb-bbe8-55a2d86dd7fb from the persistent domain config.
Oct 20 08:56:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3625b19d-4394-4feb-bbe8-55a2d86dd7fb from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 08:56:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 08:56:40 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:56:40 user nova-compute[74039]:   <source dev="/dev/sdc"/>
Oct 20 08:56:40 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 08:56:40 user nova-compute[74039]:   <serial>5adb8f90-53cf-4513-b73e-ef48fcf82408</serial>
Oct 20 08:56:40 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 08:56:40 user nova-compute[74039]: </disk>
Oct 20 08:56:40 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 08:56:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3625b19d-4394-4feb-bbe8-55a2d86dd7fb {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 08:56:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "03e487d1-90aa-436d-9c2f-468f9791af91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "03e487d1-90aa-436d-9c2f-468f9791af91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 08:56:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:48 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:56:48 user nova-compute[74039]: INFO nova.compute.claims [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Claim successful on node user
Oct 20 08:56:49 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:56:49 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:56:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:49 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 08:56:49 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 08:56:49 user nova-compute[74039]: DEBUG nova.network.neutron [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:56:49 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 08:56:49 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 08:56:49 user nova-compute[74039]: DEBUG nova.policy [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af6af67060414d48b96ee116b9e6dbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d044b69c56433ca011f220f8578407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:56:49 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 08:56:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:56:49 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Creating image(s)
Oct 20 08:56:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "/opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "/opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "/opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894.part --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:50 user nova-compute[74039]: DEBUG nova.network.neutron [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Successfully created port: 7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:56:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894.part --force-share --output=json" returned: 0 in 0.208s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:50 user nova-compute[74039]: DEBUG nova.virt.images [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] 60dbb338-0365-4d23-b037-a87dd89bac9a was qcow2, converting to raw {{(pid=74039) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 08:56:50 user nova-compute[74039]: DEBUG nova.privsep.utils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74039) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 08:56:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894.part /opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894.converted {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894.part /opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894.converted" returned: 0 in 0.361s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894.converted --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894.converted --force-share --output=json" returned: 0 in 0.226s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.295s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894 --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.network.neutron [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Successfully updated port: 7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquired lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.network.neutron [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-6ba3cfe7-bb0b-4628-8a4b-63398daee5ad req-cf242084-e23c-4c1e-a26a-8d30e25766f9 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received event network-changed-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-6ba3cfe7-bb0b-4628-8a4b-63398daee5ad req-cf242084-e23c-4c1e-a26a-8d30e25766f9 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Refreshing instance network info cache due to event network-changed-7f2d5682-0113-40f4-8bbb-02e87564b7ef. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6ba3cfe7-bb0b-4628-8a4b-63398daee5ad req-cf242084-e23c-4c1e-a26a-8d30e25766f9 service nova] Acquiring lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.network.neutron [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894 --force-share --output=json" returned: 0 in 0.203s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894,backing_fmt=raw /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894,backing_fmt=raw /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk 1073741824" returned: 0 in 0.071s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.network.neutron [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Updating instance_info_cache with network_info: [{"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894 --force-share --output=json" returned: 0 in 0.217s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Releasing lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Instance network_info: |[{"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6ba3cfe7-bb0b-4628-8a4b-63398daee5ad req-cf242084-e23c-4c1e-a26a-8d30e25766f9 service nova] Acquired lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.network.neutron [req-6ba3cfe7-bb0b-4628-8a4b-63398daee5ad req-cf242084-e23c-4c1e-a26a-8d30e25766f9 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Refreshing network info cache for port 7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Cannot resize image /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Ensure instance console log exists: /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Start _get_guest_xml network_info=[{"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:56:46Z,direct_url=<?>,disk_format='qcow2',id=60dbb338-0365-4d23-b037-a87dd89bac9a,min_disk=0,min_ram=0,name='tempest-scenario-img--1220700971',owner='d9d044b69c56433ca011f220f8578407',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:56:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': '60dbb338-0365-4d23-b037-a87dd89bac9a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:56:51 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:56:51 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:56:46Z,direct_url=<?>,disk_format='qcow2',id=60dbb338-0365-4d23-b037-a87dd89bac9a,min_disk=0,min_ram=0,name='tempest-scenario-img--1220700971',owner='d9d044b69c56433ca011f220f8578407',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:56:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-250189437',display_name='tempest-TestMinimumBasicScenario-server-250189437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-250189437',id=15,image_ref='60dbb338-0365-4d23-b037-a87dd89bac9a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+AsAZbu9hcOCbYGhFUvhYYTHLMoxYc4EjEdPTCNq64vpVX20iz3IE00/FA+6f425LVCuWxeFU/Of+ZYFOw9aQG00fS5587QvPqvWaQSGIHlsyM60P0361dJXLYB5FnyQ==',key_name='tempest-TestMinimumBasicScenario-1222695517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9d044b69c56433ca011f220f8578407',ramdisk_id='',reservation_id='r-mltvrcs2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60dbb338-0365-4d23-b037-a87dd89bac9a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1802809099',owner_user_name='tempest-TestMinimumBasicScenario-1802809099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:56:50Z,user_data=None,user_id='af6af67060414d48b96ee116b9e6dbdb',uuid=03e487d1-90aa-436d-9c2f-468f9791af91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Converting VIF {"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:36:6d,bridge_name='br-int',has_traffic_filtering=True,id=7f2d5682-0113-40f4-8bbb-02e87564b7ef,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d5682-01') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.objects.instance [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lazy-loading 'pci_devices' on Instance uuid 03e487d1-90aa-436d-9c2f-468f9791af91 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:56:51 user nova-compute[74039]:   <uuid>03e487d1-90aa-436d-9c2f-468f9791af91</uuid>
Oct 20 08:56:51 user nova-compute[74039]:   <name>instance-0000000f</name>
Oct 20 08:56:51 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:56:51 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:56:51 user nova-compute[74039]:   <metadata>
Oct 20 08:56:51 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:56:51 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:56:51 user nova-compute[74039]:       <nova:name>tempest-TestMinimumBasicScenario-server-250189437</nova:name>
Oct 20 08:56:51 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:56:51</nova:creationTime>
Oct 20 08:56:51 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:56:51 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:56:51 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:56:51 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:56:51 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:56:51 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:56:51 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:56:51 user nova-compute[74039]:       <nova:owner>
Oct 20 08:56:51 user nova-compute[74039]:         <nova:user uuid="af6af67060414d48b96ee116b9e6dbdb">tempest-TestMinimumBasicScenario-1802809099-project-member</nova:user>
Oct 20 08:56:51 user nova-compute[74039]:         <nova:project uuid="d9d044b69c56433ca011f220f8578407">tempest-TestMinimumBasicScenario-1802809099</nova:project>
Oct 20 08:56:51 user nova-compute[74039]:       </nova:owner>
Oct 20 08:56:51 user nova-compute[74039]:       <nova:root type="image" uuid="60dbb338-0365-4d23-b037-a87dd89bac9a"/>
Oct 20 08:56:51 user nova-compute[74039]:       <nova:ports>
Oct 20 08:56:51 user nova-compute[74039]:         <nova:port uuid="7f2d5682-0113-40f4-8bbb-02e87564b7ef">
Oct 20 08:56:51 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 08:56:51 user nova-compute[74039]:         </nova:port>
Oct 20 08:56:51 user nova-compute[74039]:       </nova:ports>
Oct 20 08:56:51 user nova-compute[74039]:     </nova:instance>
Oct 20 08:56:51 user nova-compute[74039]:   </metadata>
Oct 20 08:56:51 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:56:51 user nova-compute[74039]:     <system>
Oct 20 08:56:51 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:56:51 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:56:51 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:56:51 user nova-compute[74039]:       <entry name="serial">03e487d1-90aa-436d-9c2f-468f9791af91</entry>
Oct 20 08:56:51 user nova-compute[74039]:       <entry name="uuid">03e487d1-90aa-436d-9c2f-468f9791af91</entry>
Oct 20 08:56:51 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:56:51 user nova-compute[74039]:     </system>
Oct 20 08:56:51 user nova-compute[74039]:   </sysinfo>
Oct 20 08:56:51 user nova-compute[74039]:   <os>
Oct 20 08:56:51 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:56:51 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:56:51 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:56:51 user nova-compute[74039]:   </os>
Oct 20 08:56:51 user nova-compute[74039]:   <features>
Oct 20 08:56:51 user nova-compute[74039]:     <acpi/>
Oct 20 08:56:51 user nova-compute[74039]:     <apic/>
Oct 20 08:56:51 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:56:51 user nova-compute[74039]:   </features>
Oct 20 08:56:51 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:56:51 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:56:51 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:56:51 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:56:51 user nova-compute[74039]:   </clock>
Oct 20 08:56:51 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:56:51 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:56:51 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:56:51 user nova-compute[74039]:   </cpu>
Oct 20 08:56:51 user nova-compute[74039]:   <devices>
Oct 20 08:56:51 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:56:51 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:56:51 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk"/>
Oct 20 08:56:51 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:56:51 user nova-compute[74039]:     </disk>
Oct 20 08:56:51 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:56:51 user nova-compute[74039]:       <mac address="fa:16:3e:41:36:6d"/>
Oct 20 08:56:51 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:56:51 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:56:51 user nova-compute[74039]:       <target dev="tap7f2d5682-01"/>
Oct 20 08:56:51 user nova-compute[74039]:     </interface>
Oct 20 08:56:51 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:56:51 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/console.log" append="off"/>
Oct 20 08:56:51 user nova-compute[74039]:     </serial>
Oct 20 08:56:51 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:56:51 user nova-compute[74039]:     <video>
Oct 20 08:56:51 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:56:51 user nova-compute[74039]:     </video>
Oct 20 08:56:51 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:56:51 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:56:51 user nova-compute[74039]:     </rng>
Oct 20 08:56:51 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:56:51 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:56:51 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:56:51 user nova-compute[74039]:     </memballoon>
Oct 20 08:56:51 user nova-compute[74039]:   </devices>
Oct 20 08:56:51 user nova-compute[74039]: </domain>
Oct 20 08:56:51 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-250189437',display_name='tempest-TestMinimumBasicScenario-server-250189437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-250189437',id=15,image_ref='60dbb338-0365-4d23-b037-a87dd89bac9a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+AsAZbu9hcOCbYGhFUvhYYTHLMoxYc4EjEdPTCNq64vpVX20iz3IE00/FA+6f425LVCuWxeFU/Of+ZYFOw9aQG00fS5587QvPqvWaQSGIHlsyM60P0361dJXLYB5FnyQ==',key_name='tempest-TestMinimumBasicScenario-1222695517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9d044b69c56433ca011f220f8578407',ramdisk_id='',reservation_id='r-mltvrcs2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60dbb338-0365-4d23-b037-a87dd89bac9a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1802809099',owner_user_name='tempest-TestMinimumBasicScenario-1802809099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:56:50Z,user_data=None,user_id='af6af67060414d48b96ee116b9e6dbdb',uuid=03e487d1-90aa-436d-9c2f-468f9791af91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Converting VIF {"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:36:6d,bridge_name='br-int',has_traffic_filtering=True,id=7f2d5682-0113-40f4-8bbb-02e87564b7ef,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d5682-01') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG os_vif [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:36:6d,bridge_name='br-int',has_traffic_filtering=True,id=7f2d5682-0113-40f4-8bbb-02e87564b7ef,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d5682-01') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b40705b-d1f7-5715-b261-2ade14ede764', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f2d5682-01, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f2d5682-01, col_values=(('qos', UUID('063dc1e1-265a-46a9-a977-187d16fbc7b5')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f2d5682-01, col_values=(('external_ids', {'iface-id': '7f2d5682-0113-40f4-8bbb-02e87564b7ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:36:6d', 'vm-uuid': '03e487d1-90aa-436d-9c2f-468f9791af91'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:56:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:51 user nova-compute[74039]: INFO os_vif [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:36:6d,bridge_name='br-int',has_traffic_filtering=True,id=7f2d5682-0113-40f4-8bbb-02e87564b7ef,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d5682-01')
Oct 20 08:56:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:56:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] No VIF found with MAC fa:16:3e:41:36:6d, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:56:52 user nova-compute[74039]: DEBUG nova.network.neutron [req-6ba3cfe7-bb0b-4628-8a4b-63398daee5ad req-cf242084-e23c-4c1e-a26a-8d30e25766f9 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Updated VIF entry in instance network info cache for port 7f2d5682-0113-40f4-8bbb-02e87564b7ef. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:56:52 user nova-compute[74039]: DEBUG nova.network.neutron [req-6ba3cfe7-bb0b-4628-8a4b-63398daee5ad req-cf242084-e23c-4c1e-a26a-8d30e25766f9 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Updating instance_info_cache with network_info: [{"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:56:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6ba3cfe7-bb0b-4628-8a4b-63398daee5ad req-cf242084-e23c-4c1e-a26a-8d30e25766f9 service nova] Releasing lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:56:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-a4fe230f-f018-4d8f-993d-626891e8829c req-3abeddd2-033f-4ea6-9f5a-8930fc509567 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received event network-vif-plugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:56:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a4fe230f-f018-4d8f-993d-626891e8829c req-3abeddd2-033f-4ea6-9f5a-8930fc509567 service nova] Acquiring lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a4fe230f-f018-4d8f-993d-626891e8829c req-3abeddd2-033f-4ea6-9f5a-8930fc509567 service nova] Lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a4fe230f-f018-4d8f-993d-626891e8829c req-3abeddd2-033f-4ea6-9f5a-8930fc509567 service nova] Lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-a4fe230f-f018-4d8f-993d-626891e8829c req-3abeddd2-033f-4ea6-9f5a-8930fc509567 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] No waiting events found dispatching network-vif-plugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:56:53 user nova-compute[74039]: WARNING nova.compute.manager [req-a4fe230f-f018-4d8f-993d-626891e8829c req-3abeddd2-033f-4ea6-9f5a-8930fc509567 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received unexpected event network-vif-plugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef for instance with vm_state building and task_state spawning.
Oct 20 08:56:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:55 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:56:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:56:55 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Instance spawned successfully.
Oct 20 08:56:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:56:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:56:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:56:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:56:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:56:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:56:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:56:55 user nova-compute[74039]: INFO nova.compute.manager [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Took 6.05 seconds to spawn the instance on the hypervisor.
Oct 20 08:56:55 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:56:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-7a69e19c-c0db-47af-9314-3a574b031ee5 req-060c64dd-afda-419e-a3b1-5af000ece201 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received event network-vif-plugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:56:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7a69e19c-c0db-47af-9314-3a574b031ee5 req-060c64dd-afda-419e-a3b1-5af000ece201 service nova] Acquiring lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7a69e19c-c0db-47af-9314-3a574b031ee5 req-060c64dd-afda-419e-a3b1-5af000ece201 service nova] Lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7a69e19c-c0db-47af-9314-3a574b031ee5 req-060c64dd-afda-419e-a3b1-5af000ece201 service nova] Lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-7a69e19c-c0db-47af-9314-3a574b031ee5 req-060c64dd-afda-419e-a3b1-5af000ece201 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] No waiting events found dispatching network-vif-plugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:56:55 user nova-compute[74039]: WARNING nova.compute.manager [req-7a69e19c-c0db-47af-9314-3a574b031ee5 req-060c64dd-afda-419e-a3b1-5af000ece201 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received unexpected event network-vif-plugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef for instance with vm_state building and task_state spawning.
Oct 20 08:56:55 user nova-compute[74039]: INFO nova.compute.manager [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Took 6.91 seconds to build instance.
Oct 20 08:56:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e469e01-f142-439a-be9c-63ca0ec63982 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "03e487d1-90aa-436d-9c2f-468f9791af91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.026s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:55 user nova-compute[74039]: DEBUG nova.compute.manager [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 08:56:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:56 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:56:56 user nova-compute[74039]: INFO nova.compute.claims [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Claim successful on node user
Oct 20 08:56:56 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:56:56 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:56:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:56 user nova-compute[74039]: DEBUG nova.compute.manager [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 08:56:56 user nova-compute[74039]: DEBUG nova.compute.manager [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 08:56:56 user nova-compute[74039]: DEBUG nova.network.neutron [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:56:56 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 08:56:56 user nova-compute[74039]: DEBUG nova.compute.manager [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 08:56:56 user nova-compute[74039]: DEBUG nova.policy [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4024fa0ccfda49e0a070b9e6166e37ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74bb65080a343afb5cbcea1b5481938', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:56:56 user nova-compute[74039]: DEBUG nova.compute.manager [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 08:56:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:56:56 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Creating image(s)
Oct 20 08:56:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "/opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "/opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.202s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.252s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG nova.network.neutron [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Successfully created port: 45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk 1073741824" returned: 0 in 0.069s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.231s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Cannot resize image /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Ensure instance console log exists: /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:56:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.network.neutron [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Successfully updated port: 45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquired lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.network.neutron [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.compute.manager [req-1cb027e4-eb8e-4a3f-89b0-df16d0f8382b req-b170f775-13f4-4334-a3cc-fc76a95e4763 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-changed-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.compute.manager [req-1cb027e4-eb8e-4a3f-89b0-df16d0f8382b req-b170f775-13f4-4334-a3cc-fc76a95e4763 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Refreshing instance network info cache due to event network-changed-45971bed-5f51-4ebd-9641-e2cc09d91d71. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1cb027e4-eb8e-4a3f-89b0-df16d0f8382b req-b170f775-13f4-4334-a3cc-fc76a95e4763 service nova] Acquiring lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.network.neutron [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.network.neutron [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Updating instance_info_cache with network_info: [{"id": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "address": "fa:16:3e:0c:c9:b0", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45971bed-5f", "ovs_interfaceid": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Releasing lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.compute.manager [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Instance network_info: |[{"id": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "address": "fa:16:3e:0c:c9:b0", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45971bed-5f", "ovs_interfaceid": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1cb027e4-eb8e-4a3f-89b0-df16d0f8382b req-b170f775-13f4-4334-a3cc-fc76a95e4763 service nova] Acquired lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.network.neutron [req-1cb027e4-eb8e-4a3f-89b0-df16d0f8382b req-b170f775-13f4-4334-a3cc-fc76a95e4763 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Refreshing network info cache for port 45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Start _get_guest_xml network_info=[{"id": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "address": "fa:16:3e:0c:c9:b0", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45971bed-5f", "ovs_interfaceid": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:56:58 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:56:58 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-672455651',display_name='tempest-ServerRescueNegativeTestJSON-server-672455651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-672455651',id=16,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/4hHvbGoEk8NCxt9ELjeY9iZ2B0QwhUSOtV9sftmfCgRXaPDsyLfZUde/IDIYj+13oBjVfPBDVNN+VD63zEivAAHfkwfA/NCYJYdBOqj0F8bFDm7gPMUHQ93MvUkhiGA==',key_name='tempest-keypair-763047870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d74bb65080a343afb5cbcea1b5481938',ramdisk_id='',reservation_id='r-byof0x6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1580334620',owner_user_name='tempest-ServerRescueNegativeTestJSON-1580334620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:56:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4024fa0ccfda49e0a070b9e6166e37ed',uuid=2ae63f29-de62-4e82-877c-8bb4a3f2beb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "address": "fa:16:3e:0c:c9:b0", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45971bed-5f", "ovs_interfaceid": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converting VIF {"id": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "address": "fa:16:3e:0c:c9:b0", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45971bed-5f", "ovs_interfaceid": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:c9:b0,bridge_name='br-int',has_traffic_filtering=True,id=45971bed-5f51-4ebd-9641-e2cc09d91d71,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45971bed-5f') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.objects.instance [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:56:58 user nova-compute[74039]:   <uuid>2ae63f29-de62-4e82-877c-8bb4a3f2beb3</uuid>
Oct 20 08:56:58 user nova-compute[74039]:   <name>instance-00000010</name>
Oct 20 08:56:58 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:56:58 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:56:58 user nova-compute[74039]:   <metadata>
Oct 20 08:56:58 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:56:58 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:56:58 user nova-compute[74039]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-672455651</nova:name>
Oct 20 08:56:58 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:56:58</nova:creationTime>
Oct 20 08:56:58 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:56:58 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:56:58 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:56:58 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:56:58 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:56:58 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:56:58 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:56:58 user nova-compute[74039]:       <nova:owner>
Oct 20 08:56:58 user nova-compute[74039]:         <nova:user uuid="4024fa0ccfda49e0a070b9e6166e37ed">tempest-ServerRescueNegativeTestJSON-1580334620-project-member</nova:user>
Oct 20 08:56:58 user nova-compute[74039]:         <nova:project uuid="d74bb65080a343afb5cbcea1b5481938">tempest-ServerRescueNegativeTestJSON-1580334620</nova:project>
Oct 20 08:56:58 user nova-compute[74039]:       </nova:owner>
Oct 20 08:56:58 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:56:58 user nova-compute[74039]:       <nova:ports>
Oct 20 08:56:58 user nova-compute[74039]:         <nova:port uuid="45971bed-5f51-4ebd-9641-e2cc09d91d71">
Oct 20 08:56:58 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 08:56:58 user nova-compute[74039]:         </nova:port>
Oct 20 08:56:58 user nova-compute[74039]:       </nova:ports>
Oct 20 08:56:58 user nova-compute[74039]:     </nova:instance>
Oct 20 08:56:58 user nova-compute[74039]:   </metadata>
Oct 20 08:56:58 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:56:58 user nova-compute[74039]:     <system>
Oct 20 08:56:58 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:56:58 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:56:58 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:56:58 user nova-compute[74039]:       <entry name="serial">2ae63f29-de62-4e82-877c-8bb4a3f2beb3</entry>
Oct 20 08:56:58 user nova-compute[74039]:       <entry name="uuid">2ae63f29-de62-4e82-877c-8bb4a3f2beb3</entry>
Oct 20 08:56:58 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:56:58 user nova-compute[74039]:     </system>
Oct 20 08:56:58 user nova-compute[74039]:   </sysinfo>
Oct 20 08:56:58 user nova-compute[74039]:   <os>
Oct 20 08:56:58 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:56:58 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:56:58 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:56:58 user nova-compute[74039]:   </os>
Oct 20 08:56:58 user nova-compute[74039]:   <features>
Oct 20 08:56:58 user nova-compute[74039]:     <acpi/>
Oct 20 08:56:58 user nova-compute[74039]:     <apic/>
Oct 20 08:56:58 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:56:58 user nova-compute[74039]:   </features>
Oct 20 08:56:58 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:56:58 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:56:58 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:56:58 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:56:58 user nova-compute[74039]:   </clock>
Oct 20 08:56:58 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:56:58 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:56:58 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:56:58 user nova-compute[74039]:   </cpu>
Oct 20 08:56:58 user nova-compute[74039]:   <devices>
Oct 20 08:56:58 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:56:58 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:56:58 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk"/>
Oct 20 08:56:58 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:56:58 user nova-compute[74039]:     </disk>
Oct 20 08:56:58 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:56:58 user nova-compute[74039]:       <mac address="fa:16:3e:0c:c9:b0"/>
Oct 20 08:56:58 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:56:58 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:56:58 user nova-compute[74039]:       <target dev="tap45971bed-5f"/>
Oct 20 08:56:58 user nova-compute[74039]:     </interface>
Oct 20 08:56:58 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:56:58 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/console.log" append="off"/>
Oct 20 08:56:58 user nova-compute[74039]:     </serial>
Oct 20 08:56:58 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:56:58 user nova-compute[74039]:     <video>
Oct 20 08:56:58 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:56:58 user nova-compute[74039]:     </video>
Oct 20 08:56:58 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:56:58 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:56:58 user nova-compute[74039]:     </rng>
Oct 20 08:56:58 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:56:58 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:56:58 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:56:58 user nova-compute[74039]:     </memballoon>
Oct 20 08:56:58 user nova-compute[74039]:   </devices>
Oct 20 08:56:58 user nova-compute[74039]: </domain>
Oct 20 08:56:58 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-672455651',display_name='tempest-ServerRescueNegativeTestJSON-server-672455651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-672455651',id=16,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/4hHvbGoEk8NCxt9ELjeY9iZ2B0QwhUSOtV9sftmfCgRXaPDsyLfZUde/IDIYj+13oBjVfPBDVNN+VD63zEivAAHfkwfA/NCYJYdBOqj0F8bFDm7gPMUHQ93MvUkhiGA==',key_name='tempest-keypair-763047870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d74bb65080a343afb5cbcea1b5481938',ramdisk_id='',reservation_id='r-byof0x6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1580334620',owner_user_name='tempest-ServerRescueNegativeTestJSON-1580334620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:56:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4024fa0ccfda49e0a070b9e6166e37ed',uuid=2ae63f29-de62-4e82-877c-8bb4a3f2beb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "address": "fa:16:3e:0c:c9:b0", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45971bed-5f", "ovs_interfaceid": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converting VIF {"id": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "address": "fa:16:3e:0c:c9:b0", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45971bed-5f", "ovs_interfaceid": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:c9:b0,bridge_name='br-int',has_traffic_filtering=True,id=45971bed-5f51-4ebd-9641-e2cc09d91d71,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45971bed-5f') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG os_vif [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:c9:b0,bridge_name='br-int',has_traffic_filtering=True,id=45971bed-5f51-4ebd-9641-e2cc09d91d71,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45971bed-5f') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d180499-7ec1-5b89-a7af-e1e32659ae56', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45971bed-5f, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45971bed-5f, col_values=(('qos', UUID('6568a52e-cd33-43b7-a4e2-f555160f5e85')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45971bed-5f, col_values=(('external_ids', {'iface-id': '45971bed-5f51-4ebd-9641-e2cc09d91d71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:c9:b0', 'vm-uuid': '2ae63f29-de62-4e82-877c-8bb4a3f2beb3'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:56:58 user nova-compute[74039]: INFO os_vif [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:c9:b0,bridge_name='br-int',has_traffic_filtering=True,id=45971bed-5f51-4ebd-9641-e2cc09d91d71,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45971bed-5f')
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:56:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] No VIF found with MAC fa:16:3e:0c:c9:b0, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:56:59 user nova-compute[74039]: DEBUG nova.network.neutron [req-1cb027e4-eb8e-4a3f-89b0-df16d0f8382b req-b170f775-13f4-4334-a3cc-fc76a95e4763 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Updated VIF entry in instance network info cache for port 45971bed-5f51-4ebd-9641-e2cc09d91d71. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:56:59 user nova-compute[74039]: DEBUG nova.network.neutron [req-1cb027e4-eb8e-4a3f-89b0-df16d0f8382b req-b170f775-13f4-4334-a3cc-fc76a95e4763 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Updating instance_info_cache with network_info: [{"id": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "address": "fa:16:3e:0c:c9:b0", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45971bed-5f", "ovs_interfaceid": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:56:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1cb027e4-eb8e-4a3f-89b0-df16d0f8382b req-b170f775-13f4-4334-a3cc-fc76a95e4763 service nova] Releasing lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-826897cc-eb8a-4ef5-b666-2040d97a37e0 req-2ed4190f-f9f3-451b-9fdf-63734d9c952c service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-826897cc-eb8a-4ef5-b666-2040d97a37e0 req-2ed4190f-f9f3-451b-9fdf-63734d9c952c service nova] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-826897cc-eb8a-4ef5-b666-2040d97a37e0 req-2ed4190f-f9f3-451b-9fdf-63734d9c952c service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-826897cc-eb8a-4ef5-b666-2040d97a37e0 req-2ed4190f-f9f3-451b-9fdf-63734d9c952c service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-826897cc-eb8a-4ef5-b666-2040d97a37e0 req-2ed4190f-f9f3-451b-9fdf-63734d9c952c service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] No waiting events found dispatching network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:57:00 user nova-compute[74039]: WARNING nova.compute.manager [req-826897cc-eb8a-4ef5-b666-2040d97a37e0 req-2ed4190f-f9f3-451b-9fdf-63734d9c952c service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received unexpected event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 for instance with vm_state building and task_state spawning.
Oct 20 08:57:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:00 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3625b19d-4394-4feb-bbe8-55a2d86dd7fb is timed out.
Oct 20 08:57:00 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Successfully detached device vdb from instance 3625b19d-4394-4feb-bbe8-55a2d86dd7fb from the live domain config.
Oct 20 08:57:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjbZigYR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:57:00 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:57:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc0278c-3fa7-42d3-8078-cdae79f7cdca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 08:57:00 user nova-compute[74039]: No targets found.
Oct 20 08:57:00 user nova-compute[74039]: iSNS:
Oct 20 08:57:00 user nova-compute[74039]: No targets found.
Oct 20 08:57:00 user nova-compute[74039]: STATIC:
Oct 20 08:57:00 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a
Oct 20 08:57:00 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:57:00 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:57:00 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408
Oct 20 08:57:00 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:57:00 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:57:00 user nova-compute[74039]: FIRMWARE:
Oct 20 08:57:00 user nova-compute[74039]: No targets found.
Oct 20 08:57:00 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 08:57:00 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 08:57:00 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4be12c-92d9-4162-ba2b-3eb2d4bdd9d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce7eba7-6018-4bde-a7e3-2aa6aa3af394]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)
Oct 20 08:57:00 user nova-compute[74039]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 (non-flash)
Oct 20 08:57:00 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)
Oct 20 08:57:00 user nova-compute[74039]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 (non-flash)
Oct 20 08:57:00 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae8426a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408'): ({'sdc'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Removing single pathed devices sdc {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7632f4-6955-4975-a8b3-3000bdc94155]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c9175c-614f-4913-973b-4ef5ec5f60ce]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Flushing IO for device /dev/sdc {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76959bb-d9bf-4f75-890c-e0e4b2dac0c7]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2792c11f-5d7d-437a-a74f-5ba5f256fcd0]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc16d02a-5c9d-40f2-a557-b8050686ea55]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef28f73c-4e63-471b-a3e2-6de2c1523d1d]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408, portal: 172.16.0.220,3260]
Oct 20 08:57:01 user nova-compute[74039]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408, portal: 172.16.0.220,3260] successful.
Oct 20 08:57:01 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adb8f90-53cf-4513-b73e-ef48fcf82408 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[431b3276-f764-415e-b6fb-8c948ba815aa]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] <== disconnect_volume: return (371ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:57:01 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 08:57:02 user nova-compute[74039]: DEBUG nova.objects.instance [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lazy-loading 'flavor' on Instance uuid 3625b19d-4394-4feb-bbe8-55a2d86dd7fb {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:57:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-035e2c12-98b2-464d-a39e-84d5083e2c30 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.074s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-eb73bae3-d179-4337-beb9-9d06fb69adb7 req-de9513f2-e1b8-48cd-b11d-e0ec48a43257 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:57:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eb73bae3-d179-4337-beb9-9d06fb69adb7 req-de9513f2-e1b8-48cd-b11d-e0ec48a43257 service nova] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eb73bae3-d179-4337-beb9-9d06fb69adb7 req-de9513f2-e1b8-48cd-b11d-e0ec48a43257 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eb73bae3-d179-4337-beb9-9d06fb69adb7 req-de9513f2-e1b8-48cd-b11d-e0ec48a43257 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-eb73bae3-d179-4337-beb9-9d06fb69adb7 req-de9513f2-e1b8-48cd-b11d-e0ec48a43257 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] No waiting events found dispatching network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:57:02 user nova-compute[74039]: WARNING nova.compute.manager [req-eb73bae3-d179-4337-beb9-9d06fb69adb7 req-de9513f2-e1b8-48cd-b11d-e0ec48a43257 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received unexpected event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 for instance with vm_state building and task_state spawning.
Oct 20 08:57:02 user nova-compute[74039]: DEBUG nova.compute.manager [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:57:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:57:02 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Instance spawned successfully.
Oct 20 08:57:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:57:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:02 user nova-compute[74039]: INFO nova.compute.manager [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Took 6.02 seconds to spawn the instance on the hypervisor.
Oct 20 08:57:02 user nova-compute[74039]: DEBUG nova.compute.manager [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:57:03 user nova-compute[74039]: INFO nova.compute.manager [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Took 7.09 seconds to build instance.
Oct 20 08:57:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1ac15540-21b2-4b6c-950a-7c06d7f784b3 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.196s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-0bc38481-daf1-4cdf-8f0b-6992d9dbf824 req-c8c6ad85-442b-4288-9f99-0463278968a2 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received event network-changed-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:57:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-0bc38481-daf1-4cdf-8f0b-6992d9dbf824 req-c8c6ad85-442b-4288-9f99-0463278968a2 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Refreshing instance network info cache due to event network-changed-e7d9d83f-1522-47f7-ac4c-7dd56facfea7. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:57:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0bc38481-daf1-4cdf-8f0b-6992d9dbf824 req-c8c6ad85-442b-4288-9f99-0463278968a2 service nova] Acquiring lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:57:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0bc38481-daf1-4cdf-8f0b-6992d9dbf824 req-c8c6ad85-442b-4288-9f99-0463278968a2 service nova] Acquired lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:57:07 user nova-compute[74039]: DEBUG nova.network.neutron [req-0bc38481-daf1-4cdf-8f0b-6992d9dbf824 req-c8c6ad85-442b-4288-9f99-0463278968a2 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Refreshing network info cache for port e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:57:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:08 user nova-compute[74039]: DEBUG nova.network.neutron [req-0bc38481-daf1-4cdf-8f0b-6992d9dbf824 req-c8c6ad85-442b-4288-9f99-0463278968a2 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Updated VIF entry in instance network info cache for port e7d9d83f-1522-47f7-ac4c-7dd56facfea7. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:57:08 user nova-compute[74039]: DEBUG nova.network.neutron [req-0bc38481-daf1-4cdf-8f0b-6992d9dbf824 req-c8c6ad85-442b-4288-9f99-0463278968a2 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Updating instance_info_cache with network_info: [{"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:57:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0bc38481-daf1-4cdf-8f0b-6992d9dbf824 req-c8c6ad85-442b-4288-9f99-0463278968a2 service nova] Releasing lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:57:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Acquiring lock "8021f35f-8194-4c14-b965-987f8637be21" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Lock "8021f35f-8194-4c14-b965-987f8637be21" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:16 user nova-compute[74039]: DEBUG nova.compute.manager [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 08:57:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:16 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:57:16 user nova-compute[74039]: INFO nova.compute.claims [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Claim successful on node user
Oct 20 08:57:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG nova.compute.manager [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG nova.compute.manager [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG nova.network.neutron [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:57:17 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 08:57:17 user nova-compute[74039]: DEBUG nova.compute.manager [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG nova.compute.manager [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:57:17 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Creating image(s)
Oct 20 08:57:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Acquiring lock "/opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Lock "/opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Lock "/opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG nova.policy [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3959407fe224b999d2777b4dbcb10c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f11e6d9bbb434ab0b7bc8b3ea4596b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.192s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.196s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21/disk 1073741824" returned: 0 in 0.048s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.217s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 08:57:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:18 user nova-compute[74039]: DEBUG nova.network.neutron [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Successfully created port: 7940c977-f637-476e-a8eb-5cd7c4f9ceee {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:57:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:18 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Cannot resize image /opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 08:57:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:57:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Ensure instance console log exists: /opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:57:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.network.neutron [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Successfully updated port: 7940c977-f637-476e-a8eb-5cd7c4f9ceee {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Acquiring lock "refresh_cache-8021f35f-8194-4c14-b965-987f8637be21" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Acquired lock "refresh_cache-8021f35f-8194-4c14-b965-987f8637be21" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.network.neutron [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.compute.manager [req-3276a004-511d-4db6-b9d0-9772c60f309f req-de1090b5-353d-45ae-aa97-017038b0f853 service nova] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Received event network-changed-7940c977-f637-476e-a8eb-5cd7c4f9ceee {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.compute.manager [req-3276a004-511d-4db6-b9d0-9772c60f309f req-de1090b5-353d-45ae-aa97-017038b0f853 service nova] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Refreshing instance network info cache due to event network-changed-7940c977-f637-476e-a8eb-5cd7c4f9ceee. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3276a004-511d-4db6-b9d0-9772c60f309f req-de1090b5-353d-45ae-aa97-017038b0f853 service nova] Acquiring lock "refresh_cache-8021f35f-8194-4c14-b965-987f8637be21" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.network.neutron [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.network.neutron [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Updating instance_info_cache with network_info: [{"id": "7940c977-f637-476e-a8eb-5cd7c4f9ceee", "address": "fa:16:3e:89:71:19", "network": {"id": "ec42b455-9c86-4054-acf6-1b24524821d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ee7f98662b44e8cb41923dce3e240aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7940c977-f6", "ovs_interfaceid": "7940c977-f637-476e-a8eb-5cd7c4f9ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Releasing lock "refresh_cache-8021f35f-8194-4c14-b965-987f8637be21" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.compute.manager [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Instance network_info: |[{"id": "7940c977-f637-476e-a8eb-5cd7c4f9ceee", "address": "fa:16:3e:89:71:19", "network": {"id": "ec42b455-9c86-4054-acf6-1b24524821d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ee7f98662b44e8cb41923dce3e240aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7940c977-f6", "ovs_interfaceid": "7940c977-f637-476e-a8eb-5cd7c4f9ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3276a004-511d-4db6-b9d0-9772c60f309f req-de1090b5-353d-45ae-aa97-017038b0f853 service nova] Acquired lock "refresh_cache-8021f35f-8194-4c14-b965-987f8637be21" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.network.neutron [req-3276a004-511d-4db6-b9d0-9772c60f309f req-de1090b5-353d-45ae-aa97-017038b0f853 service nova] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Refreshing network info cache for port 7940c977-f637-476e-a8eb-5cd7c4f9ceee {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Start _get_guest_xml network_info=[{"id": "7940c977-f637-476e-a8eb-5cd7c4f9ceee", "address": "fa:16:3e:89:71:19", "network": {"id": "ec42b455-9c86-4054-acf6-1b24524821d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ee7f98662b44e8cb41923dce3e240aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7940c977-f6", "ovs_interfaceid": "7940c977-f637-476e-a8eb-5cd7c4f9ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:57:19 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:57:19 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:57:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-672808910',display_name='tempest-VolumesNegativeTest-instance-672808910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-672808910',id=17,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8f11e6d9bbb434ab0b7bc8b3ea4596b',ramdisk_id='',reservation_id='r-iij0vjfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2134407769',owner_user_name='tempest-VolumesNegativeTest-2134407769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:57:17Z,user_data=None,user_id='c3959407fe224b999d2777b4dbcb10c7',uuid=8021f35f-8194-4c14-b965-987f8637be21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7940c977-f637-476e-a8eb-5cd7c4f9ceee", "address": "fa:16:3e:89:71:19", "network": {"id": "ec42b455-9c86-4054-acf6-1b24524821d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ee7f98662b44e8cb41923dce3e240aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7940c977-f6", "ovs_interfaceid": "7940c977-f637-476e-a8eb-5cd7c4f9ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Converting VIF {"id": "7940c977-f637-476e-a8eb-5cd7c4f9ceee", "address": "fa:16:3e:89:71:19", "network": {"id": "ec42b455-9c86-4054-acf6-1b24524821d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ee7f98662b44e8cb41923dce3e240aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7940c977-f6", "ovs_interfaceid": "7940c977-f637-476e-a8eb-5cd7c4f9ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:71:19,bridge_name='br-int',has_traffic_filtering=True,id=7940c977-f637-476e-a8eb-5cd7c4f9ceee,network=Network(ec42b455-9c86-4054-acf6-1b24524821d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7940c977-f6') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.objects.instance [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Lazy-loading 'pci_devices' on Instance uuid 8021f35f-8194-4c14-b965-987f8637be21 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:57:19 user nova-compute[74039]:   <uuid>8021f35f-8194-4c14-b965-987f8637be21</uuid>
Oct 20 08:57:19 user nova-compute[74039]:   <name>instance-00000011</name>
Oct 20 08:57:19 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:57:19 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:57:19 user nova-compute[74039]:   <metadata>
Oct 20 08:57:19 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:57:19 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:57:19 user nova-compute[74039]:       <nova:name>tempest-VolumesNegativeTest-instance-672808910</nova:name>
Oct 20 08:57:19 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:57:19</nova:creationTime>
Oct 20 08:57:19 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:57:19 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:57:19 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:57:19 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:57:19 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:57:19 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:57:19 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:57:19 user nova-compute[74039]:       <nova:owner>
Oct 20 08:57:19 user nova-compute[74039]:         <nova:user uuid="c3959407fe224b999d2777b4dbcb10c7">tempest-VolumesNegativeTest-2134407769-project-member</nova:user>
Oct 20 08:57:19 user nova-compute[74039]:         <nova:project uuid="e8f11e6d9bbb434ab0b7bc8b3ea4596b">tempest-VolumesNegativeTest-2134407769</nova:project>
Oct 20 08:57:19 user nova-compute[74039]:       </nova:owner>
Oct 20 08:57:19 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:57:19 user nova-compute[74039]:       <nova:ports>
Oct 20 08:57:19 user nova-compute[74039]:         <nova:port uuid="7940c977-f637-476e-a8eb-5cd7c4f9ceee">
Oct 20 08:57:19 user nova-compute[74039]:           <nova:ip type="fixed" address="192.168.233.222" ipVersion="4"/>
Oct 20 08:57:19 user nova-compute[74039]:         </nova:port>
Oct 20 08:57:19 user nova-compute[74039]:       </nova:ports>
Oct 20 08:57:19 user nova-compute[74039]:     </nova:instance>
Oct 20 08:57:19 user nova-compute[74039]:   </metadata>
Oct 20 08:57:19 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:57:19 user nova-compute[74039]:     <system>
Oct 20 08:57:19 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:57:19 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:57:19 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:57:19 user nova-compute[74039]:       <entry name="serial">8021f35f-8194-4c14-b965-987f8637be21</entry>
Oct 20 08:57:19 user nova-compute[74039]:       <entry name="uuid">8021f35f-8194-4c14-b965-987f8637be21</entry>
Oct 20 08:57:19 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:57:19 user nova-compute[74039]:     </system>
Oct 20 08:57:19 user nova-compute[74039]:   </sysinfo>
Oct 20 08:57:19 user nova-compute[74039]:   <os>
Oct 20 08:57:19 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:57:19 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:57:19 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:57:19 user nova-compute[74039]:   </os>
Oct 20 08:57:19 user nova-compute[74039]:   <features>
Oct 20 08:57:19 user nova-compute[74039]:     <acpi/>
Oct 20 08:57:19 user nova-compute[74039]:     <apic/>
Oct 20 08:57:19 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:57:19 user nova-compute[74039]:   </features>
Oct 20 08:57:19 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:57:19 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:57:19 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:57:19 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:57:19 user nova-compute[74039]:   </clock>
Oct 20 08:57:19 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:57:19 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:57:19 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:57:19 user nova-compute[74039]:   </cpu>
Oct 20 08:57:19 user nova-compute[74039]:   <devices>
Oct 20 08:57:19 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:57:19 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:57:19 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21/disk"/>
Oct 20 08:57:19 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:57:19 user nova-compute[74039]:     </disk>
Oct 20 08:57:19 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:57:19 user nova-compute[74039]:       <mac address="fa:16:3e:89:71:19"/>
Oct 20 08:57:19 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:57:19 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:57:19 user nova-compute[74039]:       <target dev="tap7940c977-f6"/>
Oct 20 08:57:19 user nova-compute[74039]:     </interface>
Oct 20 08:57:19 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:57:19 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21/console.log" append="off"/>
Oct 20 08:57:19 user nova-compute[74039]:     </serial>
Oct 20 08:57:19 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:57:19 user nova-compute[74039]:     <video>
Oct 20 08:57:19 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:57:19 user nova-compute[74039]:     </video>
Oct 20 08:57:19 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:57:19 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:57:19 user nova-compute[74039]:     </rng>
Oct 20 08:57:19 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:57:19 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:57:19 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:57:19 user nova-compute[74039]:     </memballoon>
Oct 20 08:57:19 user nova-compute[74039]:   </devices>
Oct 20 08:57:19 user nova-compute[74039]: </domain>
Oct 20 08:57:19 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:57:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-672808910',display_name='tempest-VolumesNegativeTest-instance-672808910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-672808910',id=17,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8f11e6d9bbb434ab0b7bc8b3ea4596b',ramdisk_id='',reservation_id='r-iij0vjfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2134407769',owner_user_name='tempest-VolumesNegativeTest-2134407769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:57:17Z,user_data=None,user_id='c3959407fe224b999d2777b4dbcb10c7',uuid=8021f35f-8194-4c14-b965-987f8637be21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7940c977-f637-476e-a8eb-5cd7c4f9ceee", "address": "fa:16:3e:89:71:19", "network": {"id": "ec42b455-9c86-4054-acf6-1b24524821d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ee7f98662b44e8cb41923dce3e240aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7940c977-f6", "ovs_interfaceid": "7940c977-f637-476e-a8eb-5cd7c4f9ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Converting VIF {"id": "7940c977-f637-476e-a8eb-5cd7c4f9ceee", "address": "fa:16:3e:89:71:19", "network": {"id": "ec42b455-9c86-4054-acf6-1b24524821d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ee7f98662b44e8cb41923dce3e240aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7940c977-f6", "ovs_interfaceid": "7940c977-f637-476e-a8eb-5cd7c4f9ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:71:19,bridge_name='br-int',has_traffic_filtering=True,id=7940c977-f637-476e-a8eb-5cd7c4f9ceee,network=Network(ec42b455-9c86-4054-acf6-1b24524821d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7940c977-f6') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG os_vif [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:71:19,bridge_name='br-int',has_traffic_filtering=True,id=7940c977-f637-476e-a8eb-5cd7c4f9ceee,network=Network(ec42b455-9c86-4054-acf6-1b24524821d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7940c977-f6') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76a75c64-e2c7-5713-bd87-4acab79ed9f1', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7940c977-f6, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7940c977-f6, col_values=(('qos', UUID('edaefae4-ba76-4001-beac-f761047a063c')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7940c977-f6, col_values=(('external_ids', {'iface-id': '7940c977-f637-476e-a8eb-5cd7c4f9ceee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:71:19', 'vm-uuid': '8021f35f-8194-4c14-b965-987f8637be21'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:19 user nova-compute[74039]: INFO os_vif [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:71:19,bridge_name='br-int',has_traffic_filtering=True,id=7940c977-f637-476e-a8eb-5cd7c4f9ceee,network=Network(ec42b455-9c86-4054-acf6-1b24524821d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7940c977-f6')
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] No VIF found with MAC fa:16:3e:89:71:19, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.network.neutron [req-3276a004-511d-4db6-b9d0-9772c60f309f req-de1090b5-353d-45ae-aa97-017038b0f853 service nova] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Updated VIF entry in instance network info cache for port 7940c977-f637-476e-a8eb-5cd7c4f9ceee. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG nova.network.neutron [req-3276a004-511d-4db6-b9d0-9772c60f309f req-de1090b5-353d-45ae-aa97-017038b0f853 service nova] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Updating instance_info_cache with network_info: [{"id": "7940c977-f637-476e-a8eb-5cd7c4f9ceee", "address": "fa:16:3e:89:71:19", "network": {"id": "ec42b455-9c86-4054-acf6-1b24524821d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ee7f98662b44e8cb41923dce3e240aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7940c977-f6", "ovs_interfaceid": "7940c977-f637-476e-a8eb-5cd7c4f9ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:57:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3276a004-511d-4db6-b9d0-9772c60f309f req-de1090b5-353d-45ae-aa97-017038b0f853 service nova] Releasing lock "refresh_cache-8021f35f-8194-4c14-b965-987f8637be21" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:57:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-22331d1b-6fa6-4706-b39d-c1405b2c4878 req-34b7c3cf-b0a7-4462-baaf-14b44d07bcfe service nova] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Received event network-vif-plugged-7940c977-f637-476e-a8eb-5cd7c4f9ceee {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:57:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-22331d1b-6fa6-4706-b39d-c1405b2c4878 req-34b7c3cf-b0a7-4462-baaf-14b44d07bcfe service nova] Acquiring lock "8021f35f-8194-4c14-b965-987f8637be21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-22331d1b-6fa6-4706-b39d-c1405b2c4878 req-34b7c3cf-b0a7-4462-baaf-14b44d07bcfe service nova] Lock "8021f35f-8194-4c14-b965-987f8637be21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-22331d1b-6fa6-4706-b39d-c1405b2c4878 req-34b7c3cf-b0a7-4462-baaf-14b44d07bcfe service nova] Lock "8021f35f-8194-4c14-b965-987f8637be21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-22331d1b-6fa6-4706-b39d-c1405b2c4878 req-34b7c3cf-b0a7-4462-baaf-14b44d07bcfe service nova] [instance: 8021f35f-8194-4c14-b965-987f8637be21] No waiting events found dispatching network-vif-plugged-7940c977-f637-476e-a8eb-5cd7c4f9ceee {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:57:21 user nova-compute[74039]: WARNING nova.compute.manager [req-22331d1b-6fa6-4706-b39d-c1405b2c4878 req-34b7c3cf-b0a7-4462-baaf-14b44d07bcfe service nova] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Received unexpected event network-vif-plugged-7940c977-f637-476e-a8eb-5cd7c4f9ceee for instance with vm_state building and task_state spawning.
Oct 20 08:57:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:57:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:57:23 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Instance spawned successfully.
Oct 20 08:57:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:57:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-2ae176a8-54b5-4817-88c2-c259feaa2537 req-64057ea3-ad1f-4a36-bb62-42e97e7c2f0a service nova] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Received event network-vif-plugged-7940c977-f637-476e-a8eb-5cd7c4f9ceee {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:57:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2ae176a8-54b5-4817-88c2-c259feaa2537 req-64057ea3-ad1f-4a36-bb62-42e97e7c2f0a service nova] Acquiring lock "8021f35f-8194-4c14-b965-987f8637be21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2ae176a8-54b5-4817-88c2-c259feaa2537 req-64057ea3-ad1f-4a36-bb62-42e97e7c2f0a service nova] Lock "8021f35f-8194-4c14-b965-987f8637be21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2ae176a8-54b5-4817-88c2-c259feaa2537 req-64057ea3-ad1f-4a36-bb62-42e97e7c2f0a service nova] Lock "8021f35f-8194-4c14-b965-987f8637be21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-2ae176a8-54b5-4817-88c2-c259feaa2537 req-64057ea3-ad1f-4a36-bb62-42e97e7c2f0a service nova] [instance: 8021f35f-8194-4c14-b965-987f8637be21] No waiting events found dispatching network-vif-plugged-7940c977-f637-476e-a8eb-5cd7c4f9ceee {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:57:23 user nova-compute[74039]: WARNING nova.compute.manager [req-2ae176a8-54b5-4817-88c2-c259feaa2537 req-64057ea3-ad1f-4a36-bb62-42e97e7c2f0a service nova] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Received unexpected event network-vif-plugged-7940c977-f637-476e-a8eb-5cd7c4f9ceee for instance with vm_state building and task_state spawning.
Oct 20 08:57:23 user nova-compute[74039]: INFO nova.compute.manager [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Took 6.30 seconds to spawn the instance on the hypervisor.
Oct 20 08:57:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:57:23 user nova-compute[74039]: INFO nova.compute.manager [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Took 7.21 seconds to build instance.
Oct 20 08:57:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69c6aa54-6833-4d99-91c2-e2d92f306474 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Lock "8021f35f-8194-4c14-b965-987f8637be21" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.332s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:26 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:57:26 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:57:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 08:57:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:57:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:57:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 08:57:27 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Updating instance_info_cache with network_info: [{"id": "708d272c-3434-4525-bcbd-3ee50e71eb47", "address": "fa:16:3e:3f:80:75", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708d272c-34", "ovs_interfaceid": "708d272c-3434-4525-bcbd-3ee50e71eb47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:57:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:57:27 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 08:57:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:57:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:57:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:57:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:57:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:57:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:57:27 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 08:57:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:57:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:27 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 08:57:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 08:57:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "d61f84a9-85ea-40aa-b21e-45064b3bc090" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "d61f84a9-85ea-40aa-b21e-45064b3bc090" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:28 user nova-compute[74039]: DEBUG nova.compute.manager [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 08:57:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:57:28 user nova-compute[74039]: INFO nova.compute.claims [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Claim successful on node user
Oct 20 08:57:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG nova.compute.manager [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG nova.compute.manager [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG nova.network.neutron [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:57:29 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 08:57:29 user nova-compute[74039]: DEBUG nova.compute.manager [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG nova.policy [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6faf5f2e03204805a06ac9f83b9a61bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143bda69e4714560b4b2286adaefb4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG nova.compute.manager [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:57:29 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Creating image(s)
Oct 20 08:57:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "/opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "/opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "/opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.191s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk 1073741824" returned: 0 in 0.060s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG nova.network.neutron [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Successfully created port: b244a5a8-584d-426b-92f9-cbdd4c770a51 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.204s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Cannot resize image /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Ensure instance console log exists: /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:30 user nova-compute[74039]: DEBUG nova.network.neutron [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Successfully updated port: b244a5a8-584d-426b-92f9-cbdd4c770a51 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "refresh_cache-d61f84a9-85ea-40aa-b21e-45064b3bc090" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquired lock "refresh_cache-d61f84a9-85ea-40aa-b21e-45064b3bc090" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.network.neutron [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-34ba8c9d-f27e-4534-a05e-7a012c5059ff req-7e00f140-c704-4bda-933b-abbd32b43052 service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Received event network-changed-b244a5a8-584d-426b-92f9-cbdd4c770a51 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-34ba8c9d-f27e-4534-a05e-7a012c5059ff req-7e00f140-c704-4bda-933b-abbd32b43052 service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Refreshing instance network info cache due to event network-changed-b244a5a8-584d-426b-92f9-cbdd4c770a51. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-34ba8c9d-f27e-4534-a05e-7a012c5059ff req-7e00f140-c704-4bda-933b-abbd32b43052 service nova] Acquiring lock "refresh_cache-d61f84a9-85ea-40aa-b21e-45064b3bc090" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.network.neutron [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.264s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.network.neutron [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Updating instance_info_cache with network_info: [{"id": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "address": "fa:16:3e:f4:2a:6c", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb244a5a8-58", "ovs_interfaceid": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Releasing lock "refresh_cache-d61f84a9-85ea-40aa-b21e-45064b3bc090" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Instance network_info: |[{"id": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "address": "fa:16:3e:f4:2a:6c", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb244a5a8-58", "ovs_interfaceid": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-34ba8c9d-f27e-4534-a05e-7a012c5059ff req-7e00f140-c704-4bda-933b-abbd32b43052 service nova] Acquired lock "refresh_cache-d61f84a9-85ea-40aa-b21e-45064b3bc090" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.network.neutron [req-34ba8c9d-f27e-4534-a05e-7a012c5059ff req-7e00f140-c704-4bda-933b-abbd32b43052 service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Refreshing network info cache for port b244a5a8-584d-426b-92f9-cbdd4c770a51 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Start _get_guest_xml network_info=[{"id": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "address": "fa:16:3e:f4:2a:6c", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb244a5a8-58", "ovs_interfaceid": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:31 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:57:31 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:57:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1763804474',display_name='tempest-AttachVolumeNegativeTest-server-1763804474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1763804474',id=18,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnFzRJgurlVdQXqAdfMnpEhkAb4cVlW7KPQF3o095djtkf/NWdcHOBnzFAb6TRmgwz0scCUR3cVpbnkLGhYxXxORR2Hyfh2wGAhM0Mjm/r5J07UZeykxwn+xWNS2xn05w==',key_name='tempest-keypair-1600517727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='143bda69e4714560b4b2286adaefb4c5',ramdisk_id='',reservation_id='r-imuqtx2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-639731200',owner_user_name='tempest-AttachVolumeNegativeTest-639731200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:57:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6faf5f2e03204805a06ac9f83b9a61bb',uuid=d61f84a9-85ea-40aa-b21e-45064b3bc090,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "address": "fa:16:3e:f4:2a:6c", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb244a5a8-58", "ovs_interfaceid": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converting VIF {"id": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "address": "fa:16:3e:f4:2a:6c", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb244a5a8-58", "ovs_interfaceid": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:2a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b244a5a8-584d-426b-92f9-cbdd4c770a51,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb244a5a8-58') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.objects.instance [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lazy-loading 'pci_devices' on Instance uuid d61f84a9-85ea-40aa-b21e-45064b3bc090 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:57:31 user nova-compute[74039]:   <uuid>d61f84a9-85ea-40aa-b21e-45064b3bc090</uuid>
Oct 20 08:57:31 user nova-compute[74039]:   <name>instance-00000012</name>
Oct 20 08:57:31 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:57:31 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:57:31 user nova-compute[74039]:   <metadata>
Oct 20 08:57:31 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:57:31 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:57:31 user nova-compute[74039]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1763804474</nova:name>
Oct 20 08:57:31 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:57:31</nova:creationTime>
Oct 20 08:57:31 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:57:31 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:57:31 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:57:31 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:57:31 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:57:31 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:57:31 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:57:31 user nova-compute[74039]:       <nova:owner>
Oct 20 08:57:31 user nova-compute[74039]:         <nova:user uuid="6faf5f2e03204805a06ac9f83b9a61bb">tempest-AttachVolumeNegativeTest-639731200-project-member</nova:user>
Oct 20 08:57:31 user nova-compute[74039]:         <nova:project uuid="143bda69e4714560b4b2286adaefb4c5">tempest-AttachVolumeNegativeTest-639731200</nova:project>
Oct 20 08:57:31 user nova-compute[74039]:       </nova:owner>
Oct 20 08:57:31 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:57:31 user nova-compute[74039]:       <nova:ports>
Oct 20 08:57:31 user nova-compute[74039]:         <nova:port uuid="b244a5a8-584d-426b-92f9-cbdd4c770a51">
Oct 20 08:57:31 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 08:57:31 user nova-compute[74039]:         </nova:port>
Oct 20 08:57:31 user nova-compute[74039]:       </nova:ports>
Oct 20 08:57:31 user nova-compute[74039]:     </nova:instance>
Oct 20 08:57:31 user nova-compute[74039]:   </metadata>
Oct 20 08:57:31 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:57:31 user nova-compute[74039]:     <system>
Oct 20 08:57:31 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:57:31 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:57:31 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:57:31 user nova-compute[74039]:       <entry name="serial">d61f84a9-85ea-40aa-b21e-45064b3bc090</entry>
Oct 20 08:57:31 user nova-compute[74039]:       <entry name="uuid">d61f84a9-85ea-40aa-b21e-45064b3bc090</entry>
Oct 20 08:57:31 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:57:31 user nova-compute[74039]:     </system>
Oct 20 08:57:31 user nova-compute[74039]:   </sysinfo>
Oct 20 08:57:31 user nova-compute[74039]:   <os>
Oct 20 08:57:31 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:57:31 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:57:31 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:57:31 user nova-compute[74039]:   </os>
Oct 20 08:57:31 user nova-compute[74039]:   <features>
Oct 20 08:57:31 user nova-compute[74039]:     <acpi/>
Oct 20 08:57:31 user nova-compute[74039]:     <apic/>
Oct 20 08:57:31 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:57:31 user nova-compute[74039]:   </features>
Oct 20 08:57:31 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:57:31 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:57:31 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:57:31 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:57:31 user nova-compute[74039]:   </clock>
Oct 20 08:57:31 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:57:31 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:57:31 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:57:31 user nova-compute[74039]:   </cpu>
Oct 20 08:57:31 user nova-compute[74039]:   <devices>
Oct 20 08:57:31 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:57:31 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:57:31 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk"/>
Oct 20 08:57:31 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:57:31 user nova-compute[74039]:     </disk>
Oct 20 08:57:31 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:57:31 user nova-compute[74039]:       <mac address="fa:16:3e:f4:2a:6c"/>
Oct 20 08:57:31 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:57:31 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:57:31 user nova-compute[74039]:       <target dev="tapb244a5a8-58"/>
Oct 20 08:57:31 user nova-compute[74039]:     </interface>
Oct 20 08:57:31 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:57:31 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/console.log" append="off"/>
Oct 20 08:57:31 user nova-compute[74039]:     </serial>
Oct 20 08:57:31 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:57:31 user nova-compute[74039]:     <video>
Oct 20 08:57:31 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:57:31 user nova-compute[74039]:     </video>
Oct 20 08:57:31 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:57:31 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:57:31 user nova-compute[74039]:     </rng>
Oct 20 08:57:31 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:57:31 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:57:31 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:57:31 user nova-compute[74039]:     </memballoon>
Oct 20 08:57:31 user nova-compute[74039]:   </devices>
Oct 20 08:57:31 user nova-compute[74039]: </domain>
Oct 20 08:57:31 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1763804474',display_name='tempest-AttachVolumeNegativeTest-server-1763804474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1763804474',id=18,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnFzRJgurlVdQXqAdfMnpEhkAb4cVlW7KPQF3o095djtkf/NWdcHOBnzFAb6TRmgwz0scCUR3cVpbnkLGhYxXxORR2Hyfh2wGAhM0Mjm/r5J07UZeykxwn+xWNS2xn05w==',key_name='tempest-keypair-1600517727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='143bda69e4714560b4b2286adaefb4c5',ramdisk_id='',reservation_id='r-imuqtx2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-639731200',owner_user_name='tempest-AttachVolumeNegativeTest-639731200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:57:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6faf5f2e03204805a06ac9f83b9a61bb',uuid=d61f84a9-85ea-40aa-b21e-45064b3bc090,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "address": "fa:16:3e:f4:2a:6c", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb244a5a8-58", "ovs_interfaceid": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converting VIF {"id": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "address": "fa:16:3e:f4:2a:6c", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb244a5a8-58", "ovs_interfaceid": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:2a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b244a5a8-584d-426b-92f9-cbdd4c770a51,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb244a5a8-58') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG os_vif [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:2a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b244a5a8-584d-426b-92f9-cbdd4c770a51,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb244a5a8-58') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '649f4322-f6ad-553b-904a-a9d1a6391f55', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb244a5a8-58, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb244a5a8-58, col_values=(('qos', UUID('a1185b2f-2d1a-45f2-8c2a-5f338be16627')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb244a5a8-58, col_values=(('external_ids', {'iface-id': 'b244a5a8-584d-426b-92f9-cbdd4c770a51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:2a:6c', 'vm-uuid': 'd61f84a9-85ea-40aa-b21e-45064b3bc090'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:31 user nova-compute[74039]: INFO os_vif [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:2a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b244a5a8-584d-426b-92f9-cbdd4c770a51,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb244a5a8-58')
Oct 20 08:57:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] No VIF found with MAC fa:16:3e:f4:2a:6c, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:57:31 user nova-compute[74039]: INFO nova.compute.claims [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Claim successful on node user
Oct 20 08:57:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.network.neutron [req-34ba8c9d-f27e-4534-a05e-7a012c5059ff req-7e00f140-c704-4bda-933b-abbd32b43052 service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Updated VIF entry in instance network info cache for port b244a5a8-584d-426b-92f9-cbdd4c770a51. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG nova.network.neutron [req-34ba8c9d-f27e-4534-a05e-7a012c5059ff req-7e00f140-c704-4bda-933b-abbd32b43052 service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Updating instance_info_cache with network_info: [{"id": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "address": "fa:16:3e:f4:2a:6c", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb244a5a8-58", "ovs_interfaceid": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:57:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-34ba8c9d-f27e-4534-a05e-7a012c5059ff req-7e00f140-c704-4bda-933b-abbd32b43052 service nova] Releasing lock "refresh_cache-d61f84a9-85ea-40aa-b21e-45064b3bc090" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:57:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.compute.manager [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.compute.manager [req-1110bd97-d2bc-4dae-a461-5867cb627e00 req-59879c1e-433d-47ff-9c19-bb38390238ae service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Received event network-vif-plugged-b244a5a8-584d-426b-92f9-cbdd4c770a51 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1110bd97-d2bc-4dae-a461-5867cb627e00 req-59879c1e-433d-47ff-9c19-bb38390238ae service nova] Acquiring lock "d61f84a9-85ea-40aa-b21e-45064b3bc090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1110bd97-d2bc-4dae-a461-5867cb627e00 req-59879c1e-433d-47ff-9c19-bb38390238ae service nova] Lock "d61f84a9-85ea-40aa-b21e-45064b3bc090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1110bd97-d2bc-4dae-a461-5867cb627e00 req-59879c1e-433d-47ff-9c19-bb38390238ae service nova] Lock "d61f84a9-85ea-40aa-b21e-45064b3bc090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.compute.manager [req-1110bd97-d2bc-4dae-a461-5867cb627e00 req-59879c1e-433d-47ff-9c19-bb38390238ae service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] No waiting events found dispatching network-vif-plugged-b244a5a8-584d-426b-92f9-cbdd4c770a51 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:57:35 user nova-compute[74039]: WARNING nova.compute.manager [req-1110bd97-d2bc-4dae-a461-5867cb627e00 req-59879c1e-433d-47ff-9c19-bb38390238ae service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Received unexpected event network-vif-plugged-b244a5a8-584d-426b-92f9-cbdd4c770a51 for instance with vm_state building and task_state spawning.
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.compute.manager [req-221b609a-6d78-43e6-9356-30d6a4cf880d req-1ece9371-af5c-4e08-a28a-5ceec5b7ea0b service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Received event network-vif-plugged-b244a5a8-584d-426b-92f9-cbdd4c770a51 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-221b609a-6d78-43e6-9356-30d6a4cf880d req-1ece9371-af5c-4e08-a28a-5ceec5b7ea0b service nova] Acquiring lock "d61f84a9-85ea-40aa-b21e-45064b3bc090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-221b609a-6d78-43e6-9356-30d6a4cf880d req-1ece9371-af5c-4e08-a28a-5ceec5b7ea0b service nova] Lock "d61f84a9-85ea-40aa-b21e-45064b3bc090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-221b609a-6d78-43e6-9356-30d6a4cf880d req-1ece9371-af5c-4e08-a28a-5ceec5b7ea0b service nova] Lock "d61f84a9-85ea-40aa-b21e-45064b3bc090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.compute.manager [req-221b609a-6d78-43e6-9356-30d6a4cf880d req-1ece9371-af5c-4e08-a28a-5ceec5b7ea0b service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] No waiting events found dispatching network-vif-plugged-b244a5a8-584d-426b-92f9-cbdd4c770a51 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:57:35 user nova-compute[74039]: WARNING nova.compute.manager [req-221b609a-6d78-43e6-9356-30d6a4cf880d req-1ece9371-af5c-4e08-a28a-5ceec5b7ea0b service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Received unexpected event network-vif-plugged-b244a5a8-584d-426b-92f9-cbdd4c770a51 for instance with vm_state building and task_state spawning.
Oct 20 08:57:35 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:57:35 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7480MB free_disk=25.59162139892578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:35 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Instance spawned successfully.
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:35 user nova-compute[74039]: INFO nova.compute.manager [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Took 5.80 seconds to spawn the instance on the hypervisor.
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.compute.manager [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:57:35 user nova-compute[74039]: INFO nova.compute.manager [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Took 6.81 seconds to build instance.
Oct 20 08:57:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2f4d9ccd-f542-4dbf-821d-8de1e8123473 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "d61f84a9-85ea-40aa-b21e-45064b3bc090" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.921s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 4.014s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.321s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:57:35 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 08:57:35 user nova-compute[74039]: DEBUG nova.policy [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3e2da79669b41bea6e6a166c7c4a513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb463233344f65b2657a952c24d331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 9fe77a96-fcb5-4410-85cc-58d925548e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c8054dbd-c0ae-45d2-af95-dae7d05f8c69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 3625b19d-4394-4feb-bbe8-55a2d86dd7fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 385b3191-b427-4e5e-af5b-d929fceef331 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance ebaa4804-32e5-4fff-9562-0587ff7ca4ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 03e487d1-90aa-436d-9c2f-468f9791af91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 8021f35f-8194-4c14-b965-987f8637be21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance d61f84a9-85ea-40aa-b21e-45064b3bc090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance a81b209e-5587-4d83-a6c9-3a2256d7aa37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:57:36 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Creating image(s)
Oct 20 08:57:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "/opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "/opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "/opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.199s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.242s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37/disk 1073741824" returned: 0 in 0.065s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Successfully created port: 5ff15603-38ca-41c6-bae5-e72e704c188d {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.203s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 08:57:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.064s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Cannot resize image /opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Ensure instance console log exists: /opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Successfully updated port: 5ff15603-38ca-41c6-bae5-e72e704c188d {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "refresh_cache-a81b209e-5587-4d83-a6c9-3a2256d7aa37" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquired lock "refresh_cache-a81b209e-5587-4d83-a6c9-3a2256d7aa37" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.compute.manager [req-d0c0fc10-d0ea-4741-8514-452683eac440 req-27ef81b8-8b55-454d-a22d-37b7a8f54800 service nova] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Received event network-changed-5ff15603-38ca-41c6-bae5-e72e704c188d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.compute.manager [req-d0c0fc10-d0ea-4741-8514-452683eac440 req-27ef81b8-8b55-454d-a22d-37b7a8f54800 service nova] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Refreshing instance network info cache due to event network-changed-5ff15603-38ca-41c6-bae5-e72e704c188d. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d0c0fc10-d0ea-4741-8514-452683eac440 req-27ef81b8-8b55-454d-a22d-37b7a8f54800 service nova] Acquiring lock "refresh_cache-a81b209e-5587-4d83-a6c9-3a2256d7aa37" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Updating instance_info_cache with network_info: [{"id": "5ff15603-38ca-41c6-bae5-e72e704c188d", "address": "fa:16:3e:02:6b:7f", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff15603-38", "ovs_interfaceid": "5ff15603-38ca-41c6-bae5-e72e704c188d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Releasing lock "refresh_cache-a81b209e-5587-4d83-a6c9-3a2256d7aa37" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Instance network_info: |[{"id": "5ff15603-38ca-41c6-bae5-e72e704c188d", "address": "fa:16:3e:02:6b:7f", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff15603-38", "ovs_interfaceid": "5ff15603-38ca-41c6-bae5-e72e704c188d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d0c0fc10-d0ea-4741-8514-452683eac440 req-27ef81b8-8b55-454d-a22d-37b7a8f54800 service nova] Acquired lock "refresh_cache-a81b209e-5587-4d83-a6c9-3a2256d7aa37" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.network.neutron [req-d0c0fc10-d0ea-4741-8514-452683eac440 req-27ef81b8-8b55-454d-a22d-37b7a8f54800 service nova] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Refreshing network info cache for port 5ff15603-38ca-41c6-bae5-e72e704c188d {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Start _get_guest_xml network_info=[{"id": "5ff15603-38ca-41c6-bae5-e72e704c188d", "address": "fa:16:3e:02:6b:7f", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff15603-38", "ovs_interfaceid": "5ff15603-38ca-41c6-bae5-e72e704c188d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:57:37 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:57:37 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:57:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-255947103',display_name='tempest-VolumesAdminNegativeTest-server-255947103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-255947103',id=19,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61eb463233344f65b2657a952c24d331',ramdisk_id='',reservation_id='r-kns0an0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-772182177',owner_user_name='tempest-VolumesAdminNegativeTest-772182177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:57:36Z,user_data=None,user_id='d3e2da79669b41bea6e6a166c7c4a513',uuid=a81b209e-5587-4d83-a6c9-3a2256d7aa37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ff15603-38ca-41c6-bae5-e72e704c188d", "address": "fa:16:3e:02:6b:7f", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff15603-38", "ovs_interfaceid": "5ff15603-38ca-41c6-bae5-e72e704c188d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Converting VIF {"id": "5ff15603-38ca-41c6-bae5-e72e704c188d", "address": "fa:16:3e:02:6b:7f", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff15603-38", "ovs_interfaceid": "5ff15603-38ca-41c6-bae5-e72e704c188d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:6b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5ff15603-38ca-41c6-bae5-e72e704c188d,network=Network(5d45b218-0125-40ea-9e08-64f416fc77ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff15603-38') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.objects.instance [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lazy-loading 'pci_devices' on Instance uuid a81b209e-5587-4d83-a6c9-3a2256d7aa37 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:57:37 user nova-compute[74039]:   <uuid>a81b209e-5587-4d83-a6c9-3a2256d7aa37</uuid>
Oct 20 08:57:37 user nova-compute[74039]:   <name>instance-00000013</name>
Oct 20 08:57:37 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:57:37 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:57:37 user nova-compute[74039]:   <metadata>
Oct 20 08:57:37 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:57:37 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:57:37 user nova-compute[74039]:       <nova:name>tempest-VolumesAdminNegativeTest-server-255947103</nova:name>
Oct 20 08:57:37 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:57:37</nova:creationTime>
Oct 20 08:57:37 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:57:37 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:57:37 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:57:37 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:57:37 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:57:37 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:57:37 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:57:37 user nova-compute[74039]:       <nova:owner>
Oct 20 08:57:37 user nova-compute[74039]:         <nova:user uuid="d3e2da79669b41bea6e6a166c7c4a513">tempest-VolumesAdminNegativeTest-772182177-project-member</nova:user>
Oct 20 08:57:37 user nova-compute[74039]:         <nova:project uuid="61eb463233344f65b2657a952c24d331">tempest-VolumesAdminNegativeTest-772182177</nova:project>
Oct 20 08:57:37 user nova-compute[74039]:       </nova:owner>
Oct 20 08:57:37 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:57:37 user nova-compute[74039]:       <nova:ports>
Oct 20 08:57:37 user nova-compute[74039]:         <nova:port uuid="5ff15603-38ca-41c6-bae5-e72e704c188d">
Oct 20 08:57:37 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 08:57:37 user nova-compute[74039]:         </nova:port>
Oct 20 08:57:37 user nova-compute[74039]:       </nova:ports>
Oct 20 08:57:37 user nova-compute[74039]:     </nova:instance>
Oct 20 08:57:37 user nova-compute[74039]:   </metadata>
Oct 20 08:57:37 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:57:37 user nova-compute[74039]:     <system>
Oct 20 08:57:37 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:57:37 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:57:37 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:57:37 user nova-compute[74039]:       <entry name="serial">a81b209e-5587-4d83-a6c9-3a2256d7aa37</entry>
Oct 20 08:57:37 user nova-compute[74039]:       <entry name="uuid">a81b209e-5587-4d83-a6c9-3a2256d7aa37</entry>
Oct 20 08:57:37 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:57:37 user nova-compute[74039]:     </system>
Oct 20 08:57:37 user nova-compute[74039]:   </sysinfo>
Oct 20 08:57:37 user nova-compute[74039]:   <os>
Oct 20 08:57:37 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:57:37 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:57:37 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:57:37 user nova-compute[74039]:   </os>
Oct 20 08:57:37 user nova-compute[74039]:   <features>
Oct 20 08:57:37 user nova-compute[74039]:     <acpi/>
Oct 20 08:57:37 user nova-compute[74039]:     <apic/>
Oct 20 08:57:37 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:57:37 user nova-compute[74039]:   </features>
Oct 20 08:57:37 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:57:37 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:57:37 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:57:37 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:57:37 user nova-compute[74039]:   </clock>
Oct 20 08:57:37 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:57:37 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:57:37 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:57:37 user nova-compute[74039]:   </cpu>
Oct 20 08:57:37 user nova-compute[74039]:   <devices>
Oct 20 08:57:37 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:57:37 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:57:37 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37/disk"/>
Oct 20 08:57:37 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:57:37 user nova-compute[74039]:     </disk>
Oct 20 08:57:37 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:57:37 user nova-compute[74039]:       <mac address="fa:16:3e:02:6b:7f"/>
Oct 20 08:57:37 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:57:37 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:57:37 user nova-compute[74039]:       <target dev="tap5ff15603-38"/>
Oct 20 08:57:37 user nova-compute[74039]:     </interface>
Oct 20 08:57:37 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:57:37 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37/console.log" append="off"/>
Oct 20 08:57:37 user nova-compute[74039]:     </serial>
Oct 20 08:57:37 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:57:37 user nova-compute[74039]:     <video>
Oct 20 08:57:37 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:57:37 user nova-compute[74039]:     </video>
Oct 20 08:57:37 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:57:37 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:57:37 user nova-compute[74039]:     </rng>
Oct 20 08:57:37 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:57:37 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:57:37 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:57:37 user nova-compute[74039]:     </memballoon>
Oct 20 08:57:37 user nova-compute[74039]:   </devices>
Oct 20 08:57:37 user nova-compute[74039]: </domain>
Oct 20 08:57:37 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:57:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-255947103',display_name='tempest-VolumesAdminNegativeTest-server-255947103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-255947103',id=19,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61eb463233344f65b2657a952c24d331',ramdisk_id='',reservation_id='r-kns0an0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-772182177',owner_user_name='tempest-VolumesAdminNegativeTest-772182177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:57:36Z,user_data=None,user_id='d3e2da79669b41bea6e6a166c7c4a513',uuid=a81b209e-5587-4d83-a6c9-3a2256d7aa37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ff15603-38ca-41c6-bae5-e72e704c188d", "address": "fa:16:3e:02:6b:7f", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff15603-38", "ovs_interfaceid": "5ff15603-38ca-41c6-bae5-e72e704c188d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Converting VIF {"id": "5ff15603-38ca-41c6-bae5-e72e704c188d", "address": "fa:16:3e:02:6b:7f", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff15603-38", "ovs_interfaceid": "5ff15603-38ca-41c6-bae5-e72e704c188d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:6b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5ff15603-38ca-41c6-bae5-e72e704c188d,network=Network(5d45b218-0125-40ea-9e08-64f416fc77ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff15603-38') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:57:37 user nova-compute[74039]: DEBUG os_vif [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:6b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5ff15603-38ca-41c6-bae5-e72e704c188d,network=Network(5d45b218-0125-40ea-9e08-64f416fc77ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff15603-38') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:57:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:57:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:57:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7dfe53b-aaa5-5813-8242-1e189669c991', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:57:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:57:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ff15603-38, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:57:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ff15603-38, col_values=(('qos', UUID('adffe3a4-3992-4574-96af-0d61b374c04d')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:57:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ff15603-38, col_values=(('external_ids', {'iface-id': '5ff15603-38ca-41c6-bae5-e72e704c188d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:6b:7f', 'vm-uuid': 'a81b209e-5587-4d83-a6c9-3a2256d7aa37'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:57:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:57:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:38 user nova-compute[74039]: INFO os_vif [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:6b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5ff15603-38ca-41c6-bae5-e72e704c188d,network=Network(5d45b218-0125-40ea-9e08-64f416fc77ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff15603-38')
Oct 20 08:57:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:57:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] No VIF found with MAC fa:16:3e:02:6b:7f, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:57:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:38 user nova-compute[74039]: DEBUG nova.network.neutron [req-d0c0fc10-d0ea-4741-8514-452683eac440 req-27ef81b8-8b55-454d-a22d-37b7a8f54800 service nova] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Updated VIF entry in instance network info cache for port 5ff15603-38ca-41c6-bae5-e72e704c188d. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:57:38 user nova-compute[74039]: DEBUG nova.network.neutron [req-d0c0fc10-d0ea-4741-8514-452683eac440 req-27ef81b8-8b55-454d-a22d-37b7a8f54800 service nova] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Updating instance_info_cache with network_info: [{"id": "5ff15603-38ca-41c6-bae5-e72e704c188d", "address": "fa:16:3e:02:6b:7f", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff15603-38", "ovs_interfaceid": "5ff15603-38ca-41c6-bae5-e72e704c188d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:57:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d0c0fc10-d0ea-4741-8514-452683eac440 req-27ef81b8-8b55-454d-a22d-37b7a8f54800 service nova] Releasing lock "refresh_cache-a81b209e-5587-4d83-a6c9-3a2256d7aa37" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:57:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:39 user nova-compute[74039]: DEBUG nova.compute.manager [req-285438ae-5473-4df0-82ea-552ab750c131 req-d083cbbd-a514-4f5f-925f-1851a4482b41 service nova] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Received event network-vif-plugged-5ff15603-38ca-41c6-bae5-e72e704c188d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:57:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-285438ae-5473-4df0-82ea-552ab750c131 req-d083cbbd-a514-4f5f-925f-1851a4482b41 service nova] Acquiring lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-285438ae-5473-4df0-82ea-552ab750c131 req-d083cbbd-a514-4f5f-925f-1851a4482b41 service nova] Lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-285438ae-5473-4df0-82ea-552ab750c131 req-d083cbbd-a514-4f5f-925f-1851a4482b41 service nova] Lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:39 user nova-compute[74039]: DEBUG nova.compute.manager [req-285438ae-5473-4df0-82ea-552ab750c131 req-d083cbbd-a514-4f5f-925f-1851a4482b41 service nova] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] No waiting events found dispatching network-vif-plugged-5ff15603-38ca-41c6-bae5-e72e704c188d {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:57:39 user nova-compute[74039]: WARNING nova.compute.manager [req-285438ae-5473-4df0-82ea-552ab750c131 req-d083cbbd-a514-4f5f-925f-1851a4482b41 service nova] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Received unexpected event network-vif-plugged-5ff15603-38ca-41c6-bae5-e72e704c188d for instance with vm_state building and task_state spawning.
Oct 20 08:57:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:41 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:57:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:57:41 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Instance spawned successfully.
Oct 20 08:57:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:57:41 user nova-compute[74039]: DEBUG nova.compute.manager [req-008ee645-16e9-44d5-acd4-9a378b487a8a req-fe708a5b-21a9-4a4c-9978-e1cf55ca66a2 service nova] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Received event network-vif-plugged-5ff15603-38ca-41c6-bae5-e72e704c188d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:57:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-008ee645-16e9-44d5-acd4-9a378b487a8a req-fe708a5b-21a9-4a4c-9978-e1cf55ca66a2 service nova] Acquiring lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:57:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-008ee645-16e9-44d5-acd4-9a378b487a8a req-fe708a5b-21a9-4a4c-9978-e1cf55ca66a2 service nova] Lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:57:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-008ee645-16e9-44d5-acd4-9a378b487a8a req-fe708a5b-21a9-4a4c-9978-e1cf55ca66a2 service nova] Lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:41 user nova-compute[74039]: DEBUG nova.compute.manager [req-008ee645-16e9-44d5-acd4-9a378b487a8a req-fe708a5b-21a9-4a4c-9978-e1cf55ca66a2 service nova] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] No waiting events found dispatching network-vif-plugged-5ff15603-38ca-41c6-bae5-e72e704c188d {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:57:41 user nova-compute[74039]: WARNING nova.compute.manager [req-008ee645-16e9-44d5-acd4-9a378b487a8a req-fe708a5b-21a9-4a4c-9978-e1cf55ca66a2 service nova] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Received unexpected event network-vif-plugged-5ff15603-38ca-41c6-bae5-e72e704c188d for instance with vm_state building and task_state spawning.
Oct 20 08:57:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:57:41 user nova-compute[74039]: INFO nova.compute.manager [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Took 5.73 seconds to spawn the instance on the hypervisor.
Oct 20 08:57:41 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:57:41 user nova-compute[74039]: INFO nova.compute.manager [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Took 10.15 seconds to build instance.
Oct 20 08:57:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d03d392c-4245-490c-9199-e6e0bb01fc16 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.307s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:57:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:57:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:58:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:58:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:58:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:58:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:58:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:58:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:58:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:58:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:58:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:58:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Updating instance_info_cache with network_info: [{"id": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "address": "fa:16:3e:38:e8:6c", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9df57e-7c", "ovs_interfaceid": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:58:29 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 08:58:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 08:58:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:58:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:58:32 user nova-compute[74039]: INFO nova.compute.manager [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Detaching volume 4e26a4a0-8c25-4f88-915d-503058b5464a
Oct 20 08:58:32 user nova-compute[74039]: INFO nova.virt.block_device [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Attempting to driver detach volume 4e26a4a0-8c25-4f88-915d-503058b5464a from mountpoint /dev/vdb
Oct 20 08:58:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Attempting to detach device vdb from instance 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 08:58:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 08:58:32 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:58:32 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 08:58:32 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 08:58:32 user nova-compute[74039]:   <serial>4e26a4a0-8c25-4f88-915d-503058b5464a</serial>
Oct 20 08:58:32 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 08:58:32 user nova-compute[74039]: </disk>
Oct 20 08:58:32 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 08:58:32 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Successfully detached device vdb from instance 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 from the persistent domain config.
Oct 20 08:58:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 08:58:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 08:58:32 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:58:32 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 08:58:32 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 08:58:32 user nova-compute[74039]:   <serial>4e26a4a0-8c25-4f88-915d-503058b5464a</serial>
Oct 20 08:58:32 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 08:58:32 user nova-compute[74039]: </disk>
Oct 20 08:58:32 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 08:58:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:58:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 08:58:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:35 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:58:35 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:58:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7100MB free_disk=25.494487762451172GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 08:58:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:58:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:58:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 9fe77a96-fcb5-4410-85cc-58d925548e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:58:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c8054dbd-c0ae-45d2-af95-dae7d05f8c69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:58:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:58:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:58:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 3625b19d-4394-4feb-bbe8-55a2d86dd7fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:58:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 385b3191-b427-4e5e-af5b-d929fceef331 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:58:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance ebaa4804-32e5-4fff-9562-0587ff7ca4ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:58:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 03e487d1-90aa-436d-9c2f-468f9791af91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:58:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:58:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 8021f35f-8194-4c14-b965-987f8637be21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:58:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance d61f84a9-85ea-40aa-b21e-45064b3bc090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:58:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance a81b209e-5587-4d83-a6c9-3a2256d7aa37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:58:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 08:58:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 08:58:36 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:58:36 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:58:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 08:58:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:58:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.volume.cinder [None req-d57afaa2-dea8-4f31-a9b0-ea0371c6f5ca tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Update attachment failed for attachment b35472b5-6f70-4aba-b4f2-e9301460d225. Error: Unable to update the attachment. (HTTP 500) (Request-ID: req-6b2daf1f-bb91-434d-9c3e-714a800e147d) Code: 500: cinderclient.exceptions.ClientException: Unable to update the attachment. (HTTP 500) (Request-ID: req-6b2daf1f-bb91-434d-9c3e-714a800e147d)
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [None req-d57afaa2-dea8-4f31-a9b0-ea0371c6f5ca tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Failed to attach 2b8970f8-893d-4890-baf2-2576089722f1 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update the attachment. (HTTP 500) (Request-ID: req-6b2daf1f-bb91-434d-9c3e-714a800e147d)
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Traceback (most recent call last):
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]     ret_val = method(obj, context, *args, **kwargs)
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]     self._do_attach(context, instance, volume, volume_api,
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]     self._volume_attach(context, volume, connector, instance,
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]     connection_info = volume_api.attachment_update(
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]     res = method(self, ctx, *args, **kwargs)
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]     with excutils.save_and_reraise_exception():
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]     self.force_reraise()
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]     raise self.value
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]     return method.func(obj, *args, **kwargs)
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]     resp = self._update('/attachments/%s' % id, body)
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]     return self.request(url, method, **kwargs)
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331]     raise exceptions.from_response(resp, body)
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331] cinderclient.exceptions.ClientException: Unable to update the attachment. (HTTP 500) (Request-ID: req-6b2daf1f-bb91-434d-9c3e-714a800e147d)
Oct 20 08:58:38 user nova-compute[74039]: ERROR nova.compute.manager [instance: 385b3191-b427-4e5e-af5b-d929fceef331] 
Oct 20 08:58:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d57afaa2-dea8-4f31-a9b0-ea0371c6f5ca tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "385b3191-b427-4e5e-af5b-d929fceef331" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 120.453s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server [None req-d57afaa2-dea8-4f31-a9b0-ea0371c6f5ca tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update the attachment. (HTTP 500) (Request-ID: req-6b2daf1f-bb91-434d-9c3e-714a800e147d)
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update the attachment. (HTTP 500) (Request-ID: req-6b2daf1f-bb91-434d-9c3e-714a800e147d)
Oct 20 08:58:38 user nova-compute[74039]: ERROR oslo_messaging.rpc.server 
Oct 20 08:58:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "03e487d1-90aa-436d-9c2f-468f9791af91" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "03e487d1-90aa-436d-9c2f-468f9791af91" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG nova.objects.instance [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lazy-loading 'flavor' on Instance uuid 03e487d1-90aa-436d-9c2f-468f9791af91 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "03e487d1-90aa-436d-9c2f-468f9791af91" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "03e487d1-90aa-436d-9c2f-468f9791af91" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "03e487d1-90aa-436d-9c2f-468f9791af91" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:58:45 user nova-compute[74039]: INFO nova.compute.manager [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Attaching volume 9142d9e6-9d0b-4920-aa08-e05ace57cbbf to /dev/vdb
Oct 20 08:58:45 user nova-compute[74039]: DEBUG os_brick.utils [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc75b95-db95-4281-8bde-1ad789c84226]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b1827b-8c2c-45f0-8bbc-5c2ac25c428c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[67438948-76d1-4e02-8606-8fab3a711112]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2ad850-c1c5-434e-aea8-a0e5608810a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:58:45 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:58:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c07d74-4702-4e81-82d7-8d27323579f8]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG os_brick.utils [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:58:45 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Updating existing volume attachment record: 06ce466d-e008-4e9d-949d-79384e38d059 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 08:58:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-0fafb05e-c5cb-4c2e-b924-ab172180a044 req-3e7c84f5-69bd-4e07-af4e-62ed409cf35f service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-changed-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:58:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-0fafb05e-c5cb-4c2e-b924-ab172180a044 req-3e7c84f5-69bd-4e07-af4e-62ed409cf35f service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Refreshing instance network info cache due to event network-changed-45971bed-5f51-4ebd-9641-e2cc09d91d71. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:58:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0fafb05e-c5cb-4c2e-b924-ab172180a044 req-3e7c84f5-69bd-4e07-af4e-62ed409cf35f service nova] Acquiring lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:58:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0fafb05e-c5cb-4c2e-b924-ab172180a044 req-3e7c84f5-69bd-4e07-af4e-62ed409cf35f service nova] Acquired lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:58:46 user nova-compute[74039]: DEBUG nova.network.neutron [req-0fafb05e-c5cb-4c2e-b924-ab172180a044 req-3e7c84f5-69bd-4e07-af4e-62ed409cf35f service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Refreshing network info cache for port 45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG nova.objects.instance [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'flavor' on Instance uuid 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG nova.network.neutron [req-0fafb05e-c5cb-4c2e-b924-ab172180a044 req-3e7c84f5-69bd-4e07-af4e-62ed409cf35f service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Updated VIF entry in instance network info cache for port 45971bed-5f51-4ebd-9641-e2cc09d91d71. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG nova.network.neutron [req-0fafb05e-c5cb-4c2e-b924-ab172180a044 req-3e7c84f5-69bd-4e07-af4e-62ed409cf35f service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Updating instance_info_cache with network_info: [{"id": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "address": "fa:16:3e:0c:c9:b0", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45971bed-5f", "ovs_interfaceid": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:58:47 user nova-compute[74039]: INFO nova.compute.manager [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Attaching volume 90b8f68d-643c-4def-b0f8-fa41b129e2cf to /dev/vdb
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0fafb05e-c5cb-4c2e-b924-ab172180a044 req-3e7c84f5-69bd-4e07-af4e-62ed409cf35f service nova] Releasing lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG os_brick.utils [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2a220e-e9cf-4516-809b-31619004c28c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c5ce69-7e4f-4867-820e-97ca8ee14cd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1055a7-6e5b-46c1-b001-2d128cd57c7e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dcea42-76e7-4611-9a0a-939ba9b4c762]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:58:47 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:58:47 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c982541-df55-4828-8298-81b9e4e4323c]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG os_brick.utils [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:58:47 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Updating existing volume attachment record: a46d9cec-2030-425a-a28d-974b7a2b96f1 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 08:58:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:58:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:58:53 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 is timed out.
Oct 20 08:58:53 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Successfully detached device vdb from instance 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 from the live domain config.
Oct 20 08:58:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDUXuOSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:58:53 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:58:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd540298-9eaa-421b-be74-5e1d4b4923d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 08:58:53 user nova-compute[74039]: No targets found.
Oct 20 08:58:53 user nova-compute[74039]: iSNS:
Oct 20 08:58:53 user nova-compute[74039]: No targets found.
Oct 20 08:58:53 user nova-compute[74039]: STATIC:
Oct 20 08:58:53 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a
Oct 20 08:58:53 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:58:53 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:58:53 user nova-compute[74039]: FIRMWARE:
Oct 20 08:58:53 user nova-compute[74039]: No targets found.
Oct 20 08:58:53 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 08:58:53 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 08:58:53 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c575ec6-2bc9-4d15-95f2-3067eb335c89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13ec99e-7a37-4eb8-ac97-5c7053bc8d2e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)
Oct 20 08:58:53 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a (non-flash)
Oct 20 08:58:53 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae845239a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a'): ({'sdb'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Removing single pathed devices sdb {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ad560f-8e81-4ff7-b1b5-0f7cb5001809]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[754d52ac-23e2-43fd-aed4-31e7f996a87a]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Flushing IO for device /dev/sdb {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a32383d-81b7-42f4-9d85-451152e39e25]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f2d19f-e50e-4daa-8914-57f157604f97]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9d068f-0cc1-4760-93df-16acf015e496]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2550f997-9740-437e-a0b2-f1e182bd196f]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a, portal: 172.16.0.220,3260]
Oct 20 08:58:53 user nova-compute[74039]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a, portal: 172.16.0.220,3260] successful.
Oct 20 08:58:53 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e26a4a0-8c25-4f88-915d-503058b5464a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62faa4b-e1a0-444a-a9a4-0cbac5ba7eff]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] <== disconnect_volume: return (304ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:58:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 08:58:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:58:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG nova.objects.instance [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lazy-loading 'flavor' on Instance uuid 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e8802e55-abfa-4860-a553-5231b9c40322 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.672s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPMDhJmO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:59:05 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:59:05 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:59:05 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de84da0-7060-4423-ad90-13c29b31143c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 08:59:05 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[76128e8c-7afc-4c56-a0eb-a0c888c213b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf] added
Oct 20 08:59:05 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ca5dc4-78c2-4199-a1e7-46a0d12c7306]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ee0e6e-d9db-4f39-b0af-56c49fd85e42]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cPMDhJmO {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cPMDhJmO" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ee3131-28ad-44f4-8139-04f0ef004e1e]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cPMDhJmO'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2349f2ba-8f69-4286-82e1-93da9914cb91]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fa4903-04b0-4567-a2a8-3aede78e9614]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 08:59:05 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 08:59:05 user nova-compute[74039]:  {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:59:05 user nova-compute[74039]: WARNING os_brick.initiator.connectors.iscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 08:59:05 user nova-compute[74039]: 
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1236884-3ee5-43d9-8e1d-92a1592a2d73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf, portal: 172.16.0.220,3260]
Oct 20 08:59:05 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf, portal: 172.16.0.220,3260] successful.
Oct 20 08:59:05 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d70a11-7eb4-41d1-9927-bb4da6ff26e4]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f210fa1-53fb-44f2-a8fb-c6a269be78ec]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 08:59:05 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 08:59:05 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[201207a6-b4ac-43e4-be49-01528329eff1]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:59:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPMDhJmO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 08:59:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Acquiring lock "8021f35f-8194-4c14-b965-987f8637be21" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Lock "8021f35f-8194-4c14-b965-987f8637be21" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Acquiring lock "8021f35f-8194-4c14-b965-987f8637be21-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Lock "8021f35f-8194-4c14-b965-987f8637be21-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Lock "8021f35f-8194-4c14-b965-987f8637be21-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:06 user nova-compute[74039]: INFO nova.compute.manager [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Terminating instance
Oct 20 08:59:06 user nova-compute[74039]: DEBUG nova.compute.manager [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 08:59:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:59:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26134643164323738', 'path': '/dev/sdb'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:59:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134643164323738', 'path': '/dev/sdb'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 08:59:06 user nova-compute[74039]: DEBUG nova.objects.instance [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'flavor' on Instance uuid 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:59:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 08:59:06 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:59:06 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 08:59:06 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 08:59:06 user nova-compute[74039]:   <serial>90b8f68d-643c-4def-b0f8-fa41b129e2cf</serial>
Oct 20 08:59:06 user nova-compute[74039]: </disk>
Oct 20 08:59:06 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-63ad22f4-8b7f-4c46-8b59-97b08e067d6d req-d801cc36-c78b-4ece-b34f-7dc33d328883 service nova] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Received event network-vif-unplugged-7940c977-f637-476e-a8eb-5cd7c4f9ceee {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-63ad22f4-8b7f-4c46-8b59-97b08e067d6d req-d801cc36-c78b-4ece-b34f-7dc33d328883 service nova] Acquiring lock "8021f35f-8194-4c14-b965-987f8637be21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-63ad22f4-8b7f-4c46-8b59-97b08e067d6d req-d801cc36-c78b-4ece-b34f-7dc33d328883 service nova] Lock "8021f35f-8194-4c14-b965-987f8637be21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-63ad22f4-8b7f-4c46-8b59-97b08e067d6d req-d801cc36-c78b-4ece-b34f-7dc33d328883 service nova] Lock "8021f35f-8194-4c14-b965-987f8637be21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-63ad22f4-8b7f-4c46-8b59-97b08e067d6d req-d801cc36-c78b-4ece-b34f-7dc33d328883 service nova] [instance: 8021f35f-8194-4c14-b965-987f8637be21] No waiting events found dispatching network-vif-unplugged-7940c977-f637-476e-a8eb-5cd7c4f9ceee {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-63ad22f4-8b7f-4c46-8b59-97b08e067d6d req-d801cc36-c78b-4ece-b34f-7dc33d328883 service nova] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Received event network-vif-unplugged-7940c977-f637-476e-a8eb-5cd7c4f9ceee for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:59:07 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Instance destroyed successfully.
Oct 20 08:59:07 user nova-compute[74039]: DEBUG nova.objects.instance [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Lazy-loading 'resources' on Instance uuid 8021f35f-8194-4c14-b965-987f8637be21 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:57:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-672808910',display_name='tempest-VolumesNegativeTest-instance-672808910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-672808910',id=17,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:57:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8f11e6d9bbb434ab0b7bc8b3ea4596b',ramdisk_id='',reservation_id='r-iij0vjfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2134407769',owner_user_name='tempest-VolumesNegativeTest-2134407769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:57:24Z,user_data=None,user_id='c3959407fe224b999d2777b4dbcb10c7',uuid=8021f35f-8194-4c14-b965-987f8637be21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7940c977-f637-476e-a8eb-5cd7c4f9ceee", "address": "fa:16:3e:89:71:19", "network": {"id": "ec42b455-9c86-4054-acf6-1b24524821d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ee7f98662b44e8cb41923dce3e240aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7940c977-f6", "ovs_interfaceid": "7940c977-f637-476e-a8eb-5cd7c4f9ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Converting VIF {"id": "7940c977-f637-476e-a8eb-5cd7c4f9ceee", "address": "fa:16:3e:89:71:19", "network": {"id": "ec42b455-9c86-4054-acf6-1b24524821d1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2ee7f98662b44e8cb41923dce3e240aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7940c977-f6", "ovs_interfaceid": "7940c977-f637-476e-a8eb-5cd7c4f9ceee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:71:19,bridge_name='br-int',has_traffic_filtering=True,id=7940c977-f637-476e-a8eb-5cd7c4f9ceee,network=Network(ec42b455-9c86-4054-acf6-1b24524821d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7940c977-f6') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG os_vif [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:71:19,bridge_name='br-int',has_traffic_filtering=True,id=7940c977-f637-476e-a8eb-5cd7c4f9ceee,network=Network(ec42b455-9c86-4054-acf6-1b24524821d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7940c977-f6') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7940c977-f6, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=edaefae4-ba76-4001-beac-f761047a063c) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:59:07 user nova-compute[74039]: INFO os_vif [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:71:19,bridge_name='br-int',has_traffic_filtering=True,id=7940c977-f637-476e-a8eb-5cd7c4f9ceee,network=Network(ec42b455-9c86-4054-acf6-1b24524821d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7940c977-f6')
Oct 20 08:59:07 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Deleting instance files /opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21_del
Oct 20 08:59:07 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Deletion of /opt/stack/data/nova/instances/8021f35f-8194-4c14-b965-987f8637be21_del complete
Oct 20 08:59:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] No VIF found with MAC fa:16:3e:0c:c9:b0, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:59:07 user nova-compute[74039]: INFO nova.compute.manager [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Took 1.04 seconds to destroy the instance on the hypervisor.
Oct 20 08:59:07 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 8021f35f-8194-4c14-b965-987f8637be21] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 08:59:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-63c2eee4-b5b2-416b-82ac-a60977cfccf6 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.322s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:08 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:59:08 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Took 0.50 seconds to deallocate network for instance.
Oct 20 08:59:08 user nova-compute[74039]: INFO nova.compute.manager [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Rescuing
Oct 20 08:59:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:59:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquired lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:59:08 user nova-compute[74039]: DEBUG nova.network.neutron [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:59:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:08 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:59:08 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:59:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:08 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Deleted allocations for instance 8021f35f-8194-4c14-b965-987f8637be21
Oct 20 08:59:08 user nova-compute[74039]: DEBUG nova.network.neutron [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Updating instance_info_cache with network_info: [{"id": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "address": "fa:16:3e:0c:c9:b0", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45971bed-5f", "ovs_interfaceid": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:59:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Releasing lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:59:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2679f79a-6220-4edd-8cb0-714c23fb4007 tempest-VolumesNegativeTest-2134407769 tempest-VolumesNegativeTest-2134407769-project-member] Lock "8021f35f-8194-4c14-b965-987f8637be21" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.149s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-49112439-9c44-4ba2-8231-e9a9f725e754 req-53b796f9-58a6-48c8-8677-7ada7b227364 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-vif-unplugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-49112439-9c44-4ba2-8231-e9a9f725e754 req-53b796f9-58a6-48c8-8677-7ada7b227364 service nova] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-49112439-9c44-4ba2-8231-e9a9f725e754 req-53b796f9-58a6-48c8-8677-7ada7b227364 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-49112439-9c44-4ba2-8231-e9a9f725e754 req-53b796f9-58a6-48c8-8677-7ada7b227364 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-49112439-9c44-4ba2-8231-e9a9f725e754 req-53b796f9-58a6-48c8-8677-7ada7b227364 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] No waiting events found dispatching network-vif-unplugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:59:09 user nova-compute[74039]: WARNING nova.compute.manager [req-49112439-9c44-4ba2-8231-e9a9f725e754 req-53b796f9-58a6-48c8-8677-7ada7b227364 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received unexpected event network-vif-unplugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 for instance with vm_state active and task_state rescuing.
Oct 20 08:59:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-b549a9da-c91a-4228-b8a7-90eeab0b58a3 req-44083543-32f9-41ae-8214-976453162eff service nova] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Received event network-vif-plugged-7940c977-f637-476e-a8eb-5cd7c4f9ceee {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b549a9da-c91a-4228-b8a7-90eeab0b58a3 req-44083543-32f9-41ae-8214-976453162eff service nova] Acquiring lock "8021f35f-8194-4c14-b965-987f8637be21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b549a9da-c91a-4228-b8a7-90eeab0b58a3 req-44083543-32f9-41ae-8214-976453162eff service nova] Lock "8021f35f-8194-4c14-b965-987f8637be21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b549a9da-c91a-4228-b8a7-90eeab0b58a3 req-44083543-32f9-41ae-8214-976453162eff service nova] Lock "8021f35f-8194-4c14-b965-987f8637be21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-b549a9da-c91a-4228-b8a7-90eeab0b58a3 req-44083543-32f9-41ae-8214-976453162eff service nova] [instance: 8021f35f-8194-4c14-b965-987f8637be21] No waiting events found dispatching network-vif-plugged-7940c977-f637-476e-a8eb-5cd7c4f9ceee {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:59:09 user nova-compute[74039]: WARNING nova.compute.manager [req-b549a9da-c91a-4228-b8a7-90eeab0b58a3 req-44083543-32f9-41ae-8214-976453162eff service nova] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Received unexpected event network-vif-plugged-7940c977-f637-476e-a8eb-5cd7c4f9ceee for instance with vm_state deleted and task_state None.
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-b549a9da-c91a-4228-b8a7-90eeab0b58a3 req-44083543-32f9-41ae-8214-976453162eff service nova] [instance: 8021f35f-8194-4c14-b965-987f8637be21] Received event network-vif-deleted-7940c977-f637-476e-a8eb-5cd7c4f9ceee {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:09 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Instance destroyed successfully.
Oct 20 08:59:09 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Attempting rescue
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74039) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Instance directory exists: not creating {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 08:59:09 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Creating image(s)
Oct 20 08:59:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "/opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "/opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.objects.instance [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk.rescue {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk.rescue" returned: 0 in 0.054s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.objects.instance [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'migration_context' on Instance uuid 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.objects.base [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Object Instance<2ae63f29-de62-4e82-877c-8bb4a3f2beb3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Start _get_guest_xml network_info=[{"id": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "address": "fa:16:3e:0c:c9:b0", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "vif_mac": "fa:16:3e:0c:c9:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45971bed-5f", "ovs_interfaceid": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f58b9629-4790-4951-9492-6447e1485638', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.objects.instance [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'resources' on Instance uuid 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.objects.base [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Object Instance<2ae63f29-de62-4e82-877c-8bb4a3f2beb3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.objects.instance [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'numa_topology' on Instance uuid 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.objects.base [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Object Instance<2ae63f29-de62-4e82-877c-8bb4a3f2beb3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 08:59:09 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:59:09 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.objects.instance [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.objects.base [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Object Instance<2ae63f29-de62-4e82-877c-8bb4a3f2beb3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-672455651',display_name='tempest-ServerRescueNegativeTestJSON-server-672455651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-672455651',id=16,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/4hHvbGoEk8NCxt9ELjeY9iZ2B0QwhUSOtV9sftmfCgRXaPDsyLfZUde/IDIYj+13oBjVfPBDVNN+VD63zEivAAHfkwfA/NCYJYdBOqj0F8bFDm7gPMUHQ93MvUkhiGA==',key_name='tempest-keypair-763047870',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:57:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d74bb65080a343afb5cbcea1b5481938',ramdisk_id='',reservation_id='r-byof0x6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1580334620',owner_user_name='tempest-ServerRescueNegativeTestJSON-1580334620-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:57:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4024fa0ccfda49e0a070b9e6166e37ed',uuid=2ae63f29-de62-4e82-877c-8bb4a3f2beb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "address": "fa:16:3e:0c:c9:b0", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "vif_mac": "fa:16:3e:0c:c9:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45971bed-5f", "ovs_interfaceid": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converting VIF {"id": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "address": "fa:16:3e:0c:c9:b0", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "vif_mac": "fa:16:3e:0c:c9:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45971bed-5f", "ovs_interfaceid": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:c9:b0,bridge_name='br-int',has_traffic_filtering=True,id=45971bed-5f51-4ebd-9641-e2cc09d91d71,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45971bed-5f') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.objects.instance [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.objects.base [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Object Instance<2ae63f29-de62-4e82-877c-8bb4a3f2beb3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:59:09 user nova-compute[74039]:   <uuid>2ae63f29-de62-4e82-877c-8bb4a3f2beb3</uuid>
Oct 20 08:59:09 user nova-compute[74039]:   <name>instance-00000010</name>
Oct 20 08:59:09 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:59:09 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:59:09 user nova-compute[74039]:   <metadata>
Oct 20 08:59:09 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:59:09 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:59:09 user nova-compute[74039]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-672455651</nova:name>
Oct 20 08:59:09 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:59:09</nova:creationTime>
Oct 20 08:59:09 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:59:09 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:59:09 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:59:09 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:59:09 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:59:09 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:59:09 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:59:09 user nova-compute[74039]:       <nova:owner>
Oct 20 08:59:09 user nova-compute[74039]:         <nova:user uuid="4024fa0ccfda49e0a070b9e6166e37ed">tempest-ServerRescueNegativeTestJSON-1580334620-project-member</nova:user>
Oct 20 08:59:09 user nova-compute[74039]:         <nova:project uuid="d74bb65080a343afb5cbcea1b5481938">tempest-ServerRescueNegativeTestJSON-1580334620</nova:project>
Oct 20 08:59:09 user nova-compute[74039]:       </nova:owner>
Oct 20 08:59:09 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:59:09 user nova-compute[74039]:       <nova:ports>
Oct 20 08:59:09 user nova-compute[74039]:         <nova:port uuid="45971bed-5f51-4ebd-9641-e2cc09d91d71">
Oct 20 08:59:09 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 08:59:09 user nova-compute[74039]:         </nova:port>
Oct 20 08:59:09 user nova-compute[74039]:       </nova:ports>
Oct 20 08:59:09 user nova-compute[74039]:     </nova:instance>
Oct 20 08:59:09 user nova-compute[74039]:   </metadata>
Oct 20 08:59:09 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:59:09 user nova-compute[74039]:     <system>
Oct 20 08:59:09 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:59:09 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:59:09 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:59:09 user nova-compute[74039]:       <entry name="serial">2ae63f29-de62-4e82-877c-8bb4a3f2beb3</entry>
Oct 20 08:59:09 user nova-compute[74039]:       <entry name="uuid">2ae63f29-de62-4e82-877c-8bb4a3f2beb3</entry>
Oct 20 08:59:09 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:59:09 user nova-compute[74039]:     </system>
Oct 20 08:59:09 user nova-compute[74039]:   </sysinfo>
Oct 20 08:59:09 user nova-compute[74039]:   <os>
Oct 20 08:59:09 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:59:09 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:59:09 user nova-compute[74039]:   </os>
Oct 20 08:59:09 user nova-compute[74039]:   <features>
Oct 20 08:59:09 user nova-compute[74039]:     <acpi/>
Oct 20 08:59:09 user nova-compute[74039]:     <apic/>
Oct 20 08:59:09 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:59:09 user nova-compute[74039]:   </features>
Oct 20 08:59:09 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:59:09 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:59:09 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:59:09 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:59:09 user nova-compute[74039]:   </clock>
Oct 20 08:59:09 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:59:09 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:59:09 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:59:09 user nova-compute[74039]:   </cpu>
Oct 20 08:59:09 user nova-compute[74039]:   <devices>
Oct 20 08:59:09 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:59:09 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:59:09 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk.rescue"/>
Oct 20 08:59:09 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:59:09 user nova-compute[74039]:     </disk>
Oct 20 08:59:09 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:59:09 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:59:09 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk"/>
Oct 20 08:59:09 user nova-compute[74039]:       <target dev="vdb" bus="virtio"/>
Oct 20 08:59:09 user nova-compute[74039]:     </disk>
Oct 20 08:59:09 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:59:09 user nova-compute[74039]:       <mac address="fa:16:3e:0c:c9:b0"/>
Oct 20 08:59:09 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:59:09 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:59:09 user nova-compute[74039]:       <target dev="tap45971bed-5f"/>
Oct 20 08:59:09 user nova-compute[74039]:     </interface>
Oct 20 08:59:09 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:59:09 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/console.log" append="off"/>
Oct 20 08:59:09 user nova-compute[74039]:     </serial>
Oct 20 08:59:09 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:59:09 user nova-compute[74039]:     <video>
Oct 20 08:59:09 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:59:09 user nova-compute[74039]:     </video>
Oct 20 08:59:09 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:59:09 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:59:09 user nova-compute[74039]:     </rng>
Oct 20 08:59:09 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:59:09 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:59:09 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:59:09 user nova-compute[74039]:     </memballoon>
Oct 20 08:59:09 user nova-compute[74039]:   </devices>
Oct 20 08:59:09 user nova-compute[74039]: </domain>
Oct 20 08:59:09 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:59:09 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Instance destroyed successfully.
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:59:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] No VIF found with MAC fa:16:3e:0c:c9:b0, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:59:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-d740619c-9f18-4904-ae40-0205db701e52 req-52722cce-07bb-43a3-8c1c-401ebe2138a0 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d740619c-9f18-4904-ae40-0205db701e52 req-52722cce-07bb-43a3-8c1c-401ebe2138a0 service nova] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d740619c-9f18-4904-ae40-0205db701e52 req-52722cce-07bb-43a3-8c1c-401ebe2138a0 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d740619c-9f18-4904-ae40-0205db701e52 req-52722cce-07bb-43a3-8c1c-401ebe2138a0 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-d740619c-9f18-4904-ae40-0205db701e52 req-52722cce-07bb-43a3-8c1c-401ebe2138a0 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] No waiting events found dispatching network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:59:11 user nova-compute[74039]: WARNING nova.compute.manager [req-d740619c-9f18-4904-ae40-0205db701e52 req-52722cce-07bb-43a3-8c1c-401ebe2138a0 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received unexpected event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 for instance with vm_state active and task_state rescuing.
Oct 20 08:59:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:11 user nova-compute[74039]: DEBUG nova.objects.instance [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lazy-loading 'flavor' on Instance uuid ebaa4804-32e5-4fff-9562-0587ff7ca4ed {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:59:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:11 user nova-compute[74039]: INFO nova.compute.manager [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Attaching volume fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 to /dev/vdb
Oct 20 08:59:11 user nova-compute[74039]: DEBUG os_brick.utils [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:59:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b73670-c3db-4d4b-b350-0a6db087ba5f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[efddb869-4e20-4e29-8710-619cc3e71e9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[47122af7-dfe5-4ea4-97b8-d45881d128e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf924fc-f226-4cad-be56-69a0a079e248]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:59:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:59:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:59:12 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:59:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3cff14-b4f5-4097-a5f8-37d2a4d78df8]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:59:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:59:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:59:12 user nova-compute[74039]: DEBUG os_brick.utils [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:59:12 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Updating existing volume attachment record: 9a84c7fd-7cb5-439f-8b54-51740c891538 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 08:59:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-0637bb3c-fc31-4cc7-bdc0-91f06671886f req-544e7653-f45d-4fca-b111-17432d6c9b53 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0637bb3c-fc31-4cc7-bdc0-91f06671886f req-544e7653-f45d-4fca-b111-17432d6c9b53 service nova] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0637bb3c-fc31-4cc7-bdc0-91f06671886f req-544e7653-f45d-4fca-b111-17432d6c9b53 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0637bb3c-fc31-4cc7-bdc0-91f06671886f req-544e7653-f45d-4fca-b111-17432d6c9b53 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-0637bb3c-fc31-4cc7-bdc0-91f06671886f req-544e7653-f45d-4fca-b111-17432d6c9b53 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] No waiting events found dispatching network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:59:13 user nova-compute[74039]: WARNING nova.compute.manager [req-0637bb3c-fc31-4cc7-bdc0-91f06671886f req-544e7653-f45d-4fca-b111-17432d6c9b53 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received unexpected event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 for instance with vm_state active and task_state rescuing.
Oct 20 08:59:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-0637bb3c-fc31-4cc7-bdc0-91f06671886f req-544e7653-f45d-4fca-b111-17432d6c9b53 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0637bb3c-fc31-4cc7-bdc0-91f06671886f req-544e7653-f45d-4fca-b111-17432d6c9b53 service nova] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0637bb3c-fc31-4cc7-bdc0-91f06671886f req-544e7653-f45d-4fca-b111-17432d6c9b53 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0637bb3c-fc31-4cc7-bdc0-91f06671886f req-544e7653-f45d-4fca-b111-17432d6c9b53 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-0637bb3c-fc31-4cc7-bdc0-91f06671886f req-544e7653-f45d-4fca-b111-17432d6c9b53 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] No waiting events found dispatching network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:59:13 user nova-compute[74039]: WARNING nova.compute.manager [req-0637bb3c-fc31-4cc7-bdc0-91f06671886f req-544e7653-f45d-4fca-b111-17432d6c9b53 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received unexpected event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 for instance with vm_state active and task_state rescuing.
Oct 20 08:59:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:13 user nova-compute[74039]: DEBUG nova.compute.manager [None req-cbc15d84-3b1e-469c-adea-c09eb53777b1 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:59:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:19 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:59:19 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 08:59:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-3625b19d-4394-4feb-bbe8-55a2d86dd7fb" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:59:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-3625b19d-4394-4feb-bbe8-55a2d86dd7fb" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:59:19 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 08:59:19 user nova-compute[74039]: DEBUG nova.compute.manager [req-5518bc83-24f2-497e-88c5-3d08215eb992 req-2b299d3f-6544-491d-bd0b-085c957a16a3 service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Received event network-changed-b244a5a8-584d-426b-92f9-cbdd4c770a51 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:19 user nova-compute[74039]: DEBUG nova.compute.manager [req-5518bc83-24f2-497e-88c5-3d08215eb992 req-2b299d3f-6544-491d-bd0b-085c957a16a3 service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Refreshing instance network info cache due to event network-changed-b244a5a8-584d-426b-92f9-cbdd4c770a51. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:59:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5518bc83-24f2-497e-88c5-3d08215eb992 req-2b299d3f-6544-491d-bd0b-085c957a16a3 service nova] Acquiring lock "refresh_cache-d61f84a9-85ea-40aa-b21e-45064b3bc090" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:59:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5518bc83-24f2-497e-88c5-3d08215eb992 req-2b299d3f-6544-491d-bd0b-085c957a16a3 service nova] Acquired lock "refresh_cache-d61f84a9-85ea-40aa-b21e-45064b3bc090" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:59:19 user nova-compute[74039]: DEBUG nova.network.neutron [req-5518bc83-24f2-497e-88c5-3d08215eb992 req-2b299d3f-6544-491d-bd0b-085c957a16a3 service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Refreshing network info cache for port b244a5a8-584d-426b-92f9-cbdd4c770a51 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:59:20 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Updating instance_info_cache with network_info: [{"id": "b57e8401-da94-4880-b515-65198826312a", "address": "fa:16:3e:54:60:7c", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57e8401-da", "ovs_interfaceid": "b57e8401-da94-4880-b515-65198826312a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:59:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-3625b19d-4394-4feb-bbe8-55a2d86dd7fb" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:59:20 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 08:59:20 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:59:20 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:59:20 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:59:20 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:59:20 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:59:20 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 08:59:20 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:59:20 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Cleaning up deleted instances {{(pid=74039) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 08:59:20 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] There are 0 instances to clean {{(pid=74039) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 08:59:20 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:59:20 user nova-compute[74039]: DEBUG nova.network.neutron [req-5518bc83-24f2-497e-88c5-3d08215eb992 req-2b299d3f-6544-491d-bd0b-085c957a16a3 service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Updated VIF entry in instance network info cache for port b244a5a8-584d-426b-92f9-cbdd4c770a51. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:59:20 user nova-compute[74039]: DEBUG nova.network.neutron [req-5518bc83-24f2-497e-88c5-3d08215eb992 req-2b299d3f-6544-491d-bd0b-085c957a16a3 service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Updating instance_info_cache with network_info: [{"id": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "address": "fa:16:3e:f4:2a:6c", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb244a5a8-58", "ovs_interfaceid": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:59:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5518bc83-24f2-497e-88c5-3d08215eb992 req-2b299d3f-6544-491d-bd0b-085c957a16a3 service nova] Releasing lock "refresh_cache-d61f84a9-85ea-40aa-b21e-45064b3bc090" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:59:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:23 user nova-compute[74039]: INFO nova.compute.manager [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Terminating instance
Oct 20 08:59:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 08:59:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:23 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:59:23 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:59:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74039) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 08:59:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-6ba35990-04ae-45e4-a595-abdb3ffe3a9d req-2136ed80-ace0-4eef-9622-da224c0a973f service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Received event network-vif-unplugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6ba35990-04ae-45e4-a595-abdb3ffe3a9d req-2136ed80-ace0-4eef-9622-da224c0a973f service nova] Acquiring lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6ba35990-04ae-45e4-a595-abdb3ffe3a9d req-2136ed80-ace0-4eef-9622-da224c0a973f service nova] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6ba35990-04ae-45e4-a595-abdb3ffe3a9d req-2136ed80-ace0-4eef-9622-da224c0a973f service nova] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-6ba35990-04ae-45e4-a595-abdb3ffe3a9d req-2136ed80-ace0-4eef-9622-da224c0a973f service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] No waiting events found dispatching network-vif-unplugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:59:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-6ba35990-04ae-45e4-a595-abdb3ffe3a9d req-2136ed80-ace0-4eef-9622-da224c0a973f service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Received event network-vif-unplugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:59:24 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Instance destroyed successfully.
Oct 20 08:59:24 user nova-compute[74039]: DEBUG nova.objects.instance [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lazy-loading 'resources' on Instance uuid 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:59:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T08:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1458942537',display_name='tempest-ServerActionsTestOtherA-server-1019279431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1458942537',id=11,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTUpP2s33VfTl03H4wvNfWkRjE/JJ83tB47a0/XPOlnK2KS6d8iUtfaEnWynmonaIFqIQH11WXYG7tk5jqZm5Ea/itjl2zitoH8eHQjsIO5JMBUmZ70QQYY8ASvSrGQlA==',key_name='tempest-keypair-1150525820',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:56:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88a58985dce3491d8e45e6e468e0e549',ramdisk_id='',reservation_id='r-y9rntpk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1138208404',owner_user_name='tempest-ServerActionsTestOtherA-1138208404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:56:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb823f0374a04657be729eb153160659',uuid=54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "address": "fa:16:3e:38:e8:6c", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9df57e-7c", "ovs_interfaceid": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:59:24 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converting VIF {"id": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "address": "fa:16:3e:38:e8:6c", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9df57e-7c", "ovs_interfaceid": "8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:59:24 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9df57e-7c') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:59:24 user nova-compute[74039]: DEBUG os_vif [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9df57e-7c') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:59:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b9df57e-7c, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:59:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:59:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f23c45ca-d68a-4775-ac5c-23be8f1eaeba) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:59:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:24 user nova-compute[74039]: INFO os_vif [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:e8:6c,bridge_name='br-int',has_traffic_filtering=True,id=8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9df57e-7c')
Oct 20 08:59:24 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Deleting instance files /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11_del
Oct 20 08:59:24 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Deletion of /opt/stack/data/nova/instances/54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11_del complete
Oct 20 08:59:24 user nova-compute[74039]: INFO nova.compute.manager [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 20 08:59:24 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 08:59:24 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 08:59:24 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 08:59:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:59:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:25 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:59:25 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Took 1.25 seconds to deallocate network for instance.
Oct 20 08:59:25 user nova-compute[74039]: DEBUG nova.compute.manager [req-cd1c793b-5637-4967-b698-83c110e3e1b5 req-bb859dea-18fd-43bd-bb1b-c19b9806756b service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Received event network-vif-deleted-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:25 user nova-compute[74039]: INFO nova.compute.manager [req-cd1c793b-5637-4967-b698-83c110e3e1b5 req-bb859dea-18fd-43bd-bb1b-c19b9806756b service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Neutron deleted interface 8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d; detaching it from the instance and deleting it from the info cache
Oct 20 08:59:25 user nova-compute[74039]: DEBUG nova.network.neutron [req-cd1c793b-5637-4967-b698-83c110e3e1b5 req-bb859dea-18fd-43bd-bb1b-c19b9806756b service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:59:25 user nova-compute[74039]: DEBUG nova.compute.manager [req-cd1c793b-5637-4967-b698-83c110e3e1b5 req-bb859dea-18fd-43bd-bb1b-c19b9806756b service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Detach interface failed, port_id=8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d, reason: Instance 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11 could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 08:59:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:25 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 08:59:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:25 user nova-compute[74039]: DEBUG nova.compute.manager [req-25378e19-747c-4826-a9ba-d7b169a42157 req-942e744f-1434-4833-8e59-7613350ccb76 service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Received event network-vif-plugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-25378e19-747c-4826-a9ba-d7b169a42157 req-942e744f-1434-4833-8e59-7613350ccb76 service nova] Acquiring lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-25378e19-747c-4826-a9ba-d7b169a42157 req-942e744f-1434-4833-8e59-7613350ccb76 service nova] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-25378e19-747c-4826-a9ba-d7b169a42157 req-942e744f-1434-4833-8e59-7613350ccb76 service nova] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:25 user nova-compute[74039]: DEBUG nova.compute.manager [req-25378e19-747c-4826-a9ba-d7b169a42157 req-942e744f-1434-4833-8e59-7613350ccb76 service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] No waiting events found dispatching network-vif-plugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:59:25 user nova-compute[74039]: WARNING nova.compute.manager [req-25378e19-747c-4826-a9ba-d7b169a42157 req-942e744f-1434-4833-8e59-7613350ccb76 service nova] [instance: 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11] Received unexpected event network-vif-plugged-8b9df57e-7cb7-4f6a-9b78-db441c9aeb2d for instance with vm_state deleted and task_state None.
Oct 20 08:59:26 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.506s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.398s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 08:59:26 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Deleted allocations for instance 54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7ea16961-700c-49cb-a5cc-bd9bdf54b321 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "54f6b7cd-c5cb-4e3f-9fab-41b2f2b0fb11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.898s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "d61f84a9-85ea-40aa-b21e-45064b3bc090" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "d61f84a9-85ea-40aa-b21e-45064b3bc090" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG nova.objects.instance [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lazy-loading 'flavor' on Instance uuid d61f84a9-85ea-40aa-b21e-45064b3bc090 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "d61f84a9-85ea-40aa-b21e-45064b3bc090" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "d61f84a9-85ea-40aa-b21e-45064b3bc090" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "d61f84a9-85ea-40aa-b21e-45064b3bc090" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:26 user nova-compute[74039]: INFO nova.compute.manager [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Attaching volume 09600f2c-6f8a-4f8b-806a-511c7b63846e to /dev/vdb
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG os_brick.utils [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[210f8b1d-22cc-4623-9dde-ac652cf801d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f8ed94-e550-4aac-b2ee-07862c59d6fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6aefd6-986b-481e-a372-36b97cd34cbe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ae5fbb-4035-4006-ade5-863568de47fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:59:27 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:59:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1073d63e-b4eb-4bf7-8c8b-49b6be6e33ed]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG os_brick.utils [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Updating existing volume attachment record: bf824421-0c96-4540-b8ce-9d7648484fa2 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 08:59:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:31 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:59:31 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:59:31 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7613MB free_disk=25.537559509277344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 08:59:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:31 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 9fe77a96-fcb5-4410-85cc-58d925548e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:59:31 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c8054dbd-c0ae-45d2-af95-dae7d05f8c69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:59:31 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:59:31 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 3625b19d-4394-4feb-bbe8-55a2d86dd7fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:59:31 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 385b3191-b427-4e5e-af5b-d929fceef331 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:59:31 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance ebaa4804-32e5-4fff-9562-0587ff7ca4ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:59:31 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 03e487d1-90aa-436d-9c2f-468f9791af91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:59:31 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:59:31 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance d61f84a9-85ea-40aa-b21e-45064b3bc090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:59:31 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance a81b209e-5587-4d83-a6c9-3a2256d7aa37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 08:59:31 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 08:59:31 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 08:59:31 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:59:31 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:59:31 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 08:59:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.543s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZFEAJfq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:59:34 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:59:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:59:34 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:59:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:59:34 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 08:59:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf7564d-d69e-4c4b-b6fa-88196dcc1e2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 08:59:34 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a9de6a-d7a3-4e52-9f74-2d94fab3f433]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84] added
Oct 20 08:59:34 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a940efd7-189d-4a4e-9c3c-83b9d96a39d1]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f05104-896b-40ee-aa6b-d39526b09efb]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZFEAJfq {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZFEAJfq" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5b043b-edf4-4c30-91e8-2227392477b3]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wZFEAJfq'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c13e806-21c0-4ab6-8b03-9ea17f70d2ff]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2900c942-aabe-4081-9d85-5cffd5f3e921]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 08:59:35 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 08:59:35 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3019149f-d4ed-4cc8-a10a-2e1a0f319e1d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260]
Oct 20 08:59:35 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260] successful.
Oct 20 08:59:35 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[82090617-c2dd-409b-90cb-35c50da8677b]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0b0189-908c-43bc-9f70-c4323bc7f1b5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 08:59:35 user nova-compute[74039]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 08:59:35 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 08:59:35 user nova-compute[74039]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 08:59:35 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec4beee-f5ed-4e1c-a531-826011827607]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:59:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZFEAJfq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 08:59:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:59:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23933633139383531', 'path': '/dev/sdc'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:59:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933633139383531', 'path': '/dev/sdc'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 08:59:36 user nova-compute[74039]: DEBUG nova.objects.instance [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lazy-loading 'flavor' on Instance uuid ebaa4804-32e5-4fff-9562-0587ff7ca4ed {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:59:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 08:59:36 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:59:36 user nova-compute[74039]:   <source dev="/dev/sdc"/>
Oct 20 08:59:36 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 08:59:36 user nova-compute[74039]:   <serial>fddcdc2d-8bc1-4ba3-90c0-5607af95bc84</serial>
Oct 20 08:59:36 user nova-compute[74039]: </disk>
Oct 20 08:59:36 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 08:59:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:59:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:59:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] No VIF found with MAC fa:16:3e:0d:87:c4, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:59:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8c6e8fdc-c575-4f7b-9a56-db4db30de419 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.921s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:39 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Stashing vm_state: active {{(pid=74039) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 20 08:59:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:39 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:59:39 user nova-compute[74039]: INFO nova.compute.claims [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Claim successful on node user
Oct 20 08:59:39 user nova-compute[74039]: INFO nova.compute.resource_tracker [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Updating resource usage from migration 242a5b7f-5026-4dba-b30a-aeb328c19394
Oct 20 08:59:39 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:59:39 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:59:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.485s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:39 user nova-compute[74039]: INFO nova.compute.manager [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Migrating
Oct 20 08:59:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:59:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:59:39 user nova-compute[74039]: INFO nova.compute.rpcapi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 20 08:59:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:59:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:59:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquired lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:59:39 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:59:40 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Updating instance_info_cache with network_info: [{"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:59:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Releasing lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:59:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Starting migrate_disk_and_power_off {{(pid=74039) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 20 08:59:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:40 user nova-compute[74039]: DEBUG nova.compute.manager [req-a8ca353d-5032-4a9e-9422-bb84ec29b5ed req-637af793-d15f-4166-b6a0-d4bedcd61bc3 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received event network-vif-unplugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a8ca353d-5032-4a9e-9422-bb84ec29b5ed req-637af793-d15f-4166-b6a0-d4bedcd61bc3 service nova] Acquiring lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a8ca353d-5032-4a9e-9422-bb84ec29b5ed req-637af793-d15f-4166-b6a0-d4bedcd61bc3 service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a8ca353d-5032-4a9e-9422-bb84ec29b5ed req-637af793-d15f-4166-b6a0-d4bedcd61bc3 service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:40 user nova-compute[74039]: DEBUG nova.compute.manager [req-a8ca353d-5032-4a9e-9422-bb84ec29b5ed req-637af793-d15f-4166-b6a0-d4bedcd61bc3 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] No waiting events found dispatching network-vif-unplugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:59:40 user nova-compute[74039]: WARNING nova.compute.manager [req-a8ca353d-5032-4a9e-9422-bb84ec29b5ed req-637af793-d15f-4166-b6a0-d4bedcd61bc3 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received unexpected event network-vif-unplugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 for instance with vm_state active and task_state resize_migrating.
Oct 20 08:59:41 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Instance destroyed successfully.
Oct 20 08:59:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-981664831',display_name='tempest-ServerActionsTestOtherB-server-981664831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-981664831',id=14,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLks5fH3OqnFIJYbiqhEyJYFZHff7b4Ae9JDwAsMmBzcCMiYxaXPw5gTAg3NjSBwdB4e4WBubdaiWR0mkFHpfIFMVWW5rKzlKquVWH/exNlZL5M7mfGJM5jL4+NyXysGbg==',key_name='tempest-keypair-748521120',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:55:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='da44286b6f5b45fe9ccbd881754a9b3c',ramdisk_id='',reservation_id='r-2fnz9nzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1010421968',owner_user_name='tempest-ServerActionsTestOtherB-1010421968-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:59:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='994701e77d9740f4a7a18390f9438996',uuid=ebaa4804-32e5-4fff-9562-0587ff7ca4ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1516684708-network", "vif_mac": "fa:16:3e:0d:87:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Converting VIF {"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1516684708-network", "vif_mac": "fa:16:3e:0d:87:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_vif [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7d9d83f-15, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=687359e5-a7a0-498a-9ce3-0bf7cd72d0d6) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:41 user nova-compute[74039]: INFO os_vif [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15')
Oct 20 08:59:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZFEAJfq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:59:41 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[be713e2f-0d52-4677-b786-ba114356fb16]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 08:59:41 user nova-compute[74039]: No targets found.
Oct 20 08:59:41 user nova-compute[74039]: iSNS:
Oct 20 08:59:41 user nova-compute[74039]: No targets found.
Oct 20 08:59:41 user nova-compute[74039]: STATIC:
Oct 20 08:59:41 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84
Oct 20 08:59:41 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:59:41 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:59:41 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf
Oct 20 08:59:41 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 08:59:41 user nova-compute[74039]:                 Iface Name: default
Oct 20 08:59:41 user nova-compute[74039]: FIRMWARE:
Oct 20 08:59:41 user nova-compute[74039]: No targets found.
Oct 20 08:59:41 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 08:59:41 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 08:59:41 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d2f5f8-2b10-4681-a916-9af2c45f03a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[949bf4da-3bbd-4dc5-9aa3-13795cb80d53]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 08:59:41 user nova-compute[74039]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 08:59:41 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 08:59:41 user nova-compute[74039]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 08:59:41 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae6c4469e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84'): ({'sdc'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Removing single pathed devices sdc {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77c9b0f-85b0-4817-b3f0-8178ec2fa0e6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b81dc3-a32e-42b6-9cd2-7626aa871fe9]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Flushing IO for device /dev/sdc {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[12489171-2801-471d-90d2-d4e2b90e340b]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b847e3-9b1e-43d6-9438-f161f253b927]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3975b9a9-1a81-4aef-9e73-87eab5f9b680]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4251a65b-dd93-413b-af87-9ceb5f0ecf73]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260]
Oct 20 08:59:41 user nova-compute[74039]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260] successful.
Oct 20 08:59:41 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a87339-6843-48dd-a207-9121a1fb8adf]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] <== disconnect_volume: return (323ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:42 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 08:59:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed_resize/disk /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CMD "cp -r /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed_resize/disk /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk" returned: 0 in 0.426s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed_resize/disk.info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk.info {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CMD "cp -r /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed_resize/disk.info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk.info" returned: 0 in 0.036s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:43 user nova-compute[74039]: DEBUG nova.compute.manager [req-37db8706-f002-4b8a-ba71-75e8f36c0f99 req-98df5350-c16f-4dc1-91d6-d6105fcdfa41 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received event network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-37db8706-f002-4b8a-ba71-75e8f36c0f99 req-98df5350-c16f-4dc1-91d6-d6105fcdfa41 service nova] Acquiring lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-37db8706-f002-4b8a-ba71-75e8f36c0f99 req-98df5350-c16f-4dc1-91d6-d6105fcdfa41 service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-37db8706-f002-4b8a-ba71-75e8f36c0f99 req-98df5350-c16f-4dc1-91d6-d6105fcdfa41 service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:43 user nova-compute[74039]: DEBUG nova.compute.manager [req-37db8706-f002-4b8a-ba71-75e8f36c0f99 req-98df5350-c16f-4dc1-91d6-d6105fcdfa41 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] No waiting events found dispatching network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:59:43 user nova-compute[74039]: WARNING nova.compute.manager [req-37db8706-f002-4b8a-ba71-75e8f36c0f99 req-98df5350-c16f-4dc1-91d6-d6105fcdfa41 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received unexpected event network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 for instance with vm_state active and task_state resize_migrating.
Oct 20 08:59:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:45 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 08:59:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wiqSIPXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:59:45 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:59:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:59:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:59:45 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:59:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:59:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:59:45 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 08:59:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[55694a4f-b69d-45af-9155-02033c481bb5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 08:59:45 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ab2773-1360-4b57-bed1-529d4ada3fe4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e] added
Oct 20 08:59:45 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd75c76-3def-4aea-a8a2-d28036ce944a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bdb91b-0844-419d-b3ac-5188eaccc9be]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wiqSIPXC {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wiqSIPXC" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d0b2d9-cc74-41d0-b805-e9d418f59a75]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wiqSIPXC'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4621144c-de18-4ee1-963a-82ca0d58e986]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[681b95aa-6a0e-49a9-9510-d5a37688e8ad]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 08:59:46 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 08:59:46 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:46 user nova-compute[74039]: INFO nova.compute.manager [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Terminating instance
Oct 20 08:59:46 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d476699a-11c6-432a-9bfc-ab63da292740]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e, portal: 172.16.0.220,3260]
Oct 20 08:59:46 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e, portal: 172.16.0.220,3260] successful.
Oct 20 08:59:46 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d49cadb-0dcf-4c3e-b4f5-0b35ec75ce27]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f88583-a41e-4f09-ad7f-7a671a4c042f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 08:59:46 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 08:59:46 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 08:59:46 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 08:59:46 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b68dd7-099d-4b0e-b351-68863de82fab]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wiqSIPXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-029aafb2-b1cf-4a88-a2ce-13724d673f71 req-d0a8ecdb-b2d7-4aae-bd8e-25de83b77885 service nova] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Received event network-vif-unplugged-5ff15603-38ca-41c6-bae5-e72e704c188d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-029aafb2-b1cf-4a88-a2ce-13724d673f71 req-d0a8ecdb-b2d7-4aae-bd8e-25de83b77885 service nova] Acquiring lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-029aafb2-b1cf-4a88-a2ce-13724d673f71 req-d0a8ecdb-b2d7-4aae-bd8e-25de83b77885 service nova] Lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-029aafb2-b1cf-4a88-a2ce-13724d673f71 req-d0a8ecdb-b2d7-4aae-bd8e-25de83b77885 service nova] Lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-029aafb2-b1cf-4a88-a2ce-13724d673f71 req-d0a8ecdb-b2d7-4aae-bd8e-25de83b77885 service nova] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] No waiting events found dispatching network-vif-unplugged-5ff15603-38ca-41c6-bae5-e72e704c188d {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-029aafb2-b1cf-4a88-a2ce-13724d673f71 req-d0a8ecdb-b2d7-4aae-bd8e-25de83b77885 service nova] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Received event network-vif-unplugged-5ff15603-38ca-41c6-bae5-e72e704c188d for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:46 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Instance destroyed successfully.
Oct 20 08:59:46 user nova-compute[74039]: DEBUG nova.objects.instance [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lazy-loading 'resources' on Instance uuid a81b209e-5587-4d83-a6c9-3a2256d7aa37 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:57:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-255947103',display_name='tempest-VolumesAdminNegativeTest-server-255947103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-255947103',id=19,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:57:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61eb463233344f65b2657a952c24d331',ramdisk_id='',reservation_id='r-kns0an0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-772182177',owner_user_name='tempest-VolumesAdminNegativeTest-772182177-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:57:42Z,user_data=None,user_id='d3e2da79669b41bea6e6a166c7c4a513',uuid=a81b209e-5587-4d83-a6c9-3a2256d7aa37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ff15603-38ca-41c6-bae5-e72e704c188d", "address": "fa:16:3e:02:6b:7f", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff15603-38", "ovs_interfaceid": "5ff15603-38ca-41c6-bae5-e72e704c188d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Converting VIF {"id": "5ff15603-38ca-41c6-bae5-e72e704c188d", "address": "fa:16:3e:02:6b:7f", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ff15603-38", "ovs_interfaceid": "5ff15603-38ca-41c6-bae5-e72e704c188d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:6b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5ff15603-38ca-41c6-bae5-e72e704c188d,network=Network(5d45b218-0125-40ea-9e08-64f416fc77ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff15603-38') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG os_vif [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:6b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5ff15603-38ca-41c6-bae5-e72e704c188d,network=Network(5d45b218-0125-40ea-9e08-64f416fc77ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff15603-38') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ff15603-38, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=adffe3a4-3992-4574-96af-0d61b374c04d) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:46 user nova-compute[74039]: INFO os_vif [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:6b:7f,bridge_name='br-int',has_traffic_filtering=True,id=5ff15603-38ca-41c6-bae5-e72e704c188d,network=Network(5d45b218-0125-40ea-9e08-64f416fc77ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ff15603-38')
Oct 20 08:59:46 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Deleting instance files /opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37_del
Oct 20 08:59:46 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Deletion of /opt/stack/data/nova/instances/a81b209e-5587-4d83-a6c9-3a2256d7aa37_del complete
Oct 20 08:59:47 user nova-compute[74039]: INFO nova.compute.manager [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 20 08:59:47 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 08:59:47 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 08:59:47 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 08:59:47 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:59:47 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26365396336363162', 'path': '/dev/sdc'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:59:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365396336363162', 'path': '/dev/sdc'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 08:59:47 user nova-compute[74039]: DEBUG nova.objects.instance [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lazy-loading 'flavor' on Instance uuid d61f84a9-85ea-40aa-b21e-45064b3bc090 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:59:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 08:59:47 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:59:47 user nova-compute[74039]:   <source dev="/dev/sdc"/>
Oct 20 08:59:47 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 08:59:47 user nova-compute[74039]:   <serial>09600f2c-6f8a-4f8b-806a-511c7b63846e</serial>
Oct 20 08:59:47 user nova-compute[74039]: </disk>
Oct 20 08:59:47 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 08:59:47 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:59:47 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Took 0.42 seconds to deallocate network for instance.
Oct 20 08:59:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:59:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:59:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] No VIF found with MAC fa:16:3e:f4:2a:6c, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:59:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7da86e89-9f76-4b55-8220-ce7934b9403f tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "d61f84a9-85ea-40aa-b21e-45064b3bc090" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.089s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:47 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:59:47 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:59:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:48 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Deleted allocations for instance a81b209e-5587-4d83-a6c9-3a2256d7aa37
Oct 20 08:59:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9e786c64-2d5a-4857-95dc-5ba97a218765 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.947s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:48 user nova-compute[74039]: DEBUG nova.compute.manager [req-1e258679-1295-4320-aff9-c1ab88260da8 req-09fab6dc-4d20-410b-84b8-03535e23aad7 service nova] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Received event network-vif-plugged-5ff15603-38ca-41c6-bae5-e72e704c188d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1e258679-1295-4320-aff9-c1ab88260da8 req-09fab6dc-4d20-410b-84b8-03535e23aad7 service nova] Acquiring lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1e258679-1295-4320-aff9-c1ab88260da8 req-09fab6dc-4d20-410b-84b8-03535e23aad7 service nova] Lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1e258679-1295-4320-aff9-c1ab88260da8 req-09fab6dc-4d20-410b-84b8-03535e23aad7 service nova] Lock "a81b209e-5587-4d83-a6c9-3a2256d7aa37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:48 user nova-compute[74039]: DEBUG nova.compute.manager [req-1e258679-1295-4320-aff9-c1ab88260da8 req-09fab6dc-4d20-410b-84b8-03535e23aad7 service nova] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] No waiting events found dispatching network-vif-plugged-5ff15603-38ca-41c6-bae5-e72e704c188d {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:59:48 user nova-compute[74039]: WARNING nova.compute.manager [req-1e258679-1295-4320-aff9-c1ab88260da8 req-09fab6dc-4d20-410b-84b8-03535e23aad7 service nova] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Received unexpected event network-vif-plugged-5ff15603-38ca-41c6-bae5-e72e704c188d for instance with vm_state deleted and task_state None.
Oct 20 08:59:48 user nova-compute[74039]: DEBUG nova.compute.manager [req-1e258679-1295-4320-aff9-c1ab88260da8 req-09fab6dc-4d20-410b-84b8-03535e23aad7 service nova] [instance: a81b209e-5587-4d83-a6c9-3a2256d7aa37] Received event network-vif-deleted-5ff15603-38ca-41c6-bae5-e72e704c188d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "90473cd0-7bf8-478e-af9d-771f720a10f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "90473cd0-7bf8-478e-af9d-771f720a10f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:50 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 08:59:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 08:59:51 user nova-compute[74039]: INFO nova.compute.claims [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Claim successful on node user
Oct 20 08:59:51 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:59:51 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:59:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:51 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 08:59:51 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 08:59:51 user nova-compute[74039]: DEBUG nova.network.neutron [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 08:59:51 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 08:59:51 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 08:59:51 user nova-compute[74039]: DEBUG nova.policy [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6faf5f2e03204805a06ac9f83b9a61bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143bda69e4714560b4b2286adaefb4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 08:59:51 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 08:59:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 08:59:51 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Creating image(s)
Oct 20 08:59:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "/opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "/opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "/opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.179s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7/disk 1073741824" returned: 0 in 0.047s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG nova.network.neutron [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Successfully created port: cb325581-30da-432f-846d-402483dd60d4 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Cannot resize image /opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Ensure instance console log exists: /opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG nova.network.neutron [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Successfully updated port: cb325581-30da-432f-846d-402483dd60d4 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "refresh_cache-90473cd0-7bf8-478e-af9d-771f720a10f7" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquired lock "refresh_cache-90473cd0-7bf8-478e-af9d-771f720a10f7" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG nova.network.neutron [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG nova.compute.manager [req-55a976d1-a8ad-4867-a5e1-34fc1f7b99fe req-1c8b46b1-aa8c-4922-aea8-67bc524ae173 service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Received event network-changed-cb325581-30da-432f-846d-402483dd60d4 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG nova.compute.manager [req-55a976d1-a8ad-4867-a5e1-34fc1f7b99fe req-1c8b46b1-aa8c-4922-aea8-67bc524ae173 service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Refreshing instance network info cache due to event network-changed-cb325581-30da-432f-846d-402483dd60d4. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-55a976d1-a8ad-4867-a5e1-34fc1f7b99fe req-1c8b46b1-aa8c-4922-aea8-67bc524ae173 service nova] Acquiring lock "refresh_cache-90473cd0-7bf8-478e-af9d-771f720a10f7" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:59:52 user nova-compute[74039]: DEBUG nova.network.neutron [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.network.neutron [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Updating instance_info_cache with network_info: [{"id": "cb325581-30da-432f-846d-402483dd60d4", "address": "fa:16:3e:93:21:b6", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb325581-30", "ovs_interfaceid": "cb325581-30da-432f-846d-402483dd60d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Releasing lock "refresh_cache-90473cd0-7bf8-478e-af9d-771f720a10f7" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Instance network_info: |[{"id": "cb325581-30da-432f-846d-402483dd60d4", "address": "fa:16:3e:93:21:b6", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb325581-30", "ovs_interfaceid": "cb325581-30da-432f-846d-402483dd60d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-55a976d1-a8ad-4867-a5e1-34fc1f7b99fe req-1c8b46b1-aa8c-4922-aea8-67bc524ae173 service nova] Acquired lock "refresh_cache-90473cd0-7bf8-478e-af9d-771f720a10f7" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.network.neutron [req-55a976d1-a8ad-4867-a5e1-34fc1f7b99fe req-1c8b46b1-aa8c-4922-aea8-67bc524ae173 service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Refreshing network info cache for port cb325581-30da-432f-846d-402483dd60d4 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Start _get_guest_xml network_info=[{"id": "cb325581-30da-432f-846d-402483dd60d4", "address": "fa:16:3e:93:21:b6", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb325581-30", "ovs_interfaceid": "cb325581-30da-432f-846d-402483dd60d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:53 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:59:53 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1455808292',display_name='tempest-AttachVolumeNegativeTest-server-1455808292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1455808292',id=20,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHj1hP4WUmv6gcDueLRC1bVN/mlw9z1nuiqsEU9J334LpYFcIjJME3lyT3cRHRvUYNFi3+t4W6zPyI+P+RF1U2QFXgYhk3rzcF7I5LWTghQruo5NiaNR7skSgGsKZY82w==',key_name='tempest-keypair-810081210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='143bda69e4714560b4b2286adaefb4c5',ramdisk_id='',reservation_id='r-10ansmb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-639731200',owner_user_name='tempest-AttachVolumeNegativeTest-639731200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6faf5f2e03204805a06ac9f83b9a61bb',uuid=90473cd0-7bf8-478e-af9d-771f720a10f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb325581-30da-432f-846d-402483dd60d4", "address": "fa:16:3e:93:21:b6", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb325581-30", "ovs_interfaceid": "cb325581-30da-432f-846d-402483dd60d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converting VIF {"id": "cb325581-30da-432f-846d-402483dd60d4", "address": "fa:16:3e:93:21:b6", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb325581-30", "ovs_interfaceid": "cb325581-30da-432f-846d-402483dd60d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:21:b6,bridge_name='br-int',has_traffic_filtering=True,id=cb325581-30da-432f-846d-402483dd60d4,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb325581-30') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.objects.instance [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lazy-loading 'pci_devices' on Instance uuid 90473cd0-7bf8-478e-af9d-771f720a10f7 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] End _get_guest_xml xml=<domain type="kvm">
Oct 20 08:59:53 user nova-compute[74039]:   <uuid>90473cd0-7bf8-478e-af9d-771f720a10f7</uuid>
Oct 20 08:59:53 user nova-compute[74039]:   <name>instance-00000014</name>
Oct 20 08:59:53 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 08:59:53 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 08:59:53 user nova-compute[74039]:   <metadata>
Oct 20 08:59:53 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 08:59:53 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 08:59:53 user nova-compute[74039]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1455808292</nova:name>
Oct 20 08:59:53 user nova-compute[74039]:       <nova:creationTime>2023-10-20 08:59:53</nova:creationTime>
Oct 20 08:59:53 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 08:59:53 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 08:59:53 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 08:59:53 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 08:59:53 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 08:59:53 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 08:59:53 user nova-compute[74039]:       </nova:flavor>
Oct 20 08:59:53 user nova-compute[74039]:       <nova:owner>
Oct 20 08:59:53 user nova-compute[74039]:         <nova:user uuid="6faf5f2e03204805a06ac9f83b9a61bb">tempest-AttachVolumeNegativeTest-639731200-project-member</nova:user>
Oct 20 08:59:53 user nova-compute[74039]:         <nova:project uuid="143bda69e4714560b4b2286adaefb4c5">tempest-AttachVolumeNegativeTest-639731200</nova:project>
Oct 20 08:59:53 user nova-compute[74039]:       </nova:owner>
Oct 20 08:59:53 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 08:59:53 user nova-compute[74039]:       <nova:ports>
Oct 20 08:59:53 user nova-compute[74039]:         <nova:port uuid="cb325581-30da-432f-846d-402483dd60d4">
Oct 20 08:59:53 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 08:59:53 user nova-compute[74039]:         </nova:port>
Oct 20 08:59:53 user nova-compute[74039]:       </nova:ports>
Oct 20 08:59:53 user nova-compute[74039]:     </nova:instance>
Oct 20 08:59:53 user nova-compute[74039]:   </metadata>
Oct 20 08:59:53 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 08:59:53 user nova-compute[74039]:     <system>
Oct 20 08:59:53 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 08:59:53 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 08:59:53 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 08:59:53 user nova-compute[74039]:       <entry name="serial">90473cd0-7bf8-478e-af9d-771f720a10f7</entry>
Oct 20 08:59:53 user nova-compute[74039]:       <entry name="uuid">90473cd0-7bf8-478e-af9d-771f720a10f7</entry>
Oct 20 08:59:53 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 08:59:53 user nova-compute[74039]:     </system>
Oct 20 08:59:53 user nova-compute[74039]:   </sysinfo>
Oct 20 08:59:53 user nova-compute[74039]:   <os>
Oct 20 08:59:53 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 08:59:53 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 08:59:53 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 08:59:53 user nova-compute[74039]:   </os>
Oct 20 08:59:53 user nova-compute[74039]:   <features>
Oct 20 08:59:53 user nova-compute[74039]:     <acpi/>
Oct 20 08:59:53 user nova-compute[74039]:     <apic/>
Oct 20 08:59:53 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 08:59:53 user nova-compute[74039]:   </features>
Oct 20 08:59:53 user nova-compute[74039]:   <clock offset="utc">
Oct 20 08:59:53 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 08:59:53 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 08:59:53 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 08:59:53 user nova-compute[74039]:   </clock>
Oct 20 08:59:53 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 08:59:53 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 08:59:53 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 08:59:53 user nova-compute[74039]:   </cpu>
Oct 20 08:59:53 user nova-compute[74039]:   <devices>
Oct 20 08:59:53 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 08:59:53 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 08:59:53 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7/disk"/>
Oct 20 08:59:53 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 08:59:53 user nova-compute[74039]:     </disk>
Oct 20 08:59:53 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 08:59:53 user nova-compute[74039]:       <mac address="fa:16:3e:93:21:b6"/>
Oct 20 08:59:53 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:59:53 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 08:59:53 user nova-compute[74039]:       <target dev="tapcb325581-30"/>
Oct 20 08:59:53 user nova-compute[74039]:     </interface>
Oct 20 08:59:53 user nova-compute[74039]:     <serial type="pty">
Oct 20 08:59:53 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7/console.log" append="off"/>
Oct 20 08:59:53 user nova-compute[74039]:     </serial>
Oct 20 08:59:53 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 08:59:53 user nova-compute[74039]:     <video>
Oct 20 08:59:53 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 08:59:53 user nova-compute[74039]:     </video>
Oct 20 08:59:53 user nova-compute[74039]:     <rng model="virtio">
Oct 20 08:59:53 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 08:59:53 user nova-compute[74039]:     </rng>
Oct 20 08:59:53 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 08:59:53 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 08:59:53 user nova-compute[74039]:       <stats period="10"/>
Oct 20 08:59:53 user nova-compute[74039]:     </memballoon>
Oct 20 08:59:53 user nova-compute[74039]:   </devices>
Oct 20 08:59:53 user nova-compute[74039]: </domain>
Oct 20 08:59:53 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1455808292',display_name='tempest-AttachVolumeNegativeTest-server-1455808292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1455808292',id=20,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHj1hP4WUmv6gcDueLRC1bVN/mlw9z1nuiqsEU9J334LpYFcIjJME3lyT3cRHRvUYNFi3+t4W6zPyI+P+RF1U2QFXgYhk3rzcF7I5LWTghQruo5NiaNR7skSgGsKZY82w==',key_name='tempest-keypair-810081210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='143bda69e4714560b4b2286adaefb4c5',ramdisk_id='',reservation_id='r-10ansmb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-639731200',owner_user_name='tempest-AttachVolumeNegativeTest-639731200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6faf5f2e03204805a06ac9f83b9a61bb',uuid=90473cd0-7bf8-478e-af9d-771f720a10f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb325581-30da-432f-846d-402483dd60d4", "address": "fa:16:3e:93:21:b6", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb325581-30", "ovs_interfaceid": "cb325581-30da-432f-846d-402483dd60d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converting VIF {"id": "cb325581-30da-432f-846d-402483dd60d4", "address": "fa:16:3e:93:21:b6", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb325581-30", "ovs_interfaceid": "cb325581-30da-432f-846d-402483dd60d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:21:b6,bridge_name='br-int',has_traffic_filtering=True,id=cb325581-30da-432f-846d-402483dd60d4,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb325581-30') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG os_vif [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:21:b6,bridge_name='br-int',has_traffic_filtering=True,id=cb325581-30da-432f-846d-402483dd60d4,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb325581-30') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1de3f98-8c73-53c2-983d-91cc752d5ad4', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb325581-30, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb325581-30, col_values=(('qos', UUID('d2391b0d-801a-46e7-9dbf-14b9947a512b')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb325581-30, col_values=(('external_ids', {'iface-id': 'cb325581-30da-432f-846d-402483dd60d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:21:b6', 'vm-uuid': '90473cd0-7bf8-478e-af9d-771f720a10f7'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:53 user nova-compute[74039]: INFO os_vif [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:21:b6,bridge_name='br-int',has_traffic_filtering=True,id=cb325581-30da-432f-846d-402483dd60d4,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb325581-30')
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] No VIF found with MAC fa:16:3e:93:21:b6, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "385b3191-b427-4e5e-af5b-d929fceef331" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "385b3191-b427-4e5e-af5b-d929fceef331" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "385b3191-b427-4e5e-af5b-d929fceef331-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "385b3191-b427-4e5e-af5b-d929fceef331-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "385b3191-b427-4e5e-af5b-d929fceef331-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:53 user nova-compute[74039]: INFO nova.compute.manager [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Terminating instance
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.compute.manager [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.network.neutron [req-55a976d1-a8ad-4867-a5e1-34fc1f7b99fe req-1c8b46b1-aa8c-4922-aea8-67bc524ae173 service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Updated VIF entry in instance network info cache for port cb325581-30da-432f-846d-402483dd60d4. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.network.neutron [req-55a976d1-a8ad-4867-a5e1-34fc1f7b99fe req-1c8b46b1-aa8c-4922-aea8-67bc524ae173 service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Updating instance_info_cache with network_info: [{"id": "cb325581-30da-432f-846d-402483dd60d4", "address": "fa:16:3e:93:21:b6", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb325581-30", "ovs_interfaceid": "cb325581-30da-432f-846d-402483dd60d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-55a976d1-a8ad-4867-a5e1-34fc1f7b99fe req-1c8b46b1-aa8c-4922-aea8-67bc524ae173 service nova] Releasing lock "refresh_cache-90473cd0-7bf8-478e-af9d-771f720a10f7" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-310582e1-10c7-49f5-8d53-41d97f881478 req-0266cd54-d25f-43f1-8112-f262d354ad3e service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Received event network-vif-unplugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-310582e1-10c7-49f5-8d53-41d97f881478 req-0266cd54-d25f-43f1-8112-f262d354ad3e service nova] Acquiring lock "385b3191-b427-4e5e-af5b-d929fceef331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-310582e1-10c7-49f5-8d53-41d97f881478 req-0266cd54-d25f-43f1-8112-f262d354ad3e service nova] Lock "385b3191-b427-4e5e-af5b-d929fceef331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-310582e1-10c7-49f5-8d53-41d97f881478 req-0266cd54-d25f-43f1-8112-f262d354ad3e service nova] Lock "385b3191-b427-4e5e-af5b-d929fceef331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-310582e1-10c7-49f5-8d53-41d97f881478 req-0266cd54-d25f-43f1-8112-f262d354ad3e service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] No waiting events found dispatching network-vif-unplugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:59:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-310582e1-10c7-49f5-8d53-41d97f881478 req-0266cd54-d25f-43f1-8112-f262d354ad3e service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Received event network-vif-unplugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:54 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Instance destroyed successfully.
Oct 20 08:59:54 user nova-compute[74039]: DEBUG nova.objects.instance [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lazy-loading 'resources' on Instance uuid 385b3191-b427-4e5e-af5b-d929fceef331 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:54:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-504878641',display_name='tempest-AttachVolumeTestJSON-server-504878641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-504878641',id=13,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLS3l701zIWi6t7ikkUcypzWlohXMgEFdpYdszeQ2nU4VwrrWO8ypzkHJVXJYcI9nq1J6R8qzBqHONtT5AefhEkpXdP5ub4OpujENRBAQBMdVyBMgQiKU91gOtT0KJ5ZzA==',key_name='tempest-keypair-659986505',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39bff5237c144002a806235775eda215',ramdisk_id='',reservation_id='r-psy0n3r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1630150217',owner_user_name='tempest-AttachVolumeTestJSON-1630150217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:54:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='907a4bffd1d34559b3dd1ede3be227ee',uuid=385b3191-b427-4e5e-af5b-d929fceef331,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "address": "fa:16:3e:9e:9f:f3", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29dcf3b3-10", "ovs_interfaceid": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Converting VIF {"id": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "address": "fa:16:3e:9e:9f:f3", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29dcf3b3-10", "ovs_interfaceid": "29dcf3b3-1006-42c8-9cb1-5ed5cb792b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:9f:f3,bridge_name='br-int',has_traffic_filtering=True,id=29dcf3b3-1006-42c8-9cb1-5ed5cb792b06,network=Network(07b19de8-22c5-4d12-86ed-3e443540c21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29dcf3b3-10') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG os_vif [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:9f:f3,bridge_name='br-int',has_traffic_filtering=True,id=29dcf3b3-1006-42c8-9cb1-5ed5cb792b06,network=Network(07b19de8-22c5-4d12-86ed-3e443540c21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29dcf3b3-10') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29dcf3b3-10, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c88abb1f-f5b3-4223-a828-0c95ec6fdd37) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:54 user nova-compute[74039]: INFO os_vif [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:9f:f3,bridge_name='br-int',has_traffic_filtering=True,id=29dcf3b3-1006-42c8-9cb1-5ed5cb792b06,network=Network(07b19de8-22c5-4d12-86ed-3e443540c21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29dcf3b3-10')
Oct 20 08:59:54 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Deleting instance files /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331_del
Oct 20 08:59:54 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Deletion of /opt/stack/data/nova/instances/385b3191-b427-4e5e-af5b-d929fceef331_del complete
Oct 20 08:59:54 user nova-compute[74039]: INFO nova.compute.manager [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Took 1.06 seconds to destroy the instance on the hypervisor.
Oct 20 08:59:54 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-896384ed-058c-4f2f-8204-7d7130c07490 req-68418586-3f9c-4940-910b-5cc2fc164e12 service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Received event network-vif-plugged-cb325581-30da-432f-846d-402483dd60d4 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-896384ed-058c-4f2f-8204-7d7130c07490 req-68418586-3f9c-4940-910b-5cc2fc164e12 service nova] Acquiring lock "90473cd0-7bf8-478e-af9d-771f720a10f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-896384ed-058c-4f2f-8204-7d7130c07490 req-68418586-3f9c-4940-910b-5cc2fc164e12 service nova] Lock "90473cd0-7bf8-478e-af9d-771f720a10f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-896384ed-058c-4f2f-8204-7d7130c07490 req-68418586-3f9c-4940-910b-5cc2fc164e12 service nova] Lock "90473cd0-7bf8-478e-af9d-771f720a10f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-896384ed-058c-4f2f-8204-7d7130c07490 req-68418586-3f9c-4940-910b-5cc2fc164e12 service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] No waiting events found dispatching network-vif-plugged-cb325581-30da-432f-846d-402483dd60d4 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:59:55 user nova-compute[74039]: WARNING nova.compute.manager [req-896384ed-058c-4f2f-8204-7d7130c07490 req-68418586-3f9c-4940-910b-5cc2fc164e12 service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Received unexpected event network-vif-plugged-cb325581-30da-432f-846d-402483dd60d4 for instance with vm_state building and task_state spawning.
Oct 20 08:59:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-d10c5f6e-2656-4857-b4f2-e3a4b828b40d req-f56818a9-896e-42df-94b7-d84cf5ccfab1 service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Received event network-vif-deleted-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:55 user nova-compute[74039]: INFO nova.compute.manager [req-d10c5f6e-2656-4857-b4f2-e3a4b828b40d req-f56818a9-896e-42df-94b7-d84cf5ccfab1 service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Neutron deleted interface 29dcf3b3-1006-42c8-9cb1-5ed5cb792b06; detaching it from the instance and deleting it from the info cache
Oct 20 08:59:55 user nova-compute[74039]: DEBUG nova.network.neutron [req-d10c5f6e-2656-4857-b4f2-e3a4b828b40d req-f56818a9-896e-42df-94b7-d84cf5ccfab1 service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:59:55 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Took 0.84 seconds to deallocate network for instance.
Oct 20 08:59:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-d10c5f6e-2656-4857-b4f2-e3a4b828b40d req-f56818a9-896e-42df-94b7-d84cf5ccfab1 service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Detach interface failed, port_id=29dcf3b3-1006-42c8-9cb1-5ed5cb792b06, reason: Instance 385b3191-b427-4e5e-af5b-d929fceef331 could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Received event network-vif-plugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] Acquiring lock "385b3191-b427-4e5e-af5b-d929fceef331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] Lock "385b3191-b427-4e5e-af5b-d929fceef331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] Lock "385b3191-b427-4e5e-af5b-d929fceef331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] No waiting events found dispatching network-vif-plugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:59:55 user nova-compute[74039]: WARNING nova.compute.manager [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Received unexpected event network-vif-plugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 for instance with vm_state deleted and task_state None.
Oct 20 08:59:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Received event network-vif-plugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] Acquiring lock "385b3191-b427-4e5e-af5b-d929fceef331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] Lock "385b3191-b427-4e5e-af5b-d929fceef331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] Lock "385b3191-b427-4e5e-af5b-d929fceef331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] No waiting events found dispatching network-vif-plugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:59:55 user nova-compute[74039]: WARNING nova.compute.manager [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Received unexpected event network-vif-plugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 for instance with vm_state deleted and task_state None.
Oct 20 08:59:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Received event network-vif-plugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] Acquiring lock "385b3191-b427-4e5e-af5b-d929fceef331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] Lock "385b3191-b427-4e5e-af5b-d929fceef331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] Lock "385b3191-b427-4e5e-af5b-d929fceef331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] No waiting events found dispatching network-vif-plugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:59:55 user nova-compute[74039]: WARNING nova.compute.manager [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Received unexpected event network-vif-plugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 for instance with vm_state deleted and task_state None.
Oct 20 08:59:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Received event network-vif-unplugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] Acquiring lock "385b3191-b427-4e5e-af5b-d929fceef331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] Lock "385b3191-b427-4e5e-af5b-d929fceef331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] Lock "385b3191-b427-4e5e-af5b-d929fceef331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] No waiting events found dispatching network-vif-unplugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:59:55 user nova-compute[74039]: WARNING nova.compute.manager [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Received unexpected event network-vif-unplugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 for instance with vm_state deleted and task_state None.
Oct 20 08:59:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Received event network-vif-plugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] Acquiring lock "385b3191-b427-4e5e-af5b-d929fceef331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] Lock "385b3191-b427-4e5e-af5b-d929fceef331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] Lock "385b3191-b427-4e5e-af5b-d929fceef331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] No waiting events found dispatching network-vif-plugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:59:55 user nova-compute[74039]: WARNING nova.compute.manager [req-bedcda4c-2cf4-46d1-89a9-96d105a3a2e8 req-298e7183-1f9c-49e9-9068-26842ab6f4fe service nova] [instance: 385b3191-b427-4e5e-af5b-d929fceef331] Received unexpected event network-vif-plugged-29dcf3b3-1006-42c8-9cb1-5ed5cb792b06 for instance with vm_state deleted and task_state None.
Oct 20 08:59:55 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Deleted allocations for instance 385b3191-b427-4e5e-af5b-d929fceef331
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fc47a4eb-31bb-45db-99ab-8500c56a3ace tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "385b3191-b427-4e5e-af5b-d929fceef331" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.489s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBhpJRXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:59:56 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:59:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:59:56 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 08:59:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 08:59:56 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e53201-6928-4142-a97a-850050f4c37e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 08:59:56 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dbc5a9-2235-4888-8a61-70285e8741b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf] added
Oct 20 08:59:56 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05ea002-802f-40c2-9623-5c024aea82d7]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc906031-f63f-4883-85f3-bc95a99798a2]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YBhpJRXv {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YBhpJRXv" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f613bbb8-4495-4602-acb5-fa1e00f25a28]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YBhpJRXv'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdd4d09-7a14-494d-b21f-45994fa3a680]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b541f4fd-e665-430c-a8ba-add1e86f0dd5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 08:59:56 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 08:59:56 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 08:59:56 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 08:59:56 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:59:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[46241110-6426-4d5e-84dd-ef5916fbd637]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf, portal: 172.16.0.220,3260]
Oct 20 08:59:57 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf, portal: 172.16.0.220,3260] successful.
Oct 20 08:59:57 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2295bd83-1a77-4883-9fab-d25253167ac0]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a42779-490d-4fbc-b273-8c57c7a9d79f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 08:59:57 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 08:59:57 user nova-compute[74039]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)
Oct 20 08:59:57 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 08:59:57 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 08:59:57 user nova-compute[74039]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)
Oct 20 08:59:57 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d005f433-0bed-4cc7-91d9-a011278edba6]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBhpJRXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 08:59:57 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Instance spawned successfully.
Oct 20 08:59:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Port e7d9d83f-1522-47f7-ac4c-7dd56facfea7 binding to destination host user is already ACTIVE {{(pid=74039) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 08:59:57 user nova-compute[74039]: INFO nova.compute.manager [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Took 5.69 seconds to spawn the instance on the hypervisor.
Oct 20 08:59:57 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:57 user nova-compute[74039]: INFO nova.compute.manager [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Took 6.45 seconds to build instance.
Oct 20 08:59:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4c2679b1-d2fb-41b9-8a55-27f38f4f7843 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "90473cd0-7bf8-478e-af9d-771f720a10f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.552s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG nova.compute.manager [req-48e33335-63f4-4e1e-a5e1-edd6a9193da0 req-4cca0016-cd40-4014-ab6b-177b000617eb service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Received event network-vif-plugged-cb325581-30da-432f-846d-402483dd60d4 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-48e33335-63f4-4e1e-a5e1-edd6a9193da0 req-4cca0016-cd40-4014-ab6b-177b000617eb service nova] Acquiring lock "90473cd0-7bf8-478e-af9d-771f720a10f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-48e33335-63f4-4e1e-a5e1-edd6a9193da0 req-4cca0016-cd40-4014-ab6b-177b000617eb service nova] Lock "90473cd0-7bf8-478e-af9d-771f720a10f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-48e33335-63f4-4e1e-a5e1-edd6a9193da0 req-4cca0016-cd40-4014-ab6b-177b000617eb service nova] Lock "90473cd0-7bf8-478e-af9d-771f720a10f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG nova.compute.manager [req-48e33335-63f4-4e1e-a5e1-edd6a9193da0 req-4cca0016-cd40-4014-ab6b-177b000617eb service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] No waiting events found dispatching network-vif-plugged-cb325581-30da-432f-846d-402483dd60d4 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 08:59:57 user nova-compute[74039]: WARNING nova.compute.manager [req-48e33335-63f4-4e1e-a5e1-edd6a9193da0 req-4cca0016-cd40-4014-ab6b-177b000617eb service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Received unexpected event network-vif-plugged-cb325581-30da-432f-846d-402483dd60d4 for instance with vm_state active and task_state None.
Oct 20 08:59:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquired lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 08:59:57 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Updating instance_info_cache with network_info: [{"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Releasing lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23761346461623266', 'path': '/dev/sdd'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761346461623266', 'path': '/dev/sdd'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG nova.objects.instance [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lazy-loading 'flavor' on Instance uuid 03e487d1-90aa-436d-9c2f-468f9791af91 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 08:59:58 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 08:59:58 user nova-compute[74039]:   <source dev="/dev/sdd"/>
Oct 20 08:59:58 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 08:59:58 user nova-compute[74039]:   <serial>9142d9e6-9d0b-4920-aa08-e05ace57cbbf</serial>
Oct 20 08:59:58 user nova-compute[74039]: </disk>
Oct 20 08:59:58 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG os_brick.utils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f48fc5-d34d-4952-a688-ad55954f6616]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[471855a4-b8bb-40a6-ad02-90182d9b7034]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[317470eb-5b77-492e-971d-88f0299a76e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9ad94b-9f36-4caa-8df7-8f76f3d9cdd7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 08:59:58 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 08:59:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[22da04d7-6b92-4908-bb34-b7e47781011a]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG os_brick.utils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] No VIF found with MAC fa:16:3e:41:36:6d, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 08:59:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-71e7b49d-4fbd-4671-948e-e86c89232659 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "03e487d1-90aa-436d-9c2f-468f9791af91" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 73.113s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 08:59:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:17 user nova-compute[74039]: DEBUG nova.compute.manager [req-6a78dc55-c11f-4dd6-a749-aa8f6ed5a2fb req-1d302b91-066e-4d49-bccf-e1b938a56619 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received event network-changed-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:00:17 user nova-compute[74039]: DEBUG nova.compute.manager [req-6a78dc55-c11f-4dd6-a749-aa8f6ed5a2fb req-1d302b91-066e-4d49-bccf-e1b938a56619 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Refreshing instance network info cache due to event network-changed-7f2d5682-0113-40f4-8bbb-02e87564b7ef. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:00:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6a78dc55-c11f-4dd6-a749-aa8f6ed5a2fb req-1d302b91-066e-4d49-bccf-e1b938a56619 service nova] Acquiring lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:00:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6a78dc55-c11f-4dd6-a749-aa8f6ed5a2fb req-1d302b91-066e-4d49-bccf-e1b938a56619 service nova] Acquired lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:00:17 user nova-compute[74039]: DEBUG nova.network.neutron [req-6a78dc55-c11f-4dd6-a749-aa8f6ed5a2fb req-1d302b91-066e-4d49-bccf-e1b938a56619 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Refreshing network info cache for port 7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:00:18 user nova-compute[74039]: DEBUG nova.network.neutron [req-6a78dc55-c11f-4dd6-a749-aa8f6ed5a2fb req-1d302b91-066e-4d49-bccf-e1b938a56619 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Updated VIF entry in instance network info cache for port 7f2d5682-0113-40f4-8bbb-02e87564b7ef. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:00:18 user nova-compute[74039]: DEBUG nova.network.neutron [req-6a78dc55-c11f-4dd6-a749-aa8f6ed5a2fb req-1d302b91-066e-4d49-bccf-e1b938a56619 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Updating instance_info_cache with network_info: [{"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:00:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6a78dc55-c11f-4dd6-a749-aa8f6ed5a2fb req-1d302b91-066e-4d49-bccf-e1b938a56619 service nova] Releasing lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:00:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-239a238c-3df3-4644-89a0-e2a5dbe4b108 req-6b2f0f5a-8f6b-41ce-8d83-7147ecdc0fc9 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received event network-changed-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:00:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-239a238c-3df3-4644-89a0-e2a5dbe4b108 req-6b2f0f5a-8f6b-41ce-8d83-7147ecdc0fc9 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Refreshing instance network info cache due to event network-changed-7f2d5682-0113-40f4-8bbb-02e87564b7ef. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:00:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-239a238c-3df3-4644-89a0-e2a5dbe4b108 req-6b2f0f5a-8f6b-41ce-8d83-7147ecdc0fc9 service nova] Acquiring lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:00:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-239a238c-3df3-4644-89a0-e2a5dbe4b108 req-6b2f0f5a-8f6b-41ce-8d83-7147ecdc0fc9 service nova] Acquired lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:00:20 user nova-compute[74039]: DEBUG nova.network.neutron [req-239a238c-3df3-4644-89a0-e2a5dbe4b108 req-6b2f0f5a-8f6b-41ce-8d83-7147ecdc0fc9 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Refreshing network info cache for port 7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:00:21 user nova-compute[74039]: DEBUG nova.network.neutron [req-239a238c-3df3-4644-89a0-e2a5dbe4b108 req-6b2f0f5a-8f6b-41ce-8d83-7147ecdc0fc9 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Updated VIF entry in instance network info cache for port 7f2d5682-0113-40f4-8bbb-02e87564b7ef. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:00:21 user nova-compute[74039]: DEBUG nova.network.neutron [req-239a238c-3df3-4644-89a0-e2a5dbe4b108 req-6b2f0f5a-8f6b-41ce-8d83-7147ecdc0fc9 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Updating instance_info_cache with network_info: [{"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:00:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-239a238c-3df3-4644-89a0-e2a5dbe4b108 req-6b2f0f5a-8f6b-41ce-8d83-7147ecdc0fc9 service nova] Releasing lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:00:21 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:00:21 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:00:21 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Didn't find any instances for network info cache update. {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 09:00:21 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:00:21 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:00:21 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:00:21 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:00:21 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:00:21 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:00:22 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:00:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:00:25 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:00:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:00:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:00:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:00:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:00:27 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:00:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:00:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:00:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:00:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:00:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "03e487d1-90aa-436d-9c2f-468f9791af91" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:00:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "03e487d1-90aa-436d-9c2f-468f9791af91" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:00:31 user nova-compute[74039]: INFO nova.compute.manager [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Rebooting instance
Oct 20 09:00:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:00:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquired lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:00:31 user nova-compute[74039]: DEBUG nova.network.neutron [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:00:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:31 user nova-compute[74039]: DEBUG nova.network.neutron [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Updating instance_info_cache with network_info: [{"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:00:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Releasing lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:00:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:00:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:32 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:00:32 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7782MB free_disk=25.52391815185547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Applying migration context for instance ebaa4804-32e5-4fff-9562-0587ff7ca4ed as it has an incoming, in-progress migration 242a5b7f-5026-4dba-b30a-aeb328c19394. Migration status is post-migrating {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 09:00:32 user nova-compute[74039]: INFO nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Updating resource usage from migration 242a5b7f-5026-4dba-b30a-aeb328c19394
Oct 20 09:00:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 9fe77a96-fcb5-4410-85cc-58d925548e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c8054dbd-c0ae-45d2-af95-dae7d05f8c69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 3625b19d-4394-4feb-bbe8-55a2d86dd7fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 03e487d1-90aa-436d-9c2f-468f9791af91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance d61f84a9-85ea-40aa-b21e-45064b3bc090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Migration 242a5b7f-5026-4dba-b30a-aeb328c19394 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance ebaa4804-32e5-4fff-9562-0587ff7ca4ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 90473cd0-7bf8-478e-af9d-771f720a10f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing inventories for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Updating ProviderTree inventory for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Updating inventory in ProviderTree for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing aggregate associations for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb, aggregates: None {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing trait associations for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.compute.manager [req-0803b142-7d47-4707-845f-1c0871633eb6 req-ff9454f7-0dff-4186-aaf9-a12977144340 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received event network-vif-unplugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0803b142-7d47-4707-845f-1c0871633eb6 req-ff9454f7-0dff-4186-aaf9-a12977144340 service nova] Acquiring lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0803b142-7d47-4707-845f-1c0871633eb6 req-ff9454f7-0dff-4186-aaf9-a12977144340 service nova] Lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0803b142-7d47-4707-845f-1c0871633eb6 req-ff9454f7-0dff-4186-aaf9-a12977144340 service nova] Lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.compute.manager [req-0803b142-7d47-4707-845f-1c0871633eb6 req-ff9454f7-0dff-4186-aaf9-a12977144340 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] No waiting events found dispatching network-vif-unplugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:00:32 user nova-compute[74039]: WARNING nova.compute.manager [req-0803b142-7d47-4707-845f-1c0871633eb6 req-ff9454f7-0dff-4186-aaf9-a12977144340 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received unexpected event network-vif-unplugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef for instance with vm_state active and task_state reboot_started_hard.
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:00:32 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.677s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:00:33 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Instance destroyed successfully.
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.objects.instance [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lazy-loading 'resources' on Instance uuid 03e487d1-90aa-436d-9c2f-468f9791af91 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-250189437',display_name='tempest-TestMinimumBasicScenario-server-250189437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-250189437',id=15,image_ref='60dbb338-0365-4d23-b037-a87dd89bac9a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+AsAZbu9hcOCbYGhFUvhYYTHLMoxYc4EjEdPTCNq64vpVX20iz3IE00/FA+6f425LVCuWxeFU/Of+ZYFOw9aQG00fS5587QvPqvWaQSGIHlsyM60P0361dJXLYB5FnyQ==',key_name='tempest-TestMinimumBasicScenario-1222695517',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:56:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9d044b69c56433ca011f220f8578407',ramdisk_id='',reservation_id='r-mltvrcs2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60dbb338-0365-4d23-b037-a87dd89bac9a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1802809099',owner_user_name='tempest-TestMinimumBasicScenario-1802809099-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:00:32Z,user_data=None,user_id='af6af67060414d48b96ee116b9e6dbdb',uuid=03e487d1-90aa-436d-9c2f-468f9791af91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Converting VIF {"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:36:6d,bridge_name='br-int',has_traffic_filtering=True,id=7f2d5682-0113-40f4-8bbb-02e87564b7ef,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d5682-01') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_vif [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:36:6d,bridge_name='br-int',has_traffic_filtering=True,id=7f2d5682-0113-40f4-8bbb-02e87564b7ef,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d5682-01') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f2d5682-01, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=063dc1e1-265a-46a9-a977-187d16fbc7b5) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:00:33 user nova-compute[74039]: INFO os_vif [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:36:6d,bridge_name='br-int',has_traffic_filtering=True,id=7f2d5682-0113-40f4-8bbb-02e87564b7ef,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d5682-01')
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBhpJRXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:00:33 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6575b72c-268b-40f7-91e2-51c7402b445c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:00:33 user nova-compute[74039]: No targets found.
Oct 20 09:00:33 user nova-compute[74039]: iSNS:
Oct 20 09:00:33 user nova-compute[74039]: No targets found.
Oct 20 09:00:33 user nova-compute[74039]: STATIC:
Oct 20 09:00:33 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf
Oct 20 09:00:33 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:00:33 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:00:33 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf
Oct 20 09:00:33 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:00:33 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:00:33 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e
Oct 20 09:00:33 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:00:33 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:00:33 user nova-compute[74039]: FIRMWARE:
Oct 20 09:00:33 user nova-compute[74039]: No targets found.
Oct 20 09:00:33 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:00:33 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:00:33 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad088a3a-3a7d-4688-b6c2-3a98f128fa94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8c407f-7f7b-486d-ba3b-37eaf351f377]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:00:33 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 09:00:33 user nova-compute[74039]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)
Oct 20 09:00:33 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:00:33 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 09:00:33 user nova-compute[74039]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)
Oct 20 09:00:33 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae8429d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf'): ({'sdd'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Removing single pathed devices sdd {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecef06a6-868b-47bd-ad3c-e9206e46ceac]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eed0a5f-9a08-4b8b-81e1-6644d3eeeb65]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Flushing IO for device /dev/sdd {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[65116496-f3c3-4613-9069-4c5af4430713]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46a84bb-83c0-4579-a2b7-6aca6f8b3e9f]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead9c999-4fa1-4838-8f9d-53aa3c0a56c7]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ec98fb-62a6-4bf7-ba41-1f6e26a6ca34]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf, portal: 172.16.0.220,3260]
Oct 20 09:00:33 user nova-compute[74039]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf, portal: 172.16.0.220,3260] successful.
Oct 20 09:00:33 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f65de4-adaf-4000-9bdc-2f6eb667076b]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] <== disconnect_volume: return (332ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Start _get_guest_xml network_info=[{"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=60dbb338-0365-4d23-b037-a87dd89bac9a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': '60dbb338-0365-4d23-b037-a87dd89bac9a'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '06ce466d-e008-4e9d-949d-79384e38d059', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBhpJRXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '03e487d1-90aa-436d-9c2f-468f9791af91', 'attached_at': '', 'detached_at': '', 'volume_id': '9142d9e6-9d0b-4920-aa08-e05ace57cbbf', 'serial': '9142d9e6-9d0b-4920-aa08-e05ace57cbbf'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:00:33 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:00:33 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=60dbb338-0365-4d23-b037-a87dd89bac9a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.objects.instance [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lazy-loading 'vcpu_model' on Instance uuid 03e487d1-90aa-436d-9c2f-468f9791af91 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.objects.base [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Object Instance<03e487d1-90aa-436d-9c2f-468f9791af91> lazy-loaded attributes: resources,vcpu_model {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBhpJRXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:00:33 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:00:33 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:00:33 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae68f1f5-1024-4a40-85f7-7b214ed1ed04]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:00:33 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0a0a8c-e375-499e-a2fc-3769609e266a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf] added
Oct 20 09:00:33 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae68fe24-5169-4f0c-a479-c6a2fbade838]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c25f2f-645c-46cf-aac4-f2acaf58565a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YBhpJRXv {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YBhpJRXv" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[546db3ae-c525-4854-b29a-ef2160713095]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YBhpJRXv'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c478981c-d2d5-4822-a899-eb3e4fe2b6a4]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d0b41d-2e02-4b35-9aa3-68f1725c5928]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:00:33 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 09:00:33 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:00:33 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 09:00:33 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d200c4a-60c5-4a21-8e10-3f94102d0316]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf, portal: 172.16.0.220,3260]
Oct 20 09:00:33 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf, portal: 172.16.0.220,3260] successful.
Oct 20 09:00:33 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b7c2a6-3017-4e4f-9059-46a60726cb0a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8e5ec5-8f0f-417c-b32a-309ea44201be]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:00:33 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 09:00:33 user nova-compute[74039]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)
Oct 20 09:00:33 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:00:33 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 09:00:33 user nova-compute[74039]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)
Oct 20 09:00:33 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb55ab1-e9ce-4ca7-a693-52c4056ae40a]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:00:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBhpJRXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:00:34 user nova-compute[74039]: DEBUG nova.compute.manager [req-0723ee5f-0ef7-4b3f-bd67-45ecb9cfca43 req-0d4a6e4f-f76b-4c28-8ef8-8f4c69744e68 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received event network-vif-plugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:00:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0723ee5f-0ef7-4b3f-bd67-45ecb9cfca43 req-0d4a6e4f-f76b-4c28-8ef8-8f4c69744e68 service nova] Acquiring lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:00:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0723ee5f-0ef7-4b3f-bd67-45ecb9cfca43 req-0d4a6e4f-f76b-4c28-8ef8-8f4c69744e68 service nova] Lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:00:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0723ee5f-0ef7-4b3f-bd67-45ecb9cfca43 req-0d4a6e4f-f76b-4c28-8ef8-8f4c69744e68 service nova] Lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:00:34 user nova-compute[74039]: DEBUG nova.compute.manager [req-0723ee5f-0ef7-4b3f-bd67-45ecb9cfca43 req-0d4a6e4f-f76b-4c28-8ef8-8f4c69744e68 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] No waiting events found dispatching network-vif-plugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:00:34 user nova-compute[74039]: WARNING nova.compute.manager [req-0723ee5f-0ef7-4b3f-bd67-45ecb9cfca43 req-0d4a6e4f-f76b-4c28-8ef8-8f4c69744e68 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received unexpected event network-vif-plugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef for instance with vm_state active and task_state reboot_started_hard.
Oct 20 09:00:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:00:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23761346461623266', 'path': '/dev/sdd'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:00:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761346461623266', 'path': '/dev/sdd'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:00:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-250189437',display_name='tempest-TestMinimumBasicScenario-server-250189437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-250189437',id=15,image_ref='60dbb338-0365-4d23-b037-a87dd89bac9a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+AsAZbu9hcOCbYGhFUvhYYTHLMoxYc4EjEdPTCNq64vpVX20iz3IE00/FA+6f425LVCuWxeFU/Of+ZYFOw9aQG00fS5587QvPqvWaQSGIHlsyM60P0361dJXLYB5FnyQ==',key_name='tempest-TestMinimumBasicScenario-1222695517',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:56:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9d044b69c56433ca011f220f8578407',ramdisk_id='',reservation_id='r-mltvrcs2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60dbb338-0365-4d23-b037-a87dd89bac9a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1802809099',owner_user_name='tempest-TestMinimumBasicScenario-1802809099-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:00:32Z,user_data=None,user_id='af6af67060414d48b96ee116b9e6dbdb',uuid=03e487d1-90aa-436d-9c2f-468f9791af91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:00:34 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Converting VIF {"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:00:34 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:36:6d,bridge_name='br-int',has_traffic_filtering=True,id=7f2d5682-0113-40f4-8bbb-02e87564b7ef,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d5682-01') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:00:34 user nova-compute[74039]: DEBUG nova.objects.instance [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lazy-loading 'pci_devices' on Instance uuid 03e487d1-90aa-436d-9c2f-468f9791af91 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG nova.objects.base [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Object Instance<03e487d1-90aa-436d-9c2f-468f9791af91> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:00:35 user nova-compute[74039]:   <uuid>03e487d1-90aa-436d-9c2f-468f9791af91</uuid>
Oct 20 09:00:35 user nova-compute[74039]:   <name>instance-0000000f</name>
Oct 20 09:00:35 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:00:35 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:00:35 user nova-compute[74039]:   <metadata>
Oct 20 09:00:35 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:00:35 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:00:35 user nova-compute[74039]:       <nova:name>tempest-TestMinimumBasicScenario-server-250189437</nova:name>
Oct 20 09:00:35 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:00:33</nova:creationTime>
Oct 20 09:00:35 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:00:35 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:00:35 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:00:35 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:00:35 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:00:35 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:00:35 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:00:35 user nova-compute[74039]:       <nova:owner>
Oct 20 09:00:35 user nova-compute[74039]:         <nova:user uuid="af6af67060414d48b96ee116b9e6dbdb">tempest-TestMinimumBasicScenario-1802809099-project-member</nova:user>
Oct 20 09:00:35 user nova-compute[74039]:         <nova:project uuid="d9d044b69c56433ca011f220f8578407">tempest-TestMinimumBasicScenario-1802809099</nova:project>
Oct 20 09:00:35 user nova-compute[74039]:       </nova:owner>
Oct 20 09:00:35 user nova-compute[74039]:       <nova:root type="image" uuid="60dbb338-0365-4d23-b037-a87dd89bac9a"/>
Oct 20 09:00:35 user nova-compute[74039]:       <nova:ports>
Oct 20 09:00:35 user nova-compute[74039]:         <nova:port uuid="7f2d5682-0113-40f4-8bbb-02e87564b7ef">
Oct 20 09:00:35 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 09:00:35 user nova-compute[74039]:         </nova:port>
Oct 20 09:00:35 user nova-compute[74039]:       </nova:ports>
Oct 20 09:00:35 user nova-compute[74039]:     </nova:instance>
Oct 20 09:00:35 user nova-compute[74039]:   </metadata>
Oct 20 09:00:35 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:00:35 user nova-compute[74039]:     <system>
Oct 20 09:00:35 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:00:35 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:00:35 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:00:35 user nova-compute[74039]:       <entry name="serial">03e487d1-90aa-436d-9c2f-468f9791af91</entry>
Oct 20 09:00:35 user nova-compute[74039]:       <entry name="uuid">03e487d1-90aa-436d-9c2f-468f9791af91</entry>
Oct 20 09:00:35 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:00:35 user nova-compute[74039]:     </system>
Oct 20 09:00:35 user nova-compute[74039]:   </sysinfo>
Oct 20 09:00:35 user nova-compute[74039]:   <os>
Oct 20 09:00:35 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:00:35 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:00:35 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:00:35 user nova-compute[74039]:   </os>
Oct 20 09:00:35 user nova-compute[74039]:   <features>
Oct 20 09:00:35 user nova-compute[74039]:     <acpi/>
Oct 20 09:00:35 user nova-compute[74039]:     <apic/>
Oct 20 09:00:35 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:00:35 user nova-compute[74039]:   </features>
Oct 20 09:00:35 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:00:35 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:00:35 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:00:35 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:00:35 user nova-compute[74039]:   </clock>
Oct 20 09:00:35 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:00:35 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:00:35 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:00:35 user nova-compute[74039]:   </cpu>
Oct 20 09:00:35 user nova-compute[74039]:   <devices>
Oct 20 09:00:35 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:00:35 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:00:35 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk"/>
Oct 20 09:00:35 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:00:35 user nova-compute[74039]:     </disk>
Oct 20 09:00:35 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 09:00:35 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:00:35 user nova-compute[74039]:       <source dev="/dev/sdd"/>
Oct 20 09:00:35 user nova-compute[74039]:       <target dev="vdb" bus="virtio"/>
Oct 20 09:00:35 user nova-compute[74039]:       <serial>9142d9e6-9d0b-4920-aa08-e05ace57cbbf</serial>
Oct 20 09:00:35 user nova-compute[74039]:     </disk>
Oct 20 09:00:35 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:00:35 user nova-compute[74039]:       <mac address="fa:16:3e:41:36:6d"/>
Oct 20 09:00:35 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:00:35 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:00:35 user nova-compute[74039]:       <target dev="tap7f2d5682-01"/>
Oct 20 09:00:35 user nova-compute[74039]:     </interface>
Oct 20 09:00:35 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:00:35 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/console.log" append="off"/>
Oct 20 09:00:35 user nova-compute[74039]:     </serial>
Oct 20 09:00:35 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:00:35 user nova-compute[74039]:     <video>
Oct 20 09:00:35 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:00:35 user nova-compute[74039]:     </video>
Oct 20 09:00:35 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:00:35 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:00:35 user nova-compute[74039]:     </rng>
Oct 20 09:00:35 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:00:35 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:00:35 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:00:35 user nova-compute[74039]:     </memballoon>
Oct 20 09:00:35 user nova-compute[74039]:   </devices>
Oct 20 09:00:35 user nova-compute[74039]: </domain>
Oct 20 09:00:35 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG nova.objects.instance [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lazy-loading 'trusted_certs' on Instance uuid 03e487d1-90aa-436d-9c2f-468f9791af91 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG nova.objects.base [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Object Instance<03e487d1-90aa-436d-9c2f-468f9791af91> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894 --force-share --output=json" returned: 0 in 0.194s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Cannot resize image /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG nova.objects.instance [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lazy-loading 'migration_context' on Instance uuid 03e487d1-90aa-436d-9c2f-468f9791af91 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG nova.objects.base [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Object Instance<03e487d1-90aa-436d-9c2f-468f9791af91> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-250189437',display_name='tempest-TestMinimumBasicScenario-server-250189437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-250189437',id=15,image_ref='60dbb338-0365-4d23-b037-a87dd89bac9a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+AsAZbu9hcOCbYGhFUvhYYTHLMoxYc4EjEdPTCNq64vpVX20iz3IE00/FA+6f425LVCuWxeFU/Of+ZYFOw9aQG00fS5587QvPqvWaQSGIHlsyM60P0361dJXLYB5FnyQ==',key_name='tempest-TestMinimumBasicScenario-1222695517',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:56:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='d9d044b69c56433ca011f220f8578407',ramdisk_id='',reservation_id='r-mltvrcs2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60dbb338-0365-4d23-b037-a87dd89bac9a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1802809099',owner_user_name='tempest-TestMinimumBasicScenario-1802809099-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:00:32Z,user_data=None,user_id='af6af67060414d48b96ee116b9e6dbdb',uuid=03e487d1-90aa-436d-9c2f-468f9791af91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Converting VIF {"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:36:6d,bridge_name='br-int',has_traffic_filtering=True,id=7f2d5682-0113-40f4-8bbb-02e87564b7ef,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d5682-01') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG os_vif [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:36:6d,bridge_name='br-int',has_traffic_filtering=True,id=7f2d5682-0113-40f4-8bbb-02e87564b7ef,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d5682-01') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b40705b-d1f7-5715-b261-2ade14ede764', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f2d5682-01, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f2d5682-01, col_values=(('qos', UUID('54616e7e-010e-469c-a4d4-a3d2b6396d39')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f2d5682-01, col_values=(('external_ids', {'iface-id': '7f2d5682-0113-40f4-8bbb-02e87564b7ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:36:6d', 'vm-uuid': '03e487d1-90aa-436d-9c2f-468f9791af91'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:00:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:35 user nova-compute[74039]: INFO os_vif [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:36:6d,bridge_name='br-int',has_traffic_filtering=True,id=7f2d5682-0113-40f4-8bbb-02e87564b7ef,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d5682-01')
Oct 20 09:00:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:37 user nova-compute[74039]: DEBUG nova.compute.manager [req-e804d1e0-a761-4c76-b41c-3a607d96e844 req-d75569d2-a81c-4258-a106-05652d73cced service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received event network-vif-plugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:00:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e804d1e0-a761-4c76-b41c-3a607d96e844 req-d75569d2-a81c-4258-a106-05652d73cced service nova] Acquiring lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:00:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e804d1e0-a761-4c76-b41c-3a607d96e844 req-d75569d2-a81c-4258-a106-05652d73cced service nova] Lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:00:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e804d1e0-a761-4c76-b41c-3a607d96e844 req-d75569d2-a81c-4258-a106-05652d73cced service nova] Lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:00:37 user nova-compute[74039]: DEBUG nova.compute.manager [req-e804d1e0-a761-4c76-b41c-3a607d96e844 req-d75569d2-a81c-4258-a106-05652d73cced service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] No waiting events found dispatching network-vif-plugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:00:37 user nova-compute[74039]: WARNING nova.compute.manager [req-e804d1e0-a761-4c76-b41c-3a607d96e844 req-d75569d2-a81c-4258-a106-05652d73cced service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received unexpected event network-vif-plugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef for instance with vm_state active and task_state reboot_started_hard.
Oct 20 09:00:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:39 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:00:39 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Instance rebooted successfully.
Oct 20 09:00:39 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:00:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ef1c0b0-0887-4228-84a9-79654cc47def tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "03e487d1-90aa-436d-9c2f-468f9791af91" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.234s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:00:39 user nova-compute[74039]: DEBUG nova.compute.manager [req-7d30bef4-8c09-4f60-8976-4e201cf131be req-801c97c0-a8f0-41a2-ad92-b494543979db service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received event network-vif-plugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:00:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7d30bef4-8c09-4f60-8976-4e201cf131be req-801c97c0-a8f0-41a2-ad92-b494543979db service nova] Acquiring lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:00:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7d30bef4-8c09-4f60-8976-4e201cf131be req-801c97c0-a8f0-41a2-ad92-b494543979db service nova] Lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:00:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7d30bef4-8c09-4f60-8976-4e201cf131be req-801c97c0-a8f0-41a2-ad92-b494543979db service nova] Lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:00:39 user nova-compute[74039]: DEBUG nova.compute.manager [req-7d30bef4-8c09-4f60-8976-4e201cf131be req-801c97c0-a8f0-41a2-ad92-b494543979db service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] No waiting events found dispatching network-vif-plugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:00:39 user nova-compute[74039]: WARNING nova.compute.manager [req-7d30bef4-8c09-4f60-8976-4e201cf131be req-801c97c0-a8f0-41a2-ad92-b494543979db service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received unexpected event network-vif-plugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef for instance with vm_state active and task_state None.
Oct 20 09:00:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:00:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:00:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:00:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:00:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:00:46 user nova-compute[74039]: INFO nova.compute.manager [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Terminating instance
Oct 20 09:00:46 user nova-compute[74039]: DEBUG nova.compute.manager [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:00:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-e54b683c-9081-4167-9093-cc85ed416e9f req-fa9a17a8-e114-4ce9-9f29-41fadaaab057 service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Received event network-vif-unplugged-b57e8401-da94-4880-b515-65198826312a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:00:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e54b683c-9081-4167-9093-cc85ed416e9f req-fa9a17a8-e114-4ce9-9f29-41fadaaab057 service nova] Acquiring lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:00:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e54b683c-9081-4167-9093-cc85ed416e9f req-fa9a17a8-e114-4ce9-9f29-41fadaaab057 service nova] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:00:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e54b683c-9081-4167-9093-cc85ed416e9f req-fa9a17a8-e114-4ce9-9f29-41fadaaab057 service nova] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:00:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-e54b683c-9081-4167-9093-cc85ed416e9f req-fa9a17a8-e114-4ce9-9f29-41fadaaab057 service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] No waiting events found dispatching network-vif-unplugged-b57e8401-da94-4880-b515-65198826312a {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:00:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-e54b683c-9081-4167-9093-cc85ed416e9f req-fa9a17a8-e114-4ce9-9f29-41fadaaab057 service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Received event network-vif-unplugged-b57e8401-da94-4880-b515-65198826312a for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:00:47 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Instance destroyed successfully.
Oct 20 09:00:47 user nova-compute[74039]: DEBUG nova.objects.instance [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lazy-loading 'resources' on Instance uuid 3625b19d-4394-4feb-bbe8-55a2d86dd7fb {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:00:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:53:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-740764200',display_name='tempest-VolumesAdminNegativeTest-server-740764200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-740764200',id=12,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQEp0P+G1VK3fQcfWne/LntHgp/xEIDDIvCcEznYUwgm53tzKdQcw8SsfIGAr4cUYTSXFdzSYeFO4hfki+8D8Q91BWsNK4tJz28pHACQOnDeecjH62qCoHurCO/memc0Q==',key_name='tempest-keypair-148658676',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:53:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61eb463233344f65b2657a952c24d331',ramdisk_id='',reservation_id='r-b3x25oou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-772182177',owner_user_name='tempest-VolumesAdminNegativeTest-772182177-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:53:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3e2da79669b41bea6e6a166c7c4a513',uuid=3625b19d-4394-4feb-bbe8-55a2d86dd7fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b57e8401-da94-4880-b515-65198826312a", "address": "fa:16:3e:54:60:7c", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57e8401-da", "ovs_interfaceid": "b57e8401-da94-4880-b515-65198826312a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:00:47 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Converting VIF {"id": "b57e8401-da94-4880-b515-65198826312a", "address": "fa:16:3e:54:60:7c", "network": {"id": "5d45b218-0125-40ea-9e08-64f416fc77ea", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-714762848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61eb463233344f65b2657a952c24d331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57e8401-da", "ovs_interfaceid": "b57e8401-da94-4880-b515-65198826312a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:00:47 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:60:7c,bridge_name='br-int',has_traffic_filtering=True,id=b57e8401-da94-4880-b515-65198826312a,network=Network(5d45b218-0125-40ea-9e08-64f416fc77ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb57e8401-da') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:00:47 user nova-compute[74039]: DEBUG os_vif [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:60:7c,bridge_name='br-int',has_traffic_filtering=True,id=b57e8401-da94-4880-b515-65198826312a,network=Network(5d45b218-0125-40ea-9e08-64f416fc77ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb57e8401-da') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:00:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb57e8401-da, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:00:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:00:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c12d750d-82eb-4368-84f9-824c87d49e0e) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:00:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:47 user nova-compute[74039]: INFO os_vif [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:60:7c,bridge_name='br-int',has_traffic_filtering=True,id=b57e8401-da94-4880-b515-65198826312a,network=Network(5d45b218-0125-40ea-9e08-64f416fc77ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb57e8401-da')
Oct 20 09:00:47 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Deleting instance files /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb_del
Oct 20 09:00:47 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Deletion of /opt/stack/data/nova/instances/3625b19d-4394-4feb-bbe8-55a2d86dd7fb_del complete
Oct 20 09:00:47 user nova-compute[74039]: INFO nova.compute.manager [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 20 09:00:47 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:00:47 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:00:47 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:00:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:00:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:00:47 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:00:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:00:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:00:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:00:47 user nova-compute[74039]: INFO nova.compute.claims [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Claim successful on node user
Oct 20 09:00:48 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG nova.compute.manager [req-62ee5022-8091-4f93-af62-9dc2395be416 req-8763fc2b-909f-4076-a889-57e8b4725a88 service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Received event network-vif-deleted-b57e8401-da94-4880-b515-65198826312a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:00:48 user nova-compute[74039]: INFO nova.compute.manager [req-62ee5022-8091-4f93-af62-9dc2395be416 req-8763fc2b-909f-4076-a889-57e8b4725a88 service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Neutron deleted interface b57e8401-da94-4880-b515-65198826312a; detaching it from the instance and deleting it from the info cache
Oct 20 09:00:48 user nova-compute[74039]: DEBUG nova.network.neutron [req-62ee5022-8091-4f93-af62-9dc2395be416 req-8763fc2b-909f-4076-a889-57e8b4725a88 service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:00:48 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Took 0.82 seconds to deallocate network for instance.
Oct 20 09:00:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG nova.compute.manager [req-62ee5022-8091-4f93-af62-9dc2395be416 req-8763fc2b-909f-4076-a889-57e8b4725a88 service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Detach interface failed, port_id=b57e8401-da94-4880-b515-65198826312a, reason: Instance 3625b19d-4394-4feb-bbe8-55a2d86dd7fb could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG nova.network.neutron [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:00:48 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:00:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG nova.policy [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '907a4bffd1d34559b3dd1ede3be227ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39bff5237c144002a806235775eda215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:00:48 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Creating image(s)
Oct 20 09:00:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "/opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "/opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "/opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.522s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:00:48 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Deleted allocations for instance 3625b19d-4394-4feb-bbe8-55a2d86dd7fb
Oct 20 09:00:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.189s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG nova.compute.manager [req-ba5bc66d-a51f-4766-aed5-2f0ee7d51106 req-8af843ae-f717-466f-8dd5-2160cfe3737e service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Received event network-vif-plugged-b57e8401-da94-4880-b515-65198826312a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ba5bc66d-a51f-4766-aed5-2f0ee7d51106 req-8af843ae-f717-466f-8dd5-2160cfe3737e service nova] Acquiring lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ba5bc66d-a51f-4766-aed5-2f0ee7d51106 req-8af843ae-f717-466f-8dd5-2160cfe3737e service nova] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ba5bc66d-a51f-4766-aed5-2f0ee7d51106 req-8af843ae-f717-466f-8dd5-2160cfe3737e service nova] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG nova.compute.manager [req-ba5bc66d-a51f-4766-aed5-2f0ee7d51106 req-8af843ae-f717-466f-8dd5-2160cfe3737e service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] No waiting events found dispatching network-vif-plugged-b57e8401-da94-4880-b515-65198826312a {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:00:49 user nova-compute[74039]: WARNING nova.compute.manager [req-ba5bc66d-a51f-4766-aed5-2f0ee7d51106 req-8af843ae-f717-466f-8dd5-2160cfe3737e service nova] [instance: 3625b19d-4394-4feb-bbe8-55a2d86dd7fb] Received unexpected event network-vif-plugged-b57e8401-da94-4880-b515-65198826312a for instance with vm_state deleted and task_state None.
Oct 20 09:00:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk 1073741824" returned: 0 in 0.059s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-41420d33-b038-4579-aa93-ae7d11509b98 tempest-VolumesAdminNegativeTest-772182177 tempest-VolumesAdminNegativeTest-772182177-project-member] Lock "3625b19d-4394-4feb-bbe8-55a2d86dd7fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.576s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG nova.network.neutron [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Successfully created port: e3f15714-c9a3-44e4-832a-953cf2dbed61 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.182s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Cannot resize image /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Ensure instance console log exists: /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG nova.network.neutron [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Successfully updated port: e3f15714-c9a3-44e4-832a-953cf2dbed61 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "refresh_cache-8af05cc2-c1b2-4187-b16e-5fbeb006de6a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquired lock "refresh_cache-8af05cc2-c1b2-4187-b16e-5fbeb006de6a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG nova.network.neutron [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:00:49 user nova-compute[74039]: DEBUG nova.network.neutron [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.network.neutron [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Updating instance_info_cache with network_info: [{"id": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "address": "fa:16:3e:e6:1f:b2", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f15714-c9", "ovs_interfaceid": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Releasing lock "refresh_cache-8af05cc2-c1b2-4187-b16e-5fbeb006de6a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Instance network_info: |[{"id": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "address": "fa:16:3e:e6:1f:b2", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f15714-c9", "ovs_interfaceid": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Start _get_guest_xml network_info=[{"id": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "address": "fa:16:3e:e6:1f:b2", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f15714-c9", "ovs_interfaceid": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:00:50 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:00:50 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-545991427',display_name='tempest-AttachVolumeTestJSON-server-545991427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-545991427',id=21,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8yPCcXkGa5NGmDCjjyPeKJpDRXP/krA/BYoSZXi5PzvMQs1R74j/TXU1tP9vTRlm/U+heKByYdWrgOdwKLLPdxQVPQiWoFClS8AGJhLfSDpwHpFmNOSD8BHOegL6QgZw==',key_name='tempest-keypair-1945081547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39bff5237c144002a806235775eda215',ramdisk_id='',reservation_id='r-unx3bj5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1630150217',owner_user_name='tempest-AttachVolumeTestJSON-1630150217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:00:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='907a4bffd1d34559b3dd1ede3be227ee',uuid=8af05cc2-c1b2-4187-b16e-5fbeb006de6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "address": "fa:16:3e:e6:1f:b2", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f15714-c9", "ovs_interfaceid": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Converting VIF {"id": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "address": "fa:16:3e:e6:1f:b2", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f15714-c9", "ovs_interfaceid": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:1f:b2,bridge_name='br-int',has_traffic_filtering=True,id=e3f15714-c9a3-44e4-832a-953cf2dbed61,network=Network(07b19de8-22c5-4d12-86ed-3e443540c21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f15714-c9') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.objects.instance [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lazy-loading 'pci_devices' on Instance uuid 8af05cc2-c1b2-4187-b16e-5fbeb006de6a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:00:50 user nova-compute[74039]:   <uuid>8af05cc2-c1b2-4187-b16e-5fbeb006de6a</uuid>
Oct 20 09:00:50 user nova-compute[74039]:   <name>instance-00000015</name>
Oct 20 09:00:50 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:00:50 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:00:50 user nova-compute[74039]:   <metadata>
Oct 20 09:00:50 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:00:50 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:00:50 user nova-compute[74039]:       <nova:name>tempest-AttachVolumeTestJSON-server-545991427</nova:name>
Oct 20 09:00:50 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:00:50</nova:creationTime>
Oct 20 09:00:50 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:00:50 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:00:50 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:00:50 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:00:50 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:00:50 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:00:50 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:00:50 user nova-compute[74039]:       <nova:owner>
Oct 20 09:00:50 user nova-compute[74039]:         <nova:user uuid="907a4bffd1d34559b3dd1ede3be227ee">tempest-AttachVolumeTestJSON-1630150217-project-member</nova:user>
Oct 20 09:00:50 user nova-compute[74039]:         <nova:project uuid="39bff5237c144002a806235775eda215">tempest-AttachVolumeTestJSON-1630150217</nova:project>
Oct 20 09:00:50 user nova-compute[74039]:       </nova:owner>
Oct 20 09:00:50 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:00:50 user nova-compute[74039]:       <nova:ports>
Oct 20 09:00:50 user nova-compute[74039]:         <nova:port uuid="e3f15714-c9a3-44e4-832a-953cf2dbed61">
Oct 20 09:00:50 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 09:00:50 user nova-compute[74039]:         </nova:port>
Oct 20 09:00:50 user nova-compute[74039]:       </nova:ports>
Oct 20 09:00:50 user nova-compute[74039]:     </nova:instance>
Oct 20 09:00:50 user nova-compute[74039]:   </metadata>
Oct 20 09:00:50 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:00:50 user nova-compute[74039]:     <system>
Oct 20 09:00:50 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:00:50 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:00:50 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:00:50 user nova-compute[74039]:       <entry name="serial">8af05cc2-c1b2-4187-b16e-5fbeb006de6a</entry>
Oct 20 09:00:50 user nova-compute[74039]:       <entry name="uuid">8af05cc2-c1b2-4187-b16e-5fbeb006de6a</entry>
Oct 20 09:00:50 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:00:50 user nova-compute[74039]:     </system>
Oct 20 09:00:50 user nova-compute[74039]:   </sysinfo>
Oct 20 09:00:50 user nova-compute[74039]:   <os>
Oct 20 09:00:50 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:00:50 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:00:50 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:00:50 user nova-compute[74039]:   </os>
Oct 20 09:00:50 user nova-compute[74039]:   <features>
Oct 20 09:00:50 user nova-compute[74039]:     <acpi/>
Oct 20 09:00:50 user nova-compute[74039]:     <apic/>
Oct 20 09:00:50 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:00:50 user nova-compute[74039]:   </features>
Oct 20 09:00:50 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:00:50 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:00:50 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:00:50 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:00:50 user nova-compute[74039]:   </clock>
Oct 20 09:00:50 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:00:50 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:00:50 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:00:50 user nova-compute[74039]:   </cpu>
Oct 20 09:00:50 user nova-compute[74039]:   <devices>
Oct 20 09:00:50 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:00:50 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:00:50 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk"/>
Oct 20 09:00:50 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:00:50 user nova-compute[74039]:     </disk>
Oct 20 09:00:50 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:00:50 user nova-compute[74039]:       <mac address="fa:16:3e:e6:1f:b2"/>
Oct 20 09:00:50 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:00:50 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:00:50 user nova-compute[74039]:       <target dev="tape3f15714-c9"/>
Oct 20 09:00:50 user nova-compute[74039]:     </interface>
Oct 20 09:00:50 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:00:50 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/console.log" append="off"/>
Oct 20 09:00:50 user nova-compute[74039]:     </serial>
Oct 20 09:00:50 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:00:50 user nova-compute[74039]:     <video>
Oct 20 09:00:50 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:00:50 user nova-compute[74039]:     </video>
Oct 20 09:00:50 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:00:50 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:00:50 user nova-compute[74039]:     </rng>
Oct 20 09:00:50 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:00:50 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:00:50 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:00:50 user nova-compute[74039]:     </memballoon>
Oct 20 09:00:50 user nova-compute[74039]:   </devices>
Oct 20 09:00:50 user nova-compute[74039]: </domain>
Oct 20 09:00:50 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-545991427',display_name='tempest-AttachVolumeTestJSON-server-545991427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-545991427',id=21,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8yPCcXkGa5NGmDCjjyPeKJpDRXP/krA/BYoSZXi5PzvMQs1R74j/TXU1tP9vTRlm/U+heKByYdWrgOdwKLLPdxQVPQiWoFClS8AGJhLfSDpwHpFmNOSD8BHOegL6QgZw==',key_name='tempest-keypair-1945081547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39bff5237c144002a806235775eda215',ramdisk_id='',reservation_id='r-unx3bj5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1630150217',owner_user_name='tempest-AttachVolumeTestJSON-1630150217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:00:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='907a4bffd1d34559b3dd1ede3be227ee',uuid=8af05cc2-c1b2-4187-b16e-5fbeb006de6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "address": "fa:16:3e:e6:1f:b2", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f15714-c9", "ovs_interfaceid": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Converting VIF {"id": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "address": "fa:16:3e:e6:1f:b2", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f15714-c9", "ovs_interfaceid": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:1f:b2,bridge_name='br-int',has_traffic_filtering=True,id=e3f15714-c9a3-44e4-832a-953cf2dbed61,network=Network(07b19de8-22c5-4d12-86ed-3e443540c21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f15714-c9') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG os_vif [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:1f:b2,bridge_name='br-int',has_traffic_filtering=True,id=e3f15714-c9a3-44e4-832a-953cf2dbed61,network=Network(07b19de8-22c5-4d12-86ed-3e443540c21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f15714-c9') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '664f07b7-f926-5b49-b846-c2f70a9fb37c', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3f15714-c9, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3f15714-c9, col_values=(('qos', UUID('33616106-ae85-4ff3-a001-e3807f0b06d6')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3f15714-c9, col_values=(('external_ids', {'iface-id': 'e3f15714-c9a3-44e4-832a-953cf2dbed61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:1f:b2', 'vm-uuid': '8af05cc2-c1b2-4187-b16e-5fbeb006de6a'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:50 user nova-compute[74039]: INFO os_vif [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:1f:b2,bridge_name='br-int',has_traffic_filtering=True,id=e3f15714-c9a3-44e4-832a-953cf2dbed61,network=Network(07b19de8-22c5-4d12-86ed-3e443540c21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f15714-c9')
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.compute.manager [req-3b045991-73e6-4a3b-b332-07904e054ba2 req-91a1ec5e-1aea-426f-b8b3-b56560028f5d service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Received event network-changed-e3f15714-c9a3-44e4-832a-953cf2dbed61 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.compute.manager [req-3b045991-73e6-4a3b-b332-07904e054ba2 req-91a1ec5e-1aea-426f-b8b3-b56560028f5d service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Refreshing instance network info cache due to event network-changed-e3f15714-c9a3-44e4-832a-953cf2dbed61. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3b045991-73e6-4a3b-b332-07904e054ba2 req-91a1ec5e-1aea-426f-b8b3-b56560028f5d service nova] Acquiring lock "refresh_cache-8af05cc2-c1b2-4187-b16e-5fbeb006de6a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3b045991-73e6-4a3b-b332-07904e054ba2 req-91a1ec5e-1aea-426f-b8b3-b56560028f5d service nova] Acquired lock "refresh_cache-8af05cc2-c1b2-4187-b16e-5fbeb006de6a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.network.neutron [req-3b045991-73e6-4a3b-b332-07904e054ba2 req-91a1ec5e-1aea-426f-b8b3-b56560028f5d service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Refreshing network info cache for port e3f15714-c9a3-44e4-832a-953cf2dbed61 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] No VIF found with MAC fa:16:3e:e6:1f:b2, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.network.neutron [req-3b045991-73e6-4a3b-b332-07904e054ba2 req-91a1ec5e-1aea-426f-b8b3-b56560028f5d service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Updated VIF entry in instance network info cache for port e3f15714-c9a3-44e4-832a-953cf2dbed61. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG nova.network.neutron [req-3b045991-73e6-4a3b-b332-07904e054ba2 req-91a1ec5e-1aea-426f-b8b3-b56560028f5d service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Updating instance_info_cache with network_info: [{"id": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "address": "fa:16:3e:e6:1f:b2", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f15714-c9", "ovs_interfaceid": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:00:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3b045991-73e6-4a3b-b332-07904e054ba2 req-91a1ec5e-1aea-426f-b8b3-b56560028f5d service nova] Releasing lock "refresh_cache-8af05cc2-c1b2-4187-b16e-5fbeb006de6a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:00:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:52 user nova-compute[74039]: DEBUG nova.compute.manager [req-4eeb2759-ca4e-42de-ad1e-f9c8579cb07e req-125d2cfe-2b36-4ad9-84f6-7a99c98ea66b service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Received event network-vif-plugged-e3f15714-c9a3-44e4-832a-953cf2dbed61 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:00:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4eeb2759-ca4e-42de-ad1e-f9c8579cb07e req-125d2cfe-2b36-4ad9-84f6-7a99c98ea66b service nova] Acquiring lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:00:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4eeb2759-ca4e-42de-ad1e-f9c8579cb07e req-125d2cfe-2b36-4ad9-84f6-7a99c98ea66b service nova] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:00:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4eeb2759-ca4e-42de-ad1e-f9c8579cb07e req-125d2cfe-2b36-4ad9-84f6-7a99c98ea66b service nova] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:00:52 user nova-compute[74039]: DEBUG nova.compute.manager [req-4eeb2759-ca4e-42de-ad1e-f9c8579cb07e req-125d2cfe-2b36-4ad9-84f6-7a99c98ea66b service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] No waiting events found dispatching network-vif-plugged-e3f15714-c9a3-44e4-832a-953cf2dbed61 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:00:52 user nova-compute[74039]: WARNING nova.compute.manager [req-4eeb2759-ca4e-42de-ad1e-f9c8579cb07e req-125d2cfe-2b36-4ad9-84f6-7a99c98ea66b service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Received unexpected event network-vif-plugged-e3f15714-c9a3-44e4-832a-953cf2dbed61 for instance with vm_state building and task_state spawning.
Oct 20 09:00:52 user nova-compute[74039]: DEBUG nova.compute.manager [req-4eeb2759-ca4e-42de-ad1e-f9c8579cb07e req-125d2cfe-2b36-4ad9-84f6-7a99c98ea66b service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Received event network-vif-plugged-e3f15714-c9a3-44e4-832a-953cf2dbed61 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:00:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4eeb2759-ca4e-42de-ad1e-f9c8579cb07e req-125d2cfe-2b36-4ad9-84f6-7a99c98ea66b service nova] Acquiring lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:00:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4eeb2759-ca4e-42de-ad1e-f9c8579cb07e req-125d2cfe-2b36-4ad9-84f6-7a99c98ea66b service nova] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:00:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4eeb2759-ca4e-42de-ad1e-f9c8579cb07e req-125d2cfe-2b36-4ad9-84f6-7a99c98ea66b service nova] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:00:52 user nova-compute[74039]: DEBUG nova.compute.manager [req-4eeb2759-ca4e-42de-ad1e-f9c8579cb07e req-125d2cfe-2b36-4ad9-84f6-7a99c98ea66b service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] No waiting events found dispatching network-vif-plugged-e3f15714-c9a3-44e4-832a-953cf2dbed61 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:00:52 user nova-compute[74039]: WARNING nova.compute.manager [req-4eeb2759-ca4e-42de-ad1e-f9c8579cb07e req-125d2cfe-2b36-4ad9-84f6-7a99c98ea66b service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Received unexpected event network-vif-plugged-e3f15714-c9a3-44e4-832a-953cf2dbed61 for instance with vm_state building and task_state spawning.
Oct 20 09:00:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:53 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:00:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:00:53 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Instance spawned successfully.
Oct 20 09:00:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:00:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:00:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:00:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:00:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:00:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:00:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:00:54 user nova-compute[74039]: INFO nova.compute.manager [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Took 5.45 seconds to spawn the instance on the hypervisor.
Oct 20 09:00:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:00:54 user nova-compute[74039]: INFO nova.compute.manager [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Took 6.40 seconds to build instance.
Oct 20 09:00:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ffcaa67-b801-4e3f-8a32-85b801ac5c94 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.512s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:00:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:59 user nova-compute[74039]: INFO nova.compute.manager [None req-95fd4144-e439-4b14-a1db-d9706321f55e tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Unrescuing
Oct 20 09:00:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-95fd4144-e439-4b14-a1db-d9706321f55e tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:00:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-95fd4144-e439-4b14-a1db-d9706321f55e tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquired lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:00:59 user nova-compute[74039]: DEBUG nova.network.neutron [None req-95fd4144-e439-4b14-a1db-d9706321f55e tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:00:59 user nova-compute[74039]: DEBUG nova.network.neutron [None req-95fd4144-e439-4b14-a1db-d9706321f55e tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Updating instance_info_cache with network_info: [{"id": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "address": "fa:16:3e:0c:c9:b0", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45971bed-5f", "ovs_interfaceid": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:00:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-95fd4144-e439-4b14-a1db-d9706321f55e tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Releasing lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:00:59 user nova-compute[74039]: DEBUG nova.objects.instance [None req-95fd4144-e439-4b14-a1db-d9706321f55e tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'flavor' on Instance uuid 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:00:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:00:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-0141f436-6ee5-458f-b4cb-2ea6c53b720b req-73df2c4c-5f85-48af-88c5-9a8daa7db61f service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-vif-unplugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:01:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0141f436-6ee5-458f-b4cb-2ea6c53b720b req-73df2c4c-5f85-48af-88c5-9a8daa7db61f service nova] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0141f436-6ee5-458f-b4cb-2ea6c53b720b req-73df2c4c-5f85-48af-88c5-9a8daa7db61f service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0141f436-6ee5-458f-b4cb-2ea6c53b720b req-73df2c4c-5f85-48af-88c5-9a8daa7db61f service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-0141f436-6ee5-458f-b4cb-2ea6c53b720b req-73df2c4c-5f85-48af-88c5-9a8daa7db61f service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] No waiting events found dispatching network-vif-unplugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:01:00 user nova-compute[74039]: WARNING nova.compute.manager [req-0141f436-6ee5-458f-b4cb-2ea6c53b720b req-73df2c4c-5f85-48af-88c5-9a8daa7db61f service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received unexpected event network-vif-unplugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 for instance with vm_state rescued and task_state unrescuing.
Oct 20 09:01:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:00 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Instance destroyed successfully.
Oct 20 09:01:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-f57f6904-e00c-467a-91de-7e5b44ebac29 req-bca1c3fc-a4ed-4000-bb95-9de4796fc8b2 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:01:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f57f6904-e00c-467a-91de-7e5b44ebac29 req-bca1c3fc-a4ed-4000-bb95-9de4796fc8b2 service nova] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f57f6904-e00c-467a-91de-7e5b44ebac29 req-bca1c3fc-a4ed-4000-bb95-9de4796fc8b2 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f57f6904-e00c-467a-91de-7e5b44ebac29 req-bca1c3fc-a4ed-4000-bb95-9de4796fc8b2 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-f57f6904-e00c-467a-91de-7e5b44ebac29 req-bca1c3fc-a4ed-4000-bb95-9de4796fc8b2 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] No waiting events found dispatching network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:01:02 user nova-compute[74039]: WARNING nova.compute.manager [req-f57f6904-e00c-467a-91de-7e5b44ebac29 req-bca1c3fc-a4ed-4000-bb95-9de4796fc8b2 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received unexpected event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 for instance with vm_state rescued and task_state unrescuing.
Oct 20 09:01:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:04 user nova-compute[74039]: DEBUG nova.compute.manager [req-aba72ed5-9ebe-4fa6-b2da-45ea1a2a3d01 req-f31e0db4-5280-4a43-8d0f-582895af1a9e service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:01:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-aba72ed5-9ebe-4fa6-b2da-45ea1a2a3d01 req-f31e0db4-5280-4a43-8d0f-582895af1a9e service nova] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-aba72ed5-9ebe-4fa6-b2da-45ea1a2a3d01 req-f31e0db4-5280-4a43-8d0f-582895af1a9e service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-aba72ed5-9ebe-4fa6-b2da-45ea1a2a3d01 req-f31e0db4-5280-4a43-8d0f-582895af1a9e service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:04 user nova-compute[74039]: DEBUG nova.compute.manager [req-aba72ed5-9ebe-4fa6-b2da-45ea1a2a3d01 req-f31e0db4-5280-4a43-8d0f-582895af1a9e service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] No waiting events found dispatching network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:01:04 user nova-compute[74039]: WARNING nova.compute.manager [req-aba72ed5-9ebe-4fa6-b2da-45ea1a2a3d01 req-f31e0db4-5280-4a43-8d0f-582895af1a9e service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received unexpected event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 for instance with vm_state rescued and task_state unrescuing.
Oct 20 09:01:04 user nova-compute[74039]: DEBUG nova.compute.manager [req-aba72ed5-9ebe-4fa6-b2da-45ea1a2a3d01 req-f31e0db4-5280-4a43-8d0f-582895af1a9e service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:01:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-aba72ed5-9ebe-4fa6-b2da-45ea1a2a3d01 req-f31e0db4-5280-4a43-8d0f-582895af1a9e service nova] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-aba72ed5-9ebe-4fa6-b2da-45ea1a2a3d01 req-f31e0db4-5280-4a43-8d0f-582895af1a9e service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-aba72ed5-9ebe-4fa6-b2da-45ea1a2a3d01 req-f31e0db4-5280-4a43-8d0f-582895af1a9e service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:04 user nova-compute[74039]: DEBUG nova.compute.manager [req-aba72ed5-9ebe-4fa6-b2da-45ea1a2a3d01 req-f31e0db4-5280-4a43-8d0f-582895af1a9e service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] No waiting events found dispatching network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:01:04 user nova-compute[74039]: WARNING nova.compute.manager [req-aba72ed5-9ebe-4fa6-b2da-45ea1a2a3d01 req-f31e0db4-5280-4a43-8d0f-582895af1a9e service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received unexpected event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 for instance with vm_state rescued and task_state unrescuing.
Oct 20 09:01:04 user nova-compute[74039]: DEBUG nova.compute.manager [None req-95fd4144-e439-4b14-a1db-d9706321f55e tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:01:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:17 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Starting finish_migration {{(pid=74039) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 20 09:01:17 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Instance directory exists: not creating {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 09:01:17 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Creating image(s)
Oct 20 09:01:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.236s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:17 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk. size=21474836480 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:01:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk 21474836480 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk 21474836480" returned: 0 in 0.061s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Did not create local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Ensure instance console log exists: /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Start _get_guest_xml network_info=[{"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1516684708-network", "vif_mac": "fa:16:3e:0d:87:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '269bd883-e461-4f47-9803-50b956d1d21b', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZFEAJfq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ebaa4804-32e5-4fff-9562-0587ff7ca4ed', 'attached_at': '2023-10-20T09:01:17.000000', 'detached_at': '', 'volume_id': 'fddcdc2d-8bc1-4ba3-90c0-5607af95bc84', 'serial': 'fddcdc2d-8bc1-4ba3-90c0-5607af95bc84'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:01:18 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:01:18 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:01:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZFEAJfq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:01:18 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:01:18 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:01:18 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ec812b-2e34-449e-b74a-7dd0aab495c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:01:18 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a391491c-5873-4d27-9248-347c3dc71c66]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84] added
Oct 20 09:01:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc5b6ee-2c8e-4de0-83cb-0288924ddf3c]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8d4569-4759-46f2-b9fb-0d62daaebc9b]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZFEAJfq {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZFEAJfq" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed69f21c-0c81-46fb-bd16-f911a71eec33]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wZFEAJfq'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbeac21-1f72-4b0f-8c88-672bf8056708]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28a16c8-f984-436c-876c-6c6fe7398866]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:01:18 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 09:01:18 user nova-compute[74039]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)
Oct 20 09:01:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:01:18 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 09:01:18 user nova-compute[74039]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)
Oct 20 09:01:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ea7685-301a-4d43-9b4e-26e42602cdee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260]
Oct 20 09:01:18 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260] successful.
Oct 20 09:01:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9f8a17-9e44-4f80-9312-06815af5362b]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[593d6bf9-6598-4a62-b032-c177f071f51a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:01:18 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 09:01:18 user nova-compute[74039]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)
Oct 20 09:01:18 user nova-compute[74039]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:01:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:01:18 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 09:01:18 user nova-compute[74039]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)
Oct 20 09:01:18 user nova-compute[74039]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:01:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7205432a-a03b-4fae-b6db-0725a8f85810]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:01:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZFEAJfq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.433s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] <== connect_volume: return (1436ms) {'type': 'block', 'scsi_wwn': '23933633139383531', 'path': '/dev/sde'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933633139383531', 'path': '/dev/sde'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-981664831',display_name='tempest-ServerActionsTestOtherB-server-981664831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-981664831',id=14,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLks5fH3OqnFIJYbiqhEyJYFZHff7b4Ae9JDwAsMmBzcCMiYxaXPw5gTAg3NjSBwdB4e4WBubdaiWR0mkFHpfIFMVWW5rKzlKquVWH/exNlZL5M7mfGJM5jL4+NyXysGbg==',key_name='tempest-keypair-748521120',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:55:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='da44286b6f5b45fe9ccbd881754a9b3c',ramdisk_id='',reservation_id='r-2fnz9nzy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1010421968',owner_user_name='tempest-ServerActionsTestOtherB-1010421968-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='994701e77d9740f4a7a18390f9438996',uuid=ebaa4804-32e5-4fff-9562-0587ff7ca4ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1516684708-network", "vif_mac": "fa:16:3e:0d:87:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Converting VIF {"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1516684708-network", "vif_mac": "fa:16:3e:0d:87:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:01:19 user nova-compute[74039]:   <uuid>ebaa4804-32e5-4fff-9562-0587ff7ca4ed</uuid>
Oct 20 09:01:19 user nova-compute[74039]:   <name>instance-0000000e</name>
Oct 20 09:01:19 user nova-compute[74039]:   <memory>2097152</memory>
Oct 20 09:01:19 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:01:19 user nova-compute[74039]:   <metadata>
Oct 20 09:01:19 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:01:19 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:01:19 user nova-compute[74039]:       <nova:name>tempest-ServerActionsTestOtherB-server-981664831</nova:name>
Oct 20 09:01:19 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:01:18</nova:creationTime>
Oct 20 09:01:19 user nova-compute[74039]:       <nova:flavor name="m1.small">
Oct 20 09:01:19 user nova-compute[74039]:         <nova:memory>2048</nova:memory>
Oct 20 09:01:19 user nova-compute[74039]:         <nova:disk>20</nova:disk>
Oct 20 09:01:19 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:01:19 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:01:19 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:01:19 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:01:19 user nova-compute[74039]:       <nova:owner>
Oct 20 09:01:19 user nova-compute[74039]:         <nova:user uuid="994701e77d9740f4a7a18390f9438996">tempest-ServerActionsTestOtherB-1010421968-project-member</nova:user>
Oct 20 09:01:19 user nova-compute[74039]:         <nova:project uuid="da44286b6f5b45fe9ccbd881754a9b3c">tempest-ServerActionsTestOtherB-1010421968</nova:project>
Oct 20 09:01:19 user nova-compute[74039]:       </nova:owner>
Oct 20 09:01:19 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:01:19 user nova-compute[74039]:       <nova:ports>
Oct 20 09:01:19 user nova-compute[74039]:         <nova:port uuid="e7d9d83f-1522-47f7-ac4c-7dd56facfea7">
Oct 20 09:01:19 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 09:01:19 user nova-compute[74039]:         </nova:port>
Oct 20 09:01:19 user nova-compute[74039]:       </nova:ports>
Oct 20 09:01:19 user nova-compute[74039]:     </nova:instance>
Oct 20 09:01:19 user nova-compute[74039]:   </metadata>
Oct 20 09:01:19 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:01:19 user nova-compute[74039]:     <system>
Oct 20 09:01:19 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:01:19 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:01:19 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:01:19 user nova-compute[74039]:       <entry name="serial">ebaa4804-32e5-4fff-9562-0587ff7ca4ed</entry>
Oct 20 09:01:19 user nova-compute[74039]:       <entry name="uuid">ebaa4804-32e5-4fff-9562-0587ff7ca4ed</entry>
Oct 20 09:01:19 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:01:19 user nova-compute[74039]:     </system>
Oct 20 09:01:19 user nova-compute[74039]:   </sysinfo>
Oct 20 09:01:19 user nova-compute[74039]:   <os>
Oct 20 09:01:19 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:01:19 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:01:19 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:01:19 user nova-compute[74039]:   </os>
Oct 20 09:01:19 user nova-compute[74039]:   <features>
Oct 20 09:01:19 user nova-compute[74039]:     <acpi/>
Oct 20 09:01:19 user nova-compute[74039]:     <apic/>
Oct 20 09:01:19 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:01:19 user nova-compute[74039]:   </features>
Oct 20 09:01:19 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:01:19 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:01:19 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:01:19 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:01:19 user nova-compute[74039]:   </clock>
Oct 20 09:01:19 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:01:19 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:01:19 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:01:19 user nova-compute[74039]:   </cpu>
Oct 20 09:01:19 user nova-compute[74039]:   <devices>
Oct 20 09:01:19 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:01:19 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:01:19 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk"/>
Oct 20 09:01:19 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:01:19 user nova-compute[74039]:     </disk>
Oct 20 09:01:19 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 09:01:19 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:01:19 user nova-compute[74039]:       <source dev="/dev/sde"/>
Oct 20 09:01:19 user nova-compute[74039]:       <target dev="vdb" bus="virtio"/>
Oct 20 09:01:19 user nova-compute[74039]:       <serial>fddcdc2d-8bc1-4ba3-90c0-5607af95bc84</serial>
Oct 20 09:01:19 user nova-compute[74039]:     </disk>
Oct 20 09:01:19 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:01:19 user nova-compute[74039]:       <mac address="fa:16:3e:0d:87:c4"/>
Oct 20 09:01:19 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:01:19 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:01:19 user nova-compute[74039]:       <target dev="tape7d9d83f-15"/>
Oct 20 09:01:19 user nova-compute[74039]:     </interface>
Oct 20 09:01:19 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:01:19 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/console.log" append="off"/>
Oct 20 09:01:19 user nova-compute[74039]:     </serial>
Oct 20 09:01:19 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:01:19 user nova-compute[74039]:     <video>
Oct 20 09:01:19 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:01:19 user nova-compute[74039]:     </video>
Oct 20 09:01:19 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:01:19 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:01:19 user nova-compute[74039]:     </rng>
Oct 20 09:01:19 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:01:19 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:01:19 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:01:19 user nova-compute[74039]:     </memballoon>
Oct 20 09:01:19 user nova-compute[74039]:   </devices>
Oct 20 09:01:19 user nova-compute[74039]: </domain>
Oct 20 09:01:19 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-981664831',display_name='tempest-ServerActionsTestOtherB-server-981664831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-981664831',id=14,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLks5fH3OqnFIJYbiqhEyJYFZHff7b4Ae9JDwAsMmBzcCMiYxaXPw5gTAg3NjSBwdB4e4WBubdaiWR0mkFHpfIFMVWW5rKzlKquVWH/exNlZL5M7mfGJM5jL4+NyXysGbg==',key_name='tempest-keypair-748521120',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:55:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='da44286b6f5b45fe9ccbd881754a9b3c',ramdisk_id='',reservation_id='r-2fnz9nzy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1010421968',owner_user_name='tempest-ServerActionsTestOtherB-1010421968-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T08:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='994701e77d9740f4a7a18390f9438996',uuid=ebaa4804-32e5-4fff-9562-0587ff7ca4ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1516684708-network", "vif_mac": "fa:16:3e:0d:87:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Converting VIF {"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1516684708-network", "vif_mac": "fa:16:3e:0d:87:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG os_vif [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5add5f42-8609-5905-a571-e6b6f840a84e', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7d9d83f-15, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7d9d83f-15, col_values=(('qos', UUID('924f2e4c-0982-43e7-903b-1f03f7891ee8')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7d9d83f-15, col_values=(('external_ids', {'iface-id': 'e7d9d83f-1522-47f7-ac4c-7dd56facfea7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:87:c4', 'vm-uuid': 'ebaa4804-32e5-4fff-9562-0587ff7ca4ed'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:19 user nova-compute[74039]: INFO os_vif [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15')
Oct 20 09:01:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:01:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] No VIF found with MAC fa:16:3e:0d:87:c4, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:01:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Rebuilding the list of instances to heal {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG nova.objects.instance [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lazy-loading 'info_cache' on Instance uuid 9fe77a96-fcb5-4410-85cc-58d925548e03 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG nova.compute.manager [req-f4c62aca-d266-45df-82fe-9036a8c38d82 req-8b8390c5-baa9-4995-a8a3-cdd78e9f9ebe service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received event network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f4c62aca-d266-45df-82fe-9036a8c38d82 req-8b8390c5-baa9-4995-a8a3-cdd78e9f9ebe service nova] Acquiring lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f4c62aca-d266-45df-82fe-9036a8c38d82 req-8b8390c5-baa9-4995-a8a3-cdd78e9f9ebe service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f4c62aca-d266-45df-82fe-9036a8c38d82 req-8b8390c5-baa9-4995-a8a3-cdd78e9f9ebe service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG nova.compute.manager [req-f4c62aca-d266-45df-82fe-9036a8c38d82 req-8b8390c5-baa9-4995-a8a3-cdd78e9f9ebe service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] No waiting events found dispatching network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:01:22 user nova-compute[74039]: WARNING nova.compute.manager [req-f4c62aca-d266-45df-82fe-9036a8c38d82 req-8b8390c5-baa9-4995-a8a3-cdd78e9f9ebe service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received unexpected event network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 for instance with vm_state active and task_state resize_finish.
Oct 20 09:01:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Updating instance_info_cache with network_info: [{"id": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "address": "fa:16:3e:63:75:a3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9fe7711-d5", "ovs_interfaceid": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-9fe77a96-fcb5-4410-85cc-58d925548e03" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:01:22 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:01:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "4f5d98e3-c1f6-4617-8847-b975e2c23990" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:01:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:23 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:01:23 user nova-compute[74039]: INFO nova.compute.claims [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Claim successful on node user
Oct 20 09:01:23 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:01:23 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:01:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:01:24 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:01:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG nova.policy [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '521e273869c2472195ea7f956c47cfca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976dd013512742419a09db1bcd91c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:01:24 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Creating image(s)
Oct 20 09:01:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "/opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "/opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:01:24 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Instance running successfully.
Oct 20 09:01:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Failed to set time: agent not configured {{(pid=74039) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d84a10ae-1f7f-48d1-974a-eca1b1918121 tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] finish_migration finished successfully. {{(pid=74039) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG nova.compute.manager [req-cade2771-7241-44b9-beb3-6491e321108e req-5e8dcbc7-a4b9-4e7d-935f-e94d6fd66bbd service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received event network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-cade2771-7241-44b9-beb3-6491e321108e req-5e8dcbc7-a4b9-4e7d-935f-e94d6fd66bbd service nova] Acquiring lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-cade2771-7241-44b9-beb3-6491e321108e req-5e8dcbc7-a4b9-4e7d-935f-e94d6fd66bbd service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-cade2771-7241-44b9-beb3-6491e321108e req-5e8dcbc7-a4b9-4e7d-935f-e94d6fd66bbd service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG nova.compute.manager [req-cade2771-7241-44b9-beb3-6491e321108e req-5e8dcbc7-a4b9-4e7d-935f-e94d6fd66bbd service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] No waiting events found dispatching network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:01:24 user nova-compute[74039]: WARNING nova.compute.manager [req-cade2771-7241-44b9-beb3-6491e321108e req-5e8dcbc7-a4b9-4e7d-935f-e94d6fd66bbd service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received unexpected event network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 for instance with vm_state active and task_state resize_finish.
Oct 20 09:01:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.268s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.220s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk 1073741824" returned: 0 in 0.064s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.212s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:25 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:01:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:25 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Successfully created port: 558d1748-92c4-4e5d-a341-b3b5c0389c45 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:01:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:25 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Cannot resize image /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:01:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:01:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Ensure instance console log exists: /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:01:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:25 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Successfully updated port: 558d1748-92c4-4e5d-a341-b3b5c0389c45 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:01:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "refresh_cache-4f5d98e3-c1f6-4617-8847-b975e2c23990" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:01:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquired lock "refresh_cache-4f5d98e3-c1f6-4617-8847-b975e2c23990" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:01:25 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-90614e62-281a-4d30-9b92-fd6798ca6db8 req-719d966a-20fe-4e4f-a9f4-e5d07d6b6b43 service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Received event network-changed-558d1748-92c4-4e5d-a341-b3b5c0389c45 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-90614e62-281a-4d30-9b92-fd6798ca6db8 req-719d966a-20fe-4e4f-a9f4-e5d07d6b6b43 service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Refreshing instance network info cache due to event network-changed-558d1748-92c4-4e5d-a341-b3b5c0389c45. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-90614e62-281a-4d30-9b92-fd6798ca6db8 req-719d966a-20fe-4e4f-a9f4-e5d07d6b6b43 service nova] Acquiring lock "refresh_cache-4f5d98e3-c1f6-4617-8847-b975e2c23990" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Updating instance_info_cache with network_info: [{"id": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "address": "fa:16:3e:00:9a:92", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558d1748-92", "ovs_interfaceid": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Releasing lock "refresh_cache-4f5d98e3-c1f6-4617-8847-b975e2c23990" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Instance network_info: |[{"id": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "address": "fa:16:3e:00:9a:92", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558d1748-92", "ovs_interfaceid": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-90614e62-281a-4d30-9b92-fd6798ca6db8 req-719d966a-20fe-4e4f-a9f4-e5d07d6b6b43 service nova] Acquired lock "refresh_cache-4f5d98e3-c1f6-4617-8847-b975e2c23990" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.network.neutron [req-90614e62-281a-4d30-9b92-fd6798ca6db8 req-719d966a-20fe-4e4f-a9f4-e5d07d6b6b43 service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Refreshing network info cache for port 558d1748-92c4-4e5d-a341-b3b5c0389c45 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Start _get_guest_xml network_info=[{"id": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "address": "fa:16:3e:00:9a:92", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558d1748-92", "ovs_interfaceid": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:01:26 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:01:26 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:01:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-608517850',display_name='tempest-TestStampPattern-server-608517850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-608517850',id=22,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCoYAYLQAIK0eZwZlLZsSngPmiUuCavbZvZuAXBNr5s5G9UwpQhAO/A9UrKL/K+8+IO1hH8/ytdfxCHYdYzvPmR2tPylGWVvOVVSYReebeMYYdncFm19RRSUV+eGOaikQ==',key_name='tempest-TestStampPattern-2133476221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='976dd013512742419a09db1bcd91c33f',ramdisk_id='',reservation_id='r-2u29q444',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1484113572',owner_user_name='tempest-TestStampPattern-1484113572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:01:24Z,user_data=None,user_id='521e273869c2472195ea7f956c47cfca',uuid=4f5d98e3-c1f6-4617-8847-b975e2c23990,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "address": "fa:16:3e:00:9a:92", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558d1748-92", "ovs_interfaceid": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Converting VIF {"id": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "address": "fa:16:3e:00:9a:92", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558d1748-92", "ovs_interfaceid": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:9a:92,bridge_name='br-int',has_traffic_filtering=True,id=558d1748-92c4-4e5d-a341-b3b5c0389c45,network=Network(95c63035-cc80-442a-b660-301acdda2a79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558d1748-92') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.objects.instance [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f5d98e3-c1f6-4617-8847-b975e2c23990 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:01:26 user nova-compute[74039]:   <uuid>4f5d98e3-c1f6-4617-8847-b975e2c23990</uuid>
Oct 20 09:01:26 user nova-compute[74039]:   <name>instance-00000016</name>
Oct 20 09:01:26 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:01:26 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:01:26 user nova-compute[74039]:   <metadata>
Oct 20 09:01:26 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:01:26 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:01:26 user nova-compute[74039]:       <nova:name>tempest-TestStampPattern-server-608517850</nova:name>
Oct 20 09:01:26 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:01:26</nova:creationTime>
Oct 20 09:01:26 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:01:26 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:01:26 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:01:26 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:01:26 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:01:26 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:01:26 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:01:26 user nova-compute[74039]:       <nova:owner>
Oct 20 09:01:26 user nova-compute[74039]:         <nova:user uuid="521e273869c2472195ea7f956c47cfca">tempest-TestStampPattern-1484113572-project-member</nova:user>
Oct 20 09:01:26 user nova-compute[74039]:         <nova:project uuid="976dd013512742419a09db1bcd91c33f">tempest-TestStampPattern-1484113572</nova:project>
Oct 20 09:01:26 user nova-compute[74039]:       </nova:owner>
Oct 20 09:01:26 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:01:26 user nova-compute[74039]:       <nova:ports>
Oct 20 09:01:26 user nova-compute[74039]:         <nova:port uuid="558d1748-92c4-4e5d-a341-b3b5c0389c45">
Oct 20 09:01:26 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 09:01:26 user nova-compute[74039]:         </nova:port>
Oct 20 09:01:26 user nova-compute[74039]:       </nova:ports>
Oct 20 09:01:26 user nova-compute[74039]:     </nova:instance>
Oct 20 09:01:26 user nova-compute[74039]:   </metadata>
Oct 20 09:01:26 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:01:26 user nova-compute[74039]:     <system>
Oct 20 09:01:26 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:01:26 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:01:26 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:01:26 user nova-compute[74039]:       <entry name="serial">4f5d98e3-c1f6-4617-8847-b975e2c23990</entry>
Oct 20 09:01:26 user nova-compute[74039]:       <entry name="uuid">4f5d98e3-c1f6-4617-8847-b975e2c23990</entry>
Oct 20 09:01:26 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:01:26 user nova-compute[74039]:     </system>
Oct 20 09:01:26 user nova-compute[74039]:   </sysinfo>
Oct 20 09:01:26 user nova-compute[74039]:   <os>
Oct 20 09:01:26 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:01:26 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:01:26 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:01:26 user nova-compute[74039]:   </os>
Oct 20 09:01:26 user nova-compute[74039]:   <features>
Oct 20 09:01:26 user nova-compute[74039]:     <acpi/>
Oct 20 09:01:26 user nova-compute[74039]:     <apic/>
Oct 20 09:01:26 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:01:26 user nova-compute[74039]:   </features>
Oct 20 09:01:26 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:01:26 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:01:26 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:01:26 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:01:26 user nova-compute[74039]:   </clock>
Oct 20 09:01:26 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:01:26 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:01:26 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:01:26 user nova-compute[74039]:   </cpu>
Oct 20 09:01:26 user nova-compute[74039]:   <devices>
Oct 20 09:01:26 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:01:26 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:01:26 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk"/>
Oct 20 09:01:26 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:01:26 user nova-compute[74039]:     </disk>
Oct 20 09:01:26 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:01:26 user nova-compute[74039]:       <mac address="fa:16:3e:00:9a:92"/>
Oct 20 09:01:26 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:01:26 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:01:26 user nova-compute[74039]:       <target dev="tap558d1748-92"/>
Oct 20 09:01:26 user nova-compute[74039]:     </interface>
Oct 20 09:01:26 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:01:26 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/console.log" append="off"/>
Oct 20 09:01:26 user nova-compute[74039]:     </serial>
Oct 20 09:01:26 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:01:26 user nova-compute[74039]:     <video>
Oct 20 09:01:26 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:01:26 user nova-compute[74039]:     </video>
Oct 20 09:01:26 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:01:26 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:01:26 user nova-compute[74039]:     </rng>
Oct 20 09:01:26 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:01:26 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:01:26 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:01:26 user nova-compute[74039]:     </memballoon>
Oct 20 09:01:26 user nova-compute[74039]:   </devices>
Oct 20 09:01:26 user nova-compute[74039]: </domain>
Oct 20 09:01:26 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:01:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-608517850',display_name='tempest-TestStampPattern-server-608517850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-608517850',id=22,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCoYAYLQAIK0eZwZlLZsSngPmiUuCavbZvZuAXBNr5s5G9UwpQhAO/A9UrKL/K+8+IO1hH8/ytdfxCHYdYzvPmR2tPylGWVvOVVSYReebeMYYdncFm19RRSUV+eGOaikQ==',key_name='tempest-TestStampPattern-2133476221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='976dd013512742419a09db1bcd91c33f',ramdisk_id='',reservation_id='r-2u29q444',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1484113572',owner_user_name='tempest-TestStampPattern-1484113572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:01:24Z,user_data=None,user_id='521e273869c2472195ea7f956c47cfca',uuid=4f5d98e3-c1f6-4617-8847-b975e2c23990,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "address": "fa:16:3e:00:9a:92", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558d1748-92", "ovs_interfaceid": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Converting VIF {"id": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "address": "fa:16:3e:00:9a:92", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558d1748-92", "ovs_interfaceid": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:9a:92,bridge_name='br-int',has_traffic_filtering=True,id=558d1748-92c4-4e5d-a341-b3b5c0389c45,network=Network(95c63035-cc80-442a-b660-301acdda2a79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558d1748-92') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG os_vif [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:9a:92,bridge_name='br-int',has_traffic_filtering=True,id=558d1748-92c4-4e5d-a341-b3b5c0389c45,network=Network(95c63035-cc80-442a-b660-301acdda2a79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558d1748-92') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b3296c87-95fd-5518-ad92-133fdbbc9889', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap558d1748-92, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap558d1748-92, col_values=(('qos', UUID('0bd3f814-2b74-4f37-8552-806966fc92e1')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap558d1748-92, col_values=(('external_ids', {'iface-id': '558d1748-92c4-4e5d-a341-b3b5c0389c45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:9a:92', 'vm-uuid': '4f5d98e3-c1f6-4617-8847-b975e2c23990'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:26 user nova-compute[74039]: INFO os_vif [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:9a:92,bridge_name='br-int',has_traffic_filtering=True,id=558d1748-92c4-4e5d-a341-b3b5c0389c45,network=Network(95c63035-cc80-442a-b660-301acdda2a79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558d1748-92')
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] No VIF found with MAC fa:16:3e:00:9a:92, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.network.neutron [req-90614e62-281a-4d30-9b92-fd6798ca6db8 req-719d966a-20fe-4e4f-a9f4-e5d07d6b6b43 service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Updated VIF entry in instance network info cache for port 558d1748-92c4-4e5d-a341-b3b5c0389c45. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG nova.network.neutron [req-90614e62-281a-4d30-9b92-fd6798ca6db8 req-719d966a-20fe-4e4f-a9f4-e5d07d6b6b43 service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Updating instance_info_cache with network_info: [{"id": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "address": "fa:16:3e:00:9a:92", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558d1748-92", "ovs_interfaceid": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:01:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-90614e62-281a-4d30-9b92-fd6798ca6db8 req-719d966a-20fe-4e4f-a9f4-e5d07d6b6b43 service nova] Releasing lock "refresh_cache-4f5d98e3-c1f6-4617-8847-b975e2c23990" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:01:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-3c1ce51f-7ece-47a0-a402-24d344e89416 req-bfa7c9a7-c59d-4316-8b5d-5aad4ca90cf7 service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Received event network-vif-plugged-558d1748-92c4-4e5d-a341-b3b5c0389c45 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:01:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3c1ce51f-7ece-47a0-a402-24d344e89416 req-bfa7c9a7-c59d-4316-8b5d-5aad4ca90cf7 service nova] Acquiring lock "4f5d98e3-c1f6-4617-8847-b975e2c23990-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3c1ce51f-7ece-47a0-a402-24d344e89416 req-bfa7c9a7-c59d-4316-8b5d-5aad4ca90cf7 service nova] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-3c1ce51f-7ece-47a0-a402-24d344e89416 req-bfa7c9a7-c59d-4316-8b5d-5aad4ca90cf7 service nova] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-3c1ce51f-7ece-47a0-a402-24d344e89416 req-bfa7c9a7-c59d-4316-8b5d-5aad4ca90cf7 service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] No waiting events found dispatching network-vif-plugged-558d1748-92c4-4e5d-a341-b3b5c0389c45 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:01:28 user nova-compute[74039]: WARNING nova.compute.manager [req-3c1ce51f-7ece-47a0-a402-24d344e89416 req-bfa7c9a7-c59d-4316-8b5d-5aad4ca90cf7 service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Received unexpected event network-vif-plugged-558d1748-92c4-4e5d-a341-b3b5c0389c45 for instance with vm_state building and task_state spawning.
Oct 20 09:01:28 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:01:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:28 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:01:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:01:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-4000c745-8a82-4d96-ab40-329dc746eee8 req-fa6079c2-5744-4e46-8f07-6df54de6aacd service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Received event network-vif-plugged-558d1748-92c4-4e5d-a341-b3b5c0389c45 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4000c745-8a82-4d96-ab40-329dc746eee8 req-fa6079c2-5744-4e46-8f07-6df54de6aacd service nova] Acquiring lock "4f5d98e3-c1f6-4617-8847-b975e2c23990-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4000c745-8a82-4d96-ab40-329dc746eee8 req-fa6079c2-5744-4e46-8f07-6df54de6aacd service nova] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4000c745-8a82-4d96-ab40-329dc746eee8 req-fa6079c2-5744-4e46-8f07-6df54de6aacd service nova] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-4000c745-8a82-4d96-ab40-329dc746eee8 req-fa6079c2-5744-4e46-8f07-6df54de6aacd service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] No waiting events found dispatching network-vif-plugged-558d1748-92c4-4e5d-a341-b3b5c0389c45 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:01:30 user nova-compute[74039]: WARNING nova.compute.manager [req-4000c745-8a82-4d96-ab40-329dc746eee8 req-fa6079c2-5744-4e46-8f07-6df54de6aacd service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Received unexpected event network-vif-plugged-558d1748-92c4-4e5d-a341-b3b5c0389c45 for instance with vm_state building and task_state spawning.
Oct 20 09:01:30 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:01:30 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Instance spawned successfully.
Oct 20 09:01:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:30 user nova-compute[74039]: INFO nova.compute.manager [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Took 6.58 seconds to spawn the instance on the hypervisor.
Oct 20 09:01:30 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:01:30 user nova-compute[74039]: INFO nova.compute.manager [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Took 7.55 seconds to build instance.
Oct 20 09:01:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9c743b0-4d9b-4c7f-a851-7619623efa51 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.658s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:01:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:01:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:01:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "00e09d93-3077-4770-abfd-b82ece646997" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "00e09d93-3077-4770-abfd-b82ece646997" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:32 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:01:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:32 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:01:32 user nova-compute[74039]: INFO nova.compute.claims [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Claim successful on node user
Oct 20 09:01:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.658s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:01:33 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:01:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG nova.policy [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb823f0374a04657be729eb153160659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a58985dce3491d8e45e6e468e0e549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:01:33 user nova-compute[74039]: INFO nova.virt.block_device [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Booting with volume 761590b5-010a-47bc-9316-294b487cf5c1 at /dev/vda
Oct 20 09:01:33 user nova-compute[74039]: DEBUG os_brick.utils [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bbf53f-7dae-4d2f-9266-5080aa7b1ac0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd68bb1-69c1-466b-abf5-8f66452fbc56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d795f1f-99df-400a-a738-faeafc33d692]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[de72f5e9-6c92-4b31-9083-7eacecd3ea43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:34 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:01:34 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7545MB free_disk=25.50674819946289GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:01:34 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:01:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f426c84-27a9-4201-8274-66639bb2cc17]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG os_brick.utils [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] <== get_connector_properties: return (601ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Updating existing volume attachment record: 98a92e16-989a-49ac-ab58-3370680cbb67 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Successfully created port: d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Applying migration context for instance ebaa4804-32e5-4fff-9562-0587ff7ca4ed as it has an incoming, in-progress migration 242a5b7f-5026-4dba-b30a-aeb328c19394. Migration status is finished {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 09:01:34 user nova-compute[74039]: INFO nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Updating resource usage from migration 242a5b7f-5026-4dba-b30a-aeb328c19394
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 9fe77a96-fcb5-4410-85cc-58d925548e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c8054dbd-c0ae-45d2-af95-dae7d05f8c69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 03e487d1-90aa-436d-9c2f-468f9791af91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance d61f84a9-85ea-40aa-b21e-45064b3bc090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Migration 242a5b7f-5026-4dba-b30a-aeb328c19394 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance ebaa4804-32e5-4fff-9562-0587ff7ca4ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 90473cd0-7bf8-478e-af9d-771f720a10f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 8af05cc2-c1b2-4187-b16e-5fbeb006de6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4f5d98e3-c1f6-4617-8847-b975e2c23990 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 00e09d93-3077-4770-abfd-b82ece646997 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:01:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.719s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:35 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Successfully updated port: d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:01:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:01:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquired lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:01:35 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:01:35 user nova-compute[74039]: DEBUG nova.compute.manager [req-b6605794-aa42-4f06-869b-2c225aaf13ee req-86eb91bb-49f3-488f-a76f-69570f082ee1 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received event network-changed-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:01:35 user nova-compute[74039]: DEBUG nova.compute.manager [req-b6605794-aa42-4f06-869b-2c225aaf13ee req-86eb91bb-49f3-488f-a76f-69570f082ee1 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Refreshing instance network info cache due to event network-changed-d5f62963-3776-4468-b582-f2d31bf6a2be. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:01:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b6605794-aa42-4f06-869b-2c225aaf13ee req-86eb91bb-49f3-488f-a76f-69570f082ee1 service nova] Acquiring lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:01:35 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:01:35 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Updating instance_info_cache with network_info: [{"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:01:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Releasing lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:01:35 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Instance network_info: |[{"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:01:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b6605794-aa42-4f06-869b-2c225aaf13ee req-86eb91bb-49f3-488f-a76f-69570f082ee1 service nova] Acquired lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:01:35 user nova-compute[74039]: DEBUG nova.network.neutron [req-b6605794-aa42-4f06-869b-2c225aaf13ee req-86eb91bb-49f3-488f-a76f-69570f082ee1 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Refreshing network info cache for port d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:01:35 user nova-compute[74039]: DEBUG nova.network.neutron [req-b6605794-aa42-4f06-869b-2c225aaf13ee req-86eb91bb-49f3-488f-a76f-69570f082ee1 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Updated VIF entry in instance network info cache for port d5f62963-3776-4468-b582-f2d31bf6a2be. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:01:35 user nova-compute[74039]: DEBUG nova.network.neutron [req-b6605794-aa42-4f06-869b-2c225aaf13ee req-86eb91bb-49f3-488f-a76f-69570f082ee1 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Updating instance_info_cache with network_info: [{"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:01:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b6605794-aa42-4f06-869b-2c225aaf13ee req-86eb91bb-49f3-488f-a76f-69570f082ee1 service nova] Releasing lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:01:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:41 user nova-compute[74039]: DEBUG nova.compute.manager [req-4cffc6a9-f567-492f-b311-2dad10f8899e req-abda9caa-cfec-411d-838c-4054780e955f service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Received event network-changed-cb325581-30da-432f-846d-402483dd60d4 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:01:41 user nova-compute[74039]: DEBUG nova.compute.manager [req-4cffc6a9-f567-492f-b311-2dad10f8899e req-abda9caa-cfec-411d-838c-4054780e955f service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Refreshing instance network info cache due to event network-changed-cb325581-30da-432f-846d-402483dd60d4. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:01:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4cffc6a9-f567-492f-b311-2dad10f8899e req-abda9caa-cfec-411d-838c-4054780e955f service nova] Acquiring lock "refresh_cache-90473cd0-7bf8-478e-af9d-771f720a10f7" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:01:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4cffc6a9-f567-492f-b311-2dad10f8899e req-abda9caa-cfec-411d-838c-4054780e955f service nova] Acquired lock "refresh_cache-90473cd0-7bf8-478e-af9d-771f720a10f7" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:01:41 user nova-compute[74039]: DEBUG nova.network.neutron [req-4cffc6a9-f567-492f-b311-2dad10f8899e req-abda9caa-cfec-411d-838c-4054780e955f service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Refreshing network info cache for port cb325581-30da-432f-846d-402483dd60d4 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:01:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "90473cd0-7bf8-478e-af9d-771f720a10f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "90473cd0-7bf8-478e-af9d-771f720a10f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "90473cd0-7bf8-478e-af9d-771f720a10f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "90473cd0-7bf8-478e-af9d-771f720a10f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "90473cd0-7bf8-478e-af9d-771f720a10f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:42 user nova-compute[74039]: INFO nova.compute.manager [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Terminating instance
Oct 20 09:01:42 user nova-compute[74039]: DEBUG nova.compute.manager [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:01:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:42 user nova-compute[74039]: DEBUG nova.network.neutron [req-4cffc6a9-f567-492f-b311-2dad10f8899e req-abda9caa-cfec-411d-838c-4054780e955f service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Updated VIF entry in instance network info cache for port cb325581-30da-432f-846d-402483dd60d4. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:01:42 user nova-compute[74039]: DEBUG nova.network.neutron [req-4cffc6a9-f567-492f-b311-2dad10f8899e req-abda9caa-cfec-411d-838c-4054780e955f service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Updating instance_info_cache with network_info: [{"id": "cb325581-30da-432f-846d-402483dd60d4", "address": "fa:16:3e:93:21:b6", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb325581-30", "ovs_interfaceid": "cb325581-30da-432f-846d-402483dd60d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:01:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4cffc6a9-f567-492f-b311-2dad10f8899e req-abda9caa-cfec-411d-838c-4054780e955f service nova] Releasing lock "refresh_cache-90473cd0-7bf8-478e-af9d-771f720a10f7" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:01:42 user nova-compute[74039]: DEBUG nova.compute.manager [req-1813c4f9-c4a0-497f-bc6b-80292fa09ed6 req-f26a1607-31e4-4ec1-9087-48896c102cb0 service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Received event network-vif-unplugged-cb325581-30da-432f-846d-402483dd60d4 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:01:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1813c4f9-c4a0-497f-bc6b-80292fa09ed6 req-f26a1607-31e4-4ec1-9087-48896c102cb0 service nova] Acquiring lock "90473cd0-7bf8-478e-af9d-771f720a10f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1813c4f9-c4a0-497f-bc6b-80292fa09ed6 req-f26a1607-31e4-4ec1-9087-48896c102cb0 service nova] Lock "90473cd0-7bf8-478e-af9d-771f720a10f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1813c4f9-c4a0-497f-bc6b-80292fa09ed6 req-f26a1607-31e4-4ec1-9087-48896c102cb0 service nova] Lock "90473cd0-7bf8-478e-af9d-771f720a10f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:42 user nova-compute[74039]: DEBUG nova.compute.manager [req-1813c4f9-c4a0-497f-bc6b-80292fa09ed6 req-f26a1607-31e4-4ec1-9087-48896c102cb0 service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] No waiting events found dispatching network-vif-unplugged-cb325581-30da-432f-846d-402483dd60d4 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:01:42 user nova-compute[74039]: DEBUG nova.compute.manager [req-1813c4f9-c4a0-497f-bc6b-80292fa09ed6 req-f26a1607-31e4-4ec1-9087-48896c102cb0 service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Received event network-vif-unplugged-cb325581-30da-432f-846d-402483dd60d4 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:01:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:43 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Instance destroyed successfully.
Oct 20 09:01:43 user nova-compute[74039]: DEBUG nova.objects.instance [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lazy-loading 'resources' on Instance uuid 90473cd0-7bf8-478e-af9d-771f720a10f7 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:01:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1455808292',display_name='tempest-AttachVolumeNegativeTest-server-1455808292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1455808292',id=20,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHj1hP4WUmv6gcDueLRC1bVN/mlw9z1nuiqsEU9J334LpYFcIjJME3lyT3cRHRvUYNFi3+t4W6zPyI+P+RF1U2QFXgYhk3rzcF7I5LWTghQruo5NiaNR7skSgGsKZY82w==',key_name='tempest-keypair-810081210',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:59:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='143bda69e4714560b4b2286adaefb4c5',ramdisk_id='',reservation_id='r-10ansmb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-639731200',owner_user_name='tempest-AttachVolumeNegativeTest-639731200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6faf5f2e03204805a06ac9f83b9a61bb',uuid=90473cd0-7bf8-478e-af9d-771f720a10f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb325581-30da-432f-846d-402483dd60d4", "address": "fa:16:3e:93:21:b6", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb325581-30", "ovs_interfaceid": "cb325581-30da-432f-846d-402483dd60d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:01:43 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converting VIF {"id": "cb325581-30da-432f-846d-402483dd60d4", "address": "fa:16:3e:93:21:b6", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb325581-30", "ovs_interfaceid": "cb325581-30da-432f-846d-402483dd60d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:01:43 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:21:b6,bridge_name='br-int',has_traffic_filtering=True,id=cb325581-30da-432f-846d-402483dd60d4,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb325581-30') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:01:43 user nova-compute[74039]: DEBUG os_vif [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:21:b6,bridge_name='br-int',has_traffic_filtering=True,id=cb325581-30da-432f-846d-402483dd60d4,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb325581-30') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:01:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb325581-30, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:01:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2391b0d-801a-46e7-9dbf-14b9947a512b) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:43 user nova-compute[74039]: INFO os_vif [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:21:b6,bridge_name='br-int',has_traffic_filtering=True,id=cb325581-30da-432f-846d-402483dd60d4,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb325581-30')
Oct 20 09:01:43 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Deleting instance files /opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7_del
Oct 20 09:01:43 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Deletion of /opt/stack/data/nova/instances/90473cd0-7bf8-478e-af9d-771f720a10f7_del complete
Oct 20 09:01:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:43 user nova-compute[74039]: INFO nova.compute.manager [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 20 09:01:43 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:01:43 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:01:43 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:01:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:44 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:01:44 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Took 0.73 seconds to deallocate network for instance.
Oct 20 09:01:44 user nova-compute[74039]: DEBUG nova.compute.manager [req-969ca03b-e64d-468d-a665-3ba8040f8cb8 req-e66e7872-38e4-4a18-95cb-4348b4140b9d service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Received event network-vif-deleted-cb325581-30da-432f-846d-402483dd60d4 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:01:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:44 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:01:44 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:01:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:44 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Deleted allocations for instance 90473cd0-7bf8-478e-af9d-771f720a10f7
Oct 20 09:01:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1d845bda-d3d7-4303-9e55-3c796d176a69 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "90473cd0-7bf8-478e-af9d-771f720a10f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.269s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:45 user nova-compute[74039]: DEBUG nova.compute.manager [req-61e330f9-f017-43cb-9146-588f195ddb35 req-51019581-7a88-40c8-95b8-10fd1f88fa25 service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Received event network-vif-plugged-cb325581-30da-432f-846d-402483dd60d4 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:01:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-61e330f9-f017-43cb-9146-588f195ddb35 req-51019581-7a88-40c8-95b8-10fd1f88fa25 service nova] Acquiring lock "90473cd0-7bf8-478e-af9d-771f720a10f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-61e330f9-f017-43cb-9146-588f195ddb35 req-51019581-7a88-40c8-95b8-10fd1f88fa25 service nova] Lock "90473cd0-7bf8-478e-af9d-771f720a10f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-61e330f9-f017-43cb-9146-588f195ddb35 req-51019581-7a88-40c8-95b8-10fd1f88fa25 service nova] Lock "90473cd0-7bf8-478e-af9d-771f720a10f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:45 user nova-compute[74039]: DEBUG nova.compute.manager [req-61e330f9-f017-43cb-9146-588f195ddb35 req-51019581-7a88-40c8-95b8-10fd1f88fa25 service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] No waiting events found dispatching network-vif-plugged-cb325581-30da-432f-846d-402483dd60d4 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:01:45 user nova-compute[74039]: WARNING nova.compute.manager [req-61e330f9-f017-43cb-9146-588f195ddb35 req-51019581-7a88-40c8-95b8-10fd1f88fa25 service nova] [instance: 90473cd0-7bf8-478e-af9d-771f720a10f7] Received unexpected event network-vif-plugged-cb325581-30da-432f-846d-402483dd60d4 for instance with vm_state deleted and task_state None.
Oct 20 09:01:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "e14ecf11-28b6-421d-875f-0ce9a21999d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:01:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:48 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:01:48 user nova-compute[74039]: INFO nova.compute.claims [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Claim successful on node user
Oct 20 09:01:48 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG nova.compute.manager [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG nova.compute.manager [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG nova.network.neutron [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:01:49 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:01:49 user nova-compute[74039]: DEBUG nova.compute.manager [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG nova.policy [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3196ef9f3da4311bb896432fbf55ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40be8c8bc79f4ce2a4857d36ddfe0667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG nova.compute.manager [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:01:49 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Creating image(s)
Oct 20 09:01:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "/opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "/opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "/opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.223s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk 1073741824" returned: 0 in 0.056s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG nova.network.neutron [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Successfully created port: e70313a0-8859-4514-b8e8-ec4355e6bd40 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:01:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.212s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:50 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:01:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:50 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Cannot resize image /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:01:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:01:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Ensure instance console log exists: /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:01:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.network.neutron [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Successfully updated port: e70313a0-8859-4514-b8e8-ec4355e6bd40 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "refresh_cache-e14ecf11-28b6-421d-875f-0ce9a21999d3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquired lock "refresh_cache-e14ecf11-28b6-421d-875f-0ce9a21999d3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.network.neutron [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-cfad4c2b-62bf-4cfa-bcb3-52eec6fa7dd9 req-9fb5de62-aa1f-4c52-a74f-700e67ca735b service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Received event network-changed-e70313a0-8859-4514-b8e8-ec4355e6bd40 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-cfad4c2b-62bf-4cfa-bcb3-52eec6fa7dd9 req-9fb5de62-aa1f-4c52-a74f-700e67ca735b service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Refreshing instance network info cache due to event network-changed-e70313a0-8859-4514-b8e8-ec4355e6bd40. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-cfad4c2b-62bf-4cfa-bcb3-52eec6fa7dd9 req-9fb5de62-aa1f-4c52-a74f-700e67ca735b service nova] Acquiring lock "refresh_cache-e14ecf11-28b6-421d-875f-0ce9a21999d3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.network.neutron [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.network.neutron [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Updating instance_info_cache with network_info: [{"id": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "address": "fa:16:3e:4c:10:22", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70313a0-88", "ovs_interfaceid": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Releasing lock "refresh_cache-e14ecf11-28b6-421d-875f-0ce9a21999d3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.compute.manager [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Instance network_info: |[{"id": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "address": "fa:16:3e:4c:10:22", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70313a0-88", "ovs_interfaceid": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-cfad4c2b-62bf-4cfa-bcb3-52eec6fa7dd9 req-9fb5de62-aa1f-4c52-a74f-700e67ca735b service nova] Acquired lock "refresh_cache-e14ecf11-28b6-421d-875f-0ce9a21999d3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.network.neutron [req-cfad4c2b-62bf-4cfa-bcb3-52eec6fa7dd9 req-9fb5de62-aa1f-4c52-a74f-700e67ca735b service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Refreshing network info cache for port e70313a0-8859-4514-b8e8-ec4355e6bd40 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Start _get_guest_xml network_info=[{"id": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "address": "fa:16:3e:4c:10:22", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70313a0-88", "ovs_interfaceid": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:01:51 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:01:51 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1041271003',display_name='tempest-VolumesSnapshotTestJSON-instance-1041271003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1041271003',id=24,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOnEnCoxHMnNpmXJE8iVnHkBMZG06kmzcaVveYLEb2o/YqsiI4cHKfYN2+mwATUaFgAzQG8s/U0vr19SivpKjYHMH2ynafbAxroMjEwKSA1Xs+KWNoS2yN+eUNV8pwPDg==',key_name='tempest-keypair-1877119492',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40be8c8bc79f4ce2a4857d36ddfe0667',ramdisk_id='',reservation_id='r-vdo3ftgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1434807460',owner_user_name='tempest-VolumesSnapshotTestJSON-1434807460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:01:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3196ef9f3da4311bb896432fbf55ed2',uuid=e14ecf11-28b6-421d-875f-0ce9a21999d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "address": "fa:16:3e:4c:10:22", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70313a0-88", "ovs_interfaceid": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Converting VIF {"id": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "address": "fa:16:3e:4c:10:22", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70313a0-88", "ovs_interfaceid": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:10:22,bridge_name='br-int',has_traffic_filtering=True,id=e70313a0-8859-4514-b8e8-ec4355e6bd40,network=Network(c8baa945-5d9a-4bf8-830d-ab75cf318cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70313a0-88') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.objects.instance [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lazy-loading 'pci_devices' on Instance uuid e14ecf11-28b6-421d-875f-0ce9a21999d3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:01:51 user nova-compute[74039]:   <uuid>e14ecf11-28b6-421d-875f-0ce9a21999d3</uuid>
Oct 20 09:01:51 user nova-compute[74039]:   <name>instance-00000018</name>
Oct 20 09:01:51 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:01:51 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:01:51 user nova-compute[74039]:   <metadata>
Oct 20 09:01:51 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:01:51 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:01:51 user nova-compute[74039]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1041271003</nova:name>
Oct 20 09:01:51 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:01:51</nova:creationTime>
Oct 20 09:01:51 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:01:51 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:01:51 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:01:51 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:01:51 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:01:51 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:01:51 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:01:51 user nova-compute[74039]:       <nova:owner>
Oct 20 09:01:51 user nova-compute[74039]:         <nova:user uuid="d3196ef9f3da4311bb896432fbf55ed2">tempest-VolumesSnapshotTestJSON-1434807460-project-member</nova:user>
Oct 20 09:01:51 user nova-compute[74039]:         <nova:project uuid="40be8c8bc79f4ce2a4857d36ddfe0667">tempest-VolumesSnapshotTestJSON-1434807460</nova:project>
Oct 20 09:01:51 user nova-compute[74039]:       </nova:owner>
Oct 20 09:01:51 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:01:51 user nova-compute[74039]:       <nova:ports>
Oct 20 09:01:51 user nova-compute[74039]:         <nova:port uuid="e70313a0-8859-4514-b8e8-ec4355e6bd40">
Oct 20 09:01:51 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 09:01:51 user nova-compute[74039]:         </nova:port>
Oct 20 09:01:51 user nova-compute[74039]:       </nova:ports>
Oct 20 09:01:51 user nova-compute[74039]:     </nova:instance>
Oct 20 09:01:51 user nova-compute[74039]:   </metadata>
Oct 20 09:01:51 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:01:51 user nova-compute[74039]:     <system>
Oct 20 09:01:51 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:01:51 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:01:51 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:01:51 user nova-compute[74039]:       <entry name="serial">e14ecf11-28b6-421d-875f-0ce9a21999d3</entry>
Oct 20 09:01:51 user nova-compute[74039]:       <entry name="uuid">e14ecf11-28b6-421d-875f-0ce9a21999d3</entry>
Oct 20 09:01:51 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:01:51 user nova-compute[74039]:     </system>
Oct 20 09:01:51 user nova-compute[74039]:   </sysinfo>
Oct 20 09:01:51 user nova-compute[74039]:   <os>
Oct 20 09:01:51 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:01:51 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:01:51 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:01:51 user nova-compute[74039]:   </os>
Oct 20 09:01:51 user nova-compute[74039]:   <features>
Oct 20 09:01:51 user nova-compute[74039]:     <acpi/>
Oct 20 09:01:51 user nova-compute[74039]:     <apic/>
Oct 20 09:01:51 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:01:51 user nova-compute[74039]:   </features>
Oct 20 09:01:51 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:01:51 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:01:51 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:01:51 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:01:51 user nova-compute[74039]:   </clock>
Oct 20 09:01:51 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:01:51 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:01:51 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:01:51 user nova-compute[74039]:   </cpu>
Oct 20 09:01:51 user nova-compute[74039]:   <devices>
Oct 20 09:01:51 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:01:51 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:01:51 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk"/>
Oct 20 09:01:51 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:01:51 user nova-compute[74039]:     </disk>
Oct 20 09:01:51 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:01:51 user nova-compute[74039]:       <mac address="fa:16:3e:4c:10:22"/>
Oct 20 09:01:51 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:01:51 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:01:51 user nova-compute[74039]:       <target dev="tape70313a0-88"/>
Oct 20 09:01:51 user nova-compute[74039]:     </interface>
Oct 20 09:01:51 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:01:51 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/console.log" append="off"/>
Oct 20 09:01:51 user nova-compute[74039]:     </serial>
Oct 20 09:01:51 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:01:51 user nova-compute[74039]:     <video>
Oct 20 09:01:51 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:01:51 user nova-compute[74039]:     </video>
Oct 20 09:01:51 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:01:51 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:01:51 user nova-compute[74039]:     </rng>
Oct 20 09:01:51 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:01:51 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:01:51 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:01:51 user nova-compute[74039]:     </memballoon>
Oct 20 09:01:51 user nova-compute[74039]:   </devices>
Oct 20 09:01:51 user nova-compute[74039]: </domain>
Oct 20 09:01:51 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1041271003',display_name='tempest-VolumesSnapshotTestJSON-instance-1041271003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1041271003',id=24,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOnEnCoxHMnNpmXJE8iVnHkBMZG06kmzcaVveYLEb2o/YqsiI4cHKfYN2+mwATUaFgAzQG8s/U0vr19SivpKjYHMH2ynafbAxroMjEwKSA1Xs+KWNoS2yN+eUNV8pwPDg==',key_name='tempest-keypair-1877119492',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40be8c8bc79f4ce2a4857d36ddfe0667',ramdisk_id='',reservation_id='r-vdo3ftgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1434807460',owner_user_name='tempest-VolumesSnapshotTestJSON-1434807460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:01:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3196ef9f3da4311bb896432fbf55ed2',uuid=e14ecf11-28b6-421d-875f-0ce9a21999d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "address": "fa:16:3e:4c:10:22", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70313a0-88", "ovs_interfaceid": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Converting VIF {"id": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "address": "fa:16:3e:4c:10:22", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70313a0-88", "ovs_interfaceid": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:10:22,bridge_name='br-int',has_traffic_filtering=True,id=e70313a0-8859-4514-b8e8-ec4355e6bd40,network=Network(c8baa945-5d9a-4bf8-830d-ab75cf318cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70313a0-88') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG os_vif [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:10:22,bridge_name='br-int',has_traffic_filtering=True,id=e70313a0-8859-4514-b8e8-ec4355e6bd40,network=Network(c8baa945-5d9a-4bf8-830d-ab75cf318cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70313a0-88') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '536cb92d-5606-5747-84be-b9da6edc4d7f', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape70313a0-88, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape70313a0-88, col_values=(('qos', UUID('c9932013-45a4-4bf4-9c03-3ec8041bb647')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape70313a0-88, col_values=(('external_ids', {'iface-id': 'e70313a0-8859-4514-b8e8-ec4355e6bd40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:10:22', 'vm-uuid': 'e14ecf11-28b6-421d-875f-0ce9a21999d3'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:51 user nova-compute[74039]: INFO os_vif [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:10:22,bridge_name='br-int',has_traffic_filtering=True,id=e70313a0-8859-4514-b8e8-ec4355e6bd40,network=Network(c8baa945-5d9a-4bf8-830d-ab75cf318cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70313a0-88')
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:01:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] No VIF found with MAC fa:16:3e:4c:10:22, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:01:52 user nova-compute[74039]: DEBUG nova.network.neutron [req-cfad4c2b-62bf-4cfa-bcb3-52eec6fa7dd9 req-9fb5de62-aa1f-4c52-a74f-700e67ca735b service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Updated VIF entry in instance network info cache for port e70313a0-8859-4514-b8e8-ec4355e6bd40. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:01:52 user nova-compute[74039]: DEBUG nova.network.neutron [req-cfad4c2b-62bf-4cfa-bcb3-52eec6fa7dd9 req-9fb5de62-aa1f-4c52-a74f-700e67ca735b service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Updating instance_info_cache with network_info: [{"id": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "address": "fa:16:3e:4c:10:22", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70313a0-88", "ovs_interfaceid": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:01:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-cfad4c2b-62bf-4cfa-bcb3-52eec6fa7dd9 req-9fb5de62-aa1f-4c52-a74f-700e67ca735b service nova] Releasing lock "refresh_cache-e14ecf11-28b6-421d-875f-0ce9a21999d3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:01:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-daa2e73b-17d2-414b-af07-45634980074c req-57f18a18-5449-425c-9ffe-55657febe35a service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Received event network-vif-plugged-e70313a0-8859-4514-b8e8-ec4355e6bd40 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:01:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-daa2e73b-17d2-414b-af07-45634980074c req-57f18a18-5449-425c-9ffe-55657febe35a service nova] Acquiring lock "e14ecf11-28b6-421d-875f-0ce9a21999d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-daa2e73b-17d2-414b-af07-45634980074c req-57f18a18-5449-425c-9ffe-55657febe35a service nova] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-daa2e73b-17d2-414b-af07-45634980074c req-57f18a18-5449-425c-9ffe-55657febe35a service nova] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-daa2e73b-17d2-414b-af07-45634980074c req-57f18a18-5449-425c-9ffe-55657febe35a service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] No waiting events found dispatching network-vif-plugged-e70313a0-8859-4514-b8e8-ec4355e6bd40 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:01:53 user nova-compute[74039]: WARNING nova.compute.manager [req-daa2e73b-17d2-414b-af07-45634980074c req-57f18a18-5449-425c-9ffe-55657febe35a service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Received unexpected event network-vif-plugged-e70313a0-8859-4514-b8e8-ec4355e6bd40 for instance with vm_state building and task_state spawning.
Oct 20 09:01:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Acquiring lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:01:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:54 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:01:54 user nova-compute[74039]: INFO nova.compute.claims [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Claim successful on node user
Oct 20 09:01:54 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:01:54 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:01:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:01:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:01:54 user nova-compute[74039]: DEBUG nova.network.neutron [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:01:54 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:01:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:01:54 user nova-compute[74039]: DEBUG nova.policy [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '935ac4f4da314ed585a4d4a2b053884b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1aae6f3e74c41769474f7618b0f3a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:01:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:01:54 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:01:54 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Creating image(s)
Oct 20 09:01:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Acquiring lock "/opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "/opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "/opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.199s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca/disk 1073741824" returned: 0 in 0.047s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG nova.network.neutron [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Successfully created port: 841a8134-5b00-46f0-9e3a-604831e8ef1f {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Checking if we can resize image /opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG nova.compute.manager [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:01:55 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Instance spawned successfully.
Oct 20 09:01:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Cannot resize image /opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Ensure instance console log exists: /opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-9177a31a-7ab5-4f18-9964-a156e498dcd1 req-a30aa633-9783-43ac-8fb2-12f8e031ca06 service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Received event network-vif-plugged-e70313a0-8859-4514-b8e8-ec4355e6bd40 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9177a31a-7ab5-4f18-9964-a156e498dcd1 req-a30aa633-9783-43ac-8fb2-12f8e031ca06 service nova] Acquiring lock "e14ecf11-28b6-421d-875f-0ce9a21999d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9177a31a-7ab5-4f18-9964-a156e498dcd1 req-a30aa633-9783-43ac-8fb2-12f8e031ca06 service nova] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9177a31a-7ab5-4f18-9964-a156e498dcd1 req-a30aa633-9783-43ac-8fb2-12f8e031ca06 service nova] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-9177a31a-7ab5-4f18-9964-a156e498dcd1 req-a30aa633-9783-43ac-8fb2-12f8e031ca06 service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] No waiting events found dispatching network-vif-plugged-e70313a0-8859-4514-b8e8-ec4355e6bd40 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:01:55 user nova-compute[74039]: WARNING nova.compute.manager [req-9177a31a-7ab5-4f18-9964-a156e498dcd1 req-a30aa633-9783-43ac-8fb2-12f8e031ca06 service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Received unexpected event network-vif-plugged-e70313a0-8859-4514-b8e8-ec4355e6bd40 for instance with vm_state building and task_state spawning.
Oct 20 09:01:55 user nova-compute[74039]: INFO nova.compute.manager [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Took 6.38 seconds to spawn the instance on the hypervisor.
Oct 20 09:01:55 user nova-compute[74039]: DEBUG nova.compute.manager [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:01:55 user nova-compute[74039]: INFO nova.compute.manager [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Took 7.30 seconds to build instance.
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0c55c8e-24ad-4bd7-8768-e65e666a4d3a tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.448s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG nova.network.neutron [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Successfully updated port: 841a8134-5b00-46f0-9e3a-604831e8ef1f {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Acquiring lock "refresh_cache-def7ee9b-e0ed-4c95-961c-c6d79144f0ca" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Acquired lock "refresh_cache-def7ee9b-e0ed-4c95-961c-c6d79144f0ca" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:01:55 user nova-compute[74039]: DEBUG nova.network.neutron [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.compute.manager [req-7c56148f-6448-4a83-abdc-412e8bf0667d req-4713efea-33ea-4920-81f4-13b1eadcd5d0 service nova] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Received event network-changed-841a8134-5b00-46f0-9e3a-604831e8ef1f {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.compute.manager [req-7c56148f-6448-4a83-abdc-412e8bf0667d req-4713efea-33ea-4920-81f4-13b1eadcd5d0 service nova] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Refreshing instance network info cache due to event network-changed-841a8134-5b00-46f0-9e3a-604831e8ef1f. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7c56148f-6448-4a83-abdc-412e8bf0667d req-4713efea-33ea-4920-81f4-13b1eadcd5d0 service nova] Acquiring lock "refresh_cache-def7ee9b-e0ed-4c95-961c-c6d79144f0ca" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.network.neutron [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.network.neutron [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Updating instance_info_cache with network_info: [{"id": "841a8134-5b00-46f0-9e3a-604831e8ef1f", "address": "fa:16:3e:ab:3b:34", "network": {"id": "eaffdf13-e72f-4493-8da9-2d079001d9a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-993230787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1aae6f3e74c41769474f7618b0f3a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a8134-5b", "ovs_interfaceid": "841a8134-5b00-46f0-9e3a-604831e8ef1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Releasing lock "refresh_cache-def7ee9b-e0ed-4c95-961c-c6d79144f0ca" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.compute.manager [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Instance network_info: |[{"id": "841a8134-5b00-46f0-9e3a-604831e8ef1f", "address": "fa:16:3e:ab:3b:34", "network": {"id": "eaffdf13-e72f-4493-8da9-2d079001d9a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-993230787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1aae6f3e74c41769474f7618b0f3a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a8134-5b", "ovs_interfaceid": "841a8134-5b00-46f0-9e3a-604831e8ef1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7c56148f-6448-4a83-abdc-412e8bf0667d req-4713efea-33ea-4920-81f4-13b1eadcd5d0 service nova] Acquired lock "refresh_cache-def7ee9b-e0ed-4c95-961c-c6d79144f0ca" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.network.neutron [req-7c56148f-6448-4a83-abdc-412e8bf0667d req-4713efea-33ea-4920-81f4-13b1eadcd5d0 service nova] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Refreshing network info cache for port 841a8134-5b00-46f0-9e3a-604831e8ef1f {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Start _get_guest_xml network_info=[{"id": "841a8134-5b00-46f0-9e3a-604831e8ef1f", "address": "fa:16:3e:ab:3b:34", "network": {"id": "eaffdf13-e72f-4493-8da9-2d079001d9a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-993230787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1aae6f3e74c41769474f7618b0f3a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a8134-5b", "ovs_interfaceid": "841a8134-5b00-46f0-9e3a-604831e8ef1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:01:56 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:01:56 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:01:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-462159413',display_name='tempest-DeleteServersTestJSON-server-462159413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-462159413',id=25,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1aae6f3e74c41769474f7618b0f3a0b',ramdisk_id='',reservation_id='r-37blellu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1719064105',owner_user_name='tempest-DeleteServersTestJSON-1719064105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:01:55Z,user_data=None,user_id='935ac4f4da314ed585a4d4a2b053884b',uuid=def7ee9b-e0ed-4c95-961c-c6d79144f0ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "841a8134-5b00-46f0-9e3a-604831e8ef1f", "address": "fa:16:3e:ab:3b:34", "network": {"id": "eaffdf13-e72f-4493-8da9-2d079001d9a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-993230787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1aae6f3e74c41769474f7618b0f3a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a8134-5b", "ovs_interfaceid": "841a8134-5b00-46f0-9e3a-604831e8ef1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Converting VIF {"id": "841a8134-5b00-46f0-9e3a-604831e8ef1f", "address": "fa:16:3e:ab:3b:34", "network": {"id": "eaffdf13-e72f-4493-8da9-2d079001d9a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-993230787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1aae6f3e74c41769474f7618b0f3a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a8134-5b", "ovs_interfaceid": "841a8134-5b00-46f0-9e3a-604831e8ef1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:3b:34,bridge_name='br-int',has_traffic_filtering=True,id=841a8134-5b00-46f0-9e3a-604831e8ef1f,network=Network(eaffdf13-e72f-4493-8da9-2d079001d9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a8134-5b') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.objects.instance [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lazy-loading 'pci_devices' on Instance uuid def7ee9b-e0ed-4c95-961c-c6d79144f0ca {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:01:56 user nova-compute[74039]:   <uuid>def7ee9b-e0ed-4c95-961c-c6d79144f0ca</uuid>
Oct 20 09:01:56 user nova-compute[74039]:   <name>instance-00000019</name>
Oct 20 09:01:56 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:01:56 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:01:56 user nova-compute[74039]:   <metadata>
Oct 20 09:01:56 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:01:56 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:01:56 user nova-compute[74039]:       <nova:name>tempest-DeleteServersTestJSON-server-462159413</nova:name>
Oct 20 09:01:56 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:01:56</nova:creationTime>
Oct 20 09:01:56 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:01:56 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:01:56 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:01:56 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:01:56 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:01:56 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:01:56 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:01:56 user nova-compute[74039]:       <nova:owner>
Oct 20 09:01:56 user nova-compute[74039]:         <nova:user uuid="935ac4f4da314ed585a4d4a2b053884b">tempest-DeleteServersTestJSON-1719064105-project-member</nova:user>
Oct 20 09:01:56 user nova-compute[74039]:         <nova:project uuid="b1aae6f3e74c41769474f7618b0f3a0b">tempest-DeleteServersTestJSON-1719064105</nova:project>
Oct 20 09:01:56 user nova-compute[74039]:       </nova:owner>
Oct 20 09:01:56 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:01:56 user nova-compute[74039]:       <nova:ports>
Oct 20 09:01:56 user nova-compute[74039]:         <nova:port uuid="841a8134-5b00-46f0-9e3a-604831e8ef1f">
Oct 20 09:01:56 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 09:01:56 user nova-compute[74039]:         </nova:port>
Oct 20 09:01:56 user nova-compute[74039]:       </nova:ports>
Oct 20 09:01:56 user nova-compute[74039]:     </nova:instance>
Oct 20 09:01:56 user nova-compute[74039]:   </metadata>
Oct 20 09:01:56 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:01:56 user nova-compute[74039]:     <system>
Oct 20 09:01:56 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:01:56 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:01:56 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:01:56 user nova-compute[74039]:       <entry name="serial">def7ee9b-e0ed-4c95-961c-c6d79144f0ca</entry>
Oct 20 09:01:56 user nova-compute[74039]:       <entry name="uuid">def7ee9b-e0ed-4c95-961c-c6d79144f0ca</entry>
Oct 20 09:01:56 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:01:56 user nova-compute[74039]:     </system>
Oct 20 09:01:56 user nova-compute[74039]:   </sysinfo>
Oct 20 09:01:56 user nova-compute[74039]:   <os>
Oct 20 09:01:56 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:01:56 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:01:56 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:01:56 user nova-compute[74039]:   </os>
Oct 20 09:01:56 user nova-compute[74039]:   <features>
Oct 20 09:01:56 user nova-compute[74039]:     <acpi/>
Oct 20 09:01:56 user nova-compute[74039]:     <apic/>
Oct 20 09:01:56 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:01:56 user nova-compute[74039]:   </features>
Oct 20 09:01:56 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:01:56 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:01:56 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:01:56 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:01:56 user nova-compute[74039]:   </clock>
Oct 20 09:01:56 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:01:56 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:01:56 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:01:56 user nova-compute[74039]:   </cpu>
Oct 20 09:01:56 user nova-compute[74039]:   <devices>
Oct 20 09:01:56 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:01:56 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:01:56 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca/disk"/>
Oct 20 09:01:56 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:01:56 user nova-compute[74039]:     </disk>
Oct 20 09:01:56 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:01:56 user nova-compute[74039]:       <mac address="fa:16:3e:ab:3b:34"/>
Oct 20 09:01:56 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:01:56 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:01:56 user nova-compute[74039]:       <target dev="tap841a8134-5b"/>
Oct 20 09:01:56 user nova-compute[74039]:     </interface>
Oct 20 09:01:56 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:01:56 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca/console.log" append="off"/>
Oct 20 09:01:56 user nova-compute[74039]:     </serial>
Oct 20 09:01:56 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:01:56 user nova-compute[74039]:     <video>
Oct 20 09:01:56 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:01:56 user nova-compute[74039]:     </video>
Oct 20 09:01:56 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:01:56 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:01:56 user nova-compute[74039]:     </rng>
Oct 20 09:01:56 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:01:56 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:01:56 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:01:56 user nova-compute[74039]:     </memballoon>
Oct 20 09:01:56 user nova-compute[74039]:   </devices>
Oct 20 09:01:56 user nova-compute[74039]: </domain>
Oct 20 09:01:56 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:01:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-462159413',display_name='tempest-DeleteServersTestJSON-server-462159413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-462159413',id=25,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1aae6f3e74c41769474f7618b0f3a0b',ramdisk_id='',reservation_id='r-37blellu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1719064105',owner_user_name='tempest-DeleteServersTestJSON-1719064105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:01:55Z,user_data=None,user_id='935ac4f4da314ed585a4d4a2b053884b',uuid=def7ee9b-e0ed-4c95-961c-c6d79144f0ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "841a8134-5b00-46f0-9e3a-604831e8ef1f", "address": "fa:16:3e:ab:3b:34", "network": {"id": "eaffdf13-e72f-4493-8da9-2d079001d9a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-993230787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1aae6f3e74c41769474f7618b0f3a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a8134-5b", "ovs_interfaceid": "841a8134-5b00-46f0-9e3a-604831e8ef1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Converting VIF {"id": "841a8134-5b00-46f0-9e3a-604831e8ef1f", "address": "fa:16:3e:ab:3b:34", "network": {"id": "eaffdf13-e72f-4493-8da9-2d079001d9a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-993230787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1aae6f3e74c41769474f7618b0f3a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a8134-5b", "ovs_interfaceid": "841a8134-5b00-46f0-9e3a-604831e8ef1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:3b:34,bridge_name='br-int',has_traffic_filtering=True,id=841a8134-5b00-46f0-9e3a-604831e8ef1f,network=Network(eaffdf13-e72f-4493-8da9-2d079001d9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a8134-5b') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG os_vif [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:3b:34,bridge_name='br-int',has_traffic_filtering=True,id=841a8134-5b00-46f0-9e3a-604831e8ef1f,network=Network(eaffdf13-e72f-4493-8da9-2d079001d9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a8134-5b') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b94c317f-8647-55d2-8e70-a71772db234e', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap841a8134-5b, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap841a8134-5b, col_values=(('qos', UUID('a6b579e5-ef28-4ca4-810e-3f47ad68adea')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap841a8134-5b, col_values=(('external_ids', {'iface-id': '841a8134-5b00-46f0-9e3a-604831e8ef1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:3b:34', 'vm-uuid': 'def7ee9b-e0ed-4c95-961c-c6d79144f0ca'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:56 user nova-compute[74039]: INFO os_vif [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:3b:34,bridge_name='br-int',has_traffic_filtering=True,id=841a8134-5b00-46f0-9e3a-604831e8ef1f,network=Network(eaffdf13-e72f-4493-8da9-2d079001d9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a8134-5b')
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] No VIF found with MAC fa:16:3e:ab:3b:34, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.network.neutron [req-7c56148f-6448-4a83-abdc-412e8bf0667d req-4713efea-33ea-4920-81f4-13b1eadcd5d0 service nova] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Updated VIF entry in instance network info cache for port 841a8134-5b00-46f0-9e3a-604831e8ef1f. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG nova.network.neutron [req-7c56148f-6448-4a83-abdc-412e8bf0667d req-4713efea-33ea-4920-81f4-13b1eadcd5d0 service nova] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Updating instance_info_cache with network_info: [{"id": "841a8134-5b00-46f0-9e3a-604831e8ef1f", "address": "fa:16:3e:ab:3b:34", "network": {"id": "eaffdf13-e72f-4493-8da9-2d079001d9a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-993230787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1aae6f3e74c41769474f7618b0f3a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a8134-5b", "ovs_interfaceid": "841a8134-5b00-46f0-9e3a-604831e8ef1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:01:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7c56148f-6448-4a83-abdc-412e8bf0667d req-4713efea-33ea-4920-81f4-13b1eadcd5d0 service nova] Releasing lock "refresh_cache-def7ee9b-e0ed-4c95-961c-c6d79144f0ca" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:01:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:58 user nova-compute[74039]: DEBUG nova.compute.manager [req-67fa660d-1a8b-4dba-842b-b503b9feffa2 req-5686c269-b35f-4c80-aaf7-fb4f45fa9963 service nova] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Received event network-vif-plugged-841a8134-5b00-46f0-9e3a-604831e8ef1f {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:01:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-67fa660d-1a8b-4dba-842b-b503b9feffa2 req-5686c269-b35f-4c80-aaf7-fb4f45fa9963 service nova] Acquiring lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:01:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-67fa660d-1a8b-4dba-842b-b503b9feffa2 req-5686c269-b35f-4c80-aaf7-fb4f45fa9963 service nova] Lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:01:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-67fa660d-1a8b-4dba-842b-b503b9feffa2 req-5686c269-b35f-4c80-aaf7-fb4f45fa9963 service nova] Lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:01:58 user nova-compute[74039]: DEBUG nova.compute.manager [req-67fa660d-1a8b-4dba-842b-b503b9feffa2 req-5686c269-b35f-4c80-aaf7-fb4f45fa9963 service nova] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] No waiting events found dispatching network-vif-plugged-841a8134-5b00-46f0-9e3a-604831e8ef1f {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:01:58 user nova-compute[74039]: WARNING nova.compute.manager [req-67fa660d-1a8b-4dba-842b-b503b9feffa2 req-5686c269-b35f-4c80-aaf7-fb4f45fa9963 service nova] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Received unexpected event network-vif-plugged-841a8134-5b00-46f0-9e3a-604831e8ef1f for instance with vm_state building and task_state spawning.
Oct 20 09:01:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:01:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:00 user nova-compute[74039]: DEBUG nova.compute.manager [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:02:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:02:00 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Instance spawned successfully.
Oct 20 09:02:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:02:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:02:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:02:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:02:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:02:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:02:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:02:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-6c5ad167-3746-4f3c-a12a-be148317308b req-d31fdda7-9d7a-4482-8183-07348c803988 service nova] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Received event network-vif-plugged-841a8134-5b00-46f0-9e3a-604831e8ef1f {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:02:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6c5ad167-3746-4f3c-a12a-be148317308b req-d31fdda7-9d7a-4482-8183-07348c803988 service nova] Acquiring lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:02:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6c5ad167-3746-4f3c-a12a-be148317308b req-d31fdda7-9d7a-4482-8183-07348c803988 service nova] Lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:02:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6c5ad167-3746-4f3c-a12a-be148317308b req-d31fdda7-9d7a-4482-8183-07348c803988 service nova] Lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:02:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-6c5ad167-3746-4f3c-a12a-be148317308b req-d31fdda7-9d7a-4482-8183-07348c803988 service nova] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] No waiting events found dispatching network-vif-plugged-841a8134-5b00-46f0-9e3a-604831e8ef1f {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:02:00 user nova-compute[74039]: WARNING nova.compute.manager [req-6c5ad167-3746-4f3c-a12a-be148317308b req-d31fdda7-9d7a-4482-8183-07348c803988 service nova] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Received unexpected event network-vif-plugged-841a8134-5b00-46f0-9e3a-604831e8ef1f for instance with vm_state building and task_state spawning.
Oct 20 09:02:00 user nova-compute[74039]: INFO nova.compute.manager [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Took 5.36 seconds to spawn the instance on the hypervisor.
Oct 20 09:02:00 user nova-compute[74039]: DEBUG nova.compute.manager [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:02:00 user nova-compute[74039]: INFO nova.compute.manager [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Took 6.15 seconds to build instance.
Oct 20 09:02:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-abbf00e5-b75a-4822-9171-7e61761f3758 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.251s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:02:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:02:09 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Creating image(s)
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Did not create local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Ensure instance console log exists: /opt/stack/data/nova/instances/00e09d93-3077-4770-abfd-b82ece646997/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Start _get_guest_xml network_info=[{"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '98a92e16-989a-49ac-ab58-3370680cbb67', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKlBfatR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '00e09d93-3077-4770-abfd-b82ece646997', 'attached_at': '', 'detached_at': '', 'volume_id': '761590b5-010a-47bc-9316-294b487cf5c1', 'serial': '761590b5-010a-47bc-9316-294b487cf5c1'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:02:09 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:02:09 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKlBfatR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:02:09 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:02:09 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:02:09 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[61233a69-dabf-4c21-8839-e77574341fe8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:02:09 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[09193cbf-046f-4242-ba30-8c6e1ec7d5b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1] added
Oct 20 09:02:09 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d7e0e2-1b9f-4039-9ae3-c1bb2becd987]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[111d61f9-35ef-4120-b811-6d579d436164]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AKlBfatR {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AKlBfatR" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[34483ba0-f9d2-4b63-ad2d-9af6bebbb481]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AKlBfatR'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e531497b-0bc7-40a6-b1c0-9d0ae2156f5b]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce90f3ed-8578-4dd9-ba97-f4a8189c3599]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:02:09 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 09:02:09 user nova-compute[74039]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)
Oct 20 09:02:09 user nova-compute[74039]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:02:09 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:02:09 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 09:02:09 user nova-compute[74039]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)
Oct 20 09:02:09 user nova-compute[74039]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:02:09 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0351727-f6cf-46ee-b3c9-a7be55d1dc95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1, portal: 172.16.0.220,3260]
Oct 20 09:02:09 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1, portal: 172.16.0.220,3260] successful.
Oct 20 09:02:09 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a20c85e-2c49-48a8-a581-416f665bad70]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd3cd53-87fc-4918-adc3-b4a90648f6c0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:02:09 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 09:02:09 user nova-compute[74039]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)
Oct 20 09:02:09 user nova-compute[74039]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:02:09 user nova-compute[74039]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:02:09 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:02:09 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 09:02:09 user nova-compute[74039]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)
Oct 20 09:02:09 user nova-compute[74039]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:02:09 user nova-compute[74039]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:02:09 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] HCTL ('37', '-', '-', 0) found on session 23 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.033s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94aba17-26f7-4a16-b907-6fde2f2b123c]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:02:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKlBfatR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23436313132633734', 'path': '/dev/sdf'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436313132633734', 'path': '/dev/sdf'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-456868217',display_name='tempest-ServerActionsTestOtherA-server-456868217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-456868217',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyyJ62onAPVNIcWwPgu8Qk09h8heuIgT4K5VQCSSgQo1m6HsMw9upnfKrs0KtZmErwiBvOSQvzot9EsqbPyLMmcaHuqRr6HWOREqecRp8rh7oJxELHXOR3Is97nl7PEUA==',key_name='tempest-keypair-612179765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88a58985dce3491d8e45e6e468e0e549',ramdisk_id='',reservation_id='r-ed0qaebc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1138208404',owner_user_name='tempest-ServerActionsTestOtherA-1138208404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb823f0374a04657be729eb153160659',uuid=00e09d93-3077-4770-abfd-b82ece646997,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converting VIF {"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:28:6b,bridge_name='br-int',has_traffic_filtering=True,id=d5f62963-3776-4468-b582-f2d31bf6a2be,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f62963-37') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG nova.objects.instance [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lazy-loading 'pci_devices' on Instance uuid 00e09d93-3077-4770-abfd-b82ece646997 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:02:10 user nova-compute[74039]:   <uuid>00e09d93-3077-4770-abfd-b82ece646997</uuid>
Oct 20 09:02:10 user nova-compute[74039]:   <name>instance-00000017</name>
Oct 20 09:02:10 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:02:10 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:02:10 user nova-compute[74039]:   <metadata>
Oct 20 09:02:10 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:02:10 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:02:10 user nova-compute[74039]:       <nova:name>tempest-ServerActionsTestOtherA-server-456868217</nova:name>
Oct 20 09:02:10 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:02:09</nova:creationTime>
Oct 20 09:02:10 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:02:10 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:02:10 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:02:10 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:02:10 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:02:10 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:02:10 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:02:10 user nova-compute[74039]:       <nova:owner>
Oct 20 09:02:10 user nova-compute[74039]:         <nova:user uuid="cb823f0374a04657be729eb153160659">tempest-ServerActionsTestOtherA-1138208404-project-member</nova:user>
Oct 20 09:02:10 user nova-compute[74039]:         <nova:project uuid="88a58985dce3491d8e45e6e468e0e549">tempest-ServerActionsTestOtherA-1138208404</nova:project>
Oct 20 09:02:10 user nova-compute[74039]:       </nova:owner>
Oct 20 09:02:10 user nova-compute[74039]:       <nova:ports>
Oct 20 09:02:10 user nova-compute[74039]:         <nova:port uuid="d5f62963-3776-4468-b582-f2d31bf6a2be">
Oct 20 09:02:10 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 09:02:10 user nova-compute[74039]:         </nova:port>
Oct 20 09:02:10 user nova-compute[74039]:       </nova:ports>
Oct 20 09:02:10 user nova-compute[74039]:     </nova:instance>
Oct 20 09:02:10 user nova-compute[74039]:   </metadata>
Oct 20 09:02:10 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:02:10 user nova-compute[74039]:     <system>
Oct 20 09:02:10 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:02:10 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:02:10 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:02:10 user nova-compute[74039]:       <entry name="serial">00e09d93-3077-4770-abfd-b82ece646997</entry>
Oct 20 09:02:10 user nova-compute[74039]:       <entry name="uuid">00e09d93-3077-4770-abfd-b82ece646997</entry>
Oct 20 09:02:10 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:02:10 user nova-compute[74039]:     </system>
Oct 20 09:02:10 user nova-compute[74039]:   </sysinfo>
Oct 20 09:02:10 user nova-compute[74039]:   <os>
Oct 20 09:02:10 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:02:10 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:02:10 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:02:10 user nova-compute[74039]:   </os>
Oct 20 09:02:10 user nova-compute[74039]:   <features>
Oct 20 09:02:10 user nova-compute[74039]:     <acpi/>
Oct 20 09:02:10 user nova-compute[74039]:     <apic/>
Oct 20 09:02:10 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:02:10 user nova-compute[74039]:   </features>
Oct 20 09:02:10 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:02:10 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:02:10 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:02:10 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:02:10 user nova-compute[74039]:   </clock>
Oct 20 09:02:10 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:02:10 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:02:10 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:02:10 user nova-compute[74039]:   </cpu>
Oct 20 09:02:10 user nova-compute[74039]:   <devices>
Oct 20 09:02:10 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 09:02:10 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:02:10 user nova-compute[74039]:       <source dev="/dev/sdf"/>
Oct 20 09:02:10 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:02:10 user nova-compute[74039]:       <serial>761590b5-010a-47bc-9316-294b487cf5c1</serial>
Oct 20 09:02:10 user nova-compute[74039]:     </disk>
Oct 20 09:02:10 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:02:10 user nova-compute[74039]:       <mac address="fa:16:3e:d7:28:6b"/>
Oct 20 09:02:10 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:02:10 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:02:10 user nova-compute[74039]:       <target dev="tapd5f62963-37"/>
Oct 20 09:02:10 user nova-compute[74039]:     </interface>
Oct 20 09:02:10 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:02:10 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/00e09d93-3077-4770-abfd-b82ece646997/console.log" append="off"/>
Oct 20 09:02:10 user nova-compute[74039]:     </serial>
Oct 20 09:02:10 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:02:10 user nova-compute[74039]:     <video>
Oct 20 09:02:10 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:02:10 user nova-compute[74039]:     </video>
Oct 20 09:02:10 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:02:10 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:02:10 user nova-compute[74039]:     </rng>
Oct 20 09:02:10 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:02:10 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:02:10 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:02:10 user nova-compute[74039]:     </memballoon>
Oct 20 09:02:10 user nova-compute[74039]:   </devices>
Oct 20 09:02:10 user nova-compute[74039]: </domain>
Oct 20 09:02:10 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-456868217',display_name='tempest-ServerActionsTestOtherA-server-456868217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-456868217',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyyJ62onAPVNIcWwPgu8Qk09h8heuIgT4K5VQCSSgQo1m6HsMw9upnfKrs0KtZmErwiBvOSQvzot9EsqbPyLMmcaHuqRr6HWOREqecRp8rh7oJxELHXOR3Is97nl7PEUA==',key_name='tempest-keypair-612179765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88a58985dce3491d8e45e6e468e0e549',ramdisk_id='',reservation_id='r-ed0qaebc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1138208404',owner_user_name='tempest-ServerActionsTestOtherA-1138208404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb823f0374a04657be729eb153160659',uuid=00e09d93-3077-4770-abfd-b82ece646997,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converting VIF {"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:28:6b,bridge_name='br-int',has_traffic_filtering=True,id=d5f62963-3776-4468-b582-f2d31bf6a2be,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f62963-37') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG os_vif [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:28:6b,bridge_name='br-int',has_traffic_filtering=True,id=d5f62963-3776-4468-b582-f2d31bf6a2be,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f62963-37') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '899230dd-2c5b-5384-a04d-a24f330f6656', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5f62963-37, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5f62963-37, col_values=(('qos', UUID('b41af2c3-2bab-4486-9b69-fe65cbbac80d')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5f62963-37, col_values=(('external_ids', {'iface-id': 'd5f62963-3776-4468-b582-f2d31bf6a2be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:28:6b', 'vm-uuid': '00e09d93-3077-4770-abfd-b82ece646997'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:02:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:10 user nova-compute[74039]: INFO os_vif [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:28:6b,bridge_name='br-int',has_traffic_filtering=True,id=d5f62963-3776-4468-b582-f2d31bf6a2be,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f62963-37')
Oct 20 09:02:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:02:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] No VIF found with MAC fa:16:3e:d7:28:6b, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:02:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:12 user nova-compute[74039]: DEBUG nova.compute.manager [req-4df7ce27-8d78-4410-a100-206ef13e81a6 req-424289b2-ed9b-4f1f-b146-64392088b8ce service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received event network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:02:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4df7ce27-8d78-4410-a100-206ef13e81a6 req-424289b2-ed9b-4f1f-b146-64392088b8ce service nova] Acquiring lock "00e09d93-3077-4770-abfd-b82ece646997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:02:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4df7ce27-8d78-4410-a100-206ef13e81a6 req-424289b2-ed9b-4f1f-b146-64392088b8ce service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:02:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4df7ce27-8d78-4410-a100-206ef13e81a6 req-424289b2-ed9b-4f1f-b146-64392088b8ce service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:02:12 user nova-compute[74039]: DEBUG nova.compute.manager [req-4df7ce27-8d78-4410-a100-206ef13e81a6 req-424289b2-ed9b-4f1f-b146-64392088b8ce service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] No waiting events found dispatching network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:02:12 user nova-compute[74039]: WARNING nova.compute.manager [req-4df7ce27-8d78-4410-a100-206ef13e81a6 req-424289b2-ed9b-4f1f-b146-64392088b8ce service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received unexpected event network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be for instance with vm_state building and task_state spawning.
Oct 20 09:02:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:14 user nova-compute[74039]: DEBUG nova.compute.manager [req-f4c27d24-ee84-42b0-8bdb-c4b4801b8960 req-35696a93-af9d-4937-89d3-4b95b3118a12 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received event network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:02:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f4c27d24-ee84-42b0-8bdb-c4b4801b8960 req-35696a93-af9d-4937-89d3-4b95b3118a12 service nova] Acquiring lock "00e09d93-3077-4770-abfd-b82ece646997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:02:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f4c27d24-ee84-42b0-8bdb-c4b4801b8960 req-35696a93-af9d-4937-89d3-4b95b3118a12 service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:02:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f4c27d24-ee84-42b0-8bdb-c4b4801b8960 req-35696a93-af9d-4937-89d3-4b95b3118a12 service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:02:14 user nova-compute[74039]: DEBUG nova.compute.manager [req-f4c27d24-ee84-42b0-8bdb-c4b4801b8960 req-35696a93-af9d-4937-89d3-4b95b3118a12 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] No waiting events found dispatching network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:02:14 user nova-compute[74039]: WARNING nova.compute.manager [req-f4c27d24-ee84-42b0-8bdb-c4b4801b8960 req-35696a93-af9d-4937-89d3-4b95b3118a12 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received unexpected event network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be for instance with vm_state building and task_state spawning.
Oct 20 09:02:14 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:02:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:02:14 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Instance spawned successfully.
Oct 20 09:02:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:02:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:02:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:02:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:02:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:02:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:02:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:02:14 user nova-compute[74039]: INFO nova.compute.manager [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Took 5.52 seconds to spawn the instance on the hypervisor.
Oct 20 09:02:14 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:02:15 user nova-compute[74039]: INFO nova.compute.manager [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Took 42.38 seconds to build instance.
Oct 20 09:02:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f1a6e379-48bf-4c1d-813f-077f8bc05ecc tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "00e09d93-3077-4770-abfd-b82ece646997" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.476s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:02:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-8f1c0f70-c33c-4e5c-b65b-2089c8492b16 req-59544f50-e6b9-479e-adf4-1ed054de5a1c service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received event network-changed-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:02:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-8f1c0f70-c33c-4e5c-b65b-2089c8492b16 req-59544f50-e6b9-479e-adf4-1ed054de5a1c service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Refreshing instance network info cache due to event network-changed-7f2d5682-0113-40f4-8bbb-02e87564b7ef. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:02:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8f1c0f70-c33c-4e5c-b65b-2089c8492b16 req-59544f50-e6b9-479e-adf4-1ed054de5a1c service nova] Acquiring lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:02:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8f1c0f70-c33c-4e5c-b65b-2089c8492b16 req-59544f50-e6b9-479e-adf4-1ed054de5a1c service nova] Acquired lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:02:23 user nova-compute[74039]: DEBUG nova.network.neutron [req-8f1c0f70-c33c-4e5c-b65b-2089c8492b16 req-59544f50-e6b9-479e-adf4-1ed054de5a1c service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Refreshing network info cache for port 7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:02:23 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:02:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-c8054dbd-c0ae-45d2-af95-dae7d05f8c69" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-c8054dbd-c0ae-45d2-af95-dae7d05f8c69" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG nova.network.neutron [req-8f1c0f70-c33c-4e5c-b65b-2089c8492b16 req-59544f50-e6b9-479e-adf4-1ed054de5a1c service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Updated VIF entry in instance network info cache for port 7f2d5682-0113-40f4-8bbb-02e87564b7ef. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG nova.network.neutron [req-8f1c0f70-c33c-4e5c-b65b-2089c8492b16 req-59544f50-e6b9-479e-adf4-1ed054de5a1c service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Updating instance_info_cache with network_info: [{"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8f1c0f70-c33c-4e5c-b65b-2089c8492b16 req-59544f50-e6b9-479e-adf4-1ed054de5a1c service nova] Releasing lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Acquiring lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:02:24 user nova-compute[74039]: INFO nova.compute.claims [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Claim successful on node user
Oct 20 09:02:24 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Updating instance_info_cache with network_info: [{"id": "24716055-5932-4507-8742-840afce654a2", "address": "fa:16:3e:3e:2e:b3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24716055-59", "ovs_interfaceid": "24716055-5932-4507-8742-840afce654a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-c8054dbd-c0ae-45d2-af95-dae7d05f8c69" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "03e487d1-90aa-436d-9c2f-468f9791af91" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "03e487d1-90aa-436d-9c2f-468f9791af91" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:02:24 user nova-compute[74039]: INFO nova.compute.manager [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Detaching volume 9142d9e6-9d0b-4920-aa08-e05ace57cbbf
Oct 20 09:02:24 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:02:24 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:02:25 user nova-compute[74039]: INFO nova.virt.block_device [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Attempting to driver detach volume 9142d9e6-9d0b-4920-aa08-e05ace57cbbf from mountpoint /dev/vdb
Oct 20 09:02:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG nova.compute.manager [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Attempting to detach device vdb from instance 03e487d1-90aa-436d-9c2f-468f9791af91 from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:02:25 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:02:25 user nova-compute[74039]:   <source dev="/dev/sdd"/>
Oct 20 09:02:25 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:02:25 user nova-compute[74039]:   <serial>9142d9e6-9d0b-4920-aa08-e05ace57cbbf</serial>
Oct 20 09:02:25 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 09:02:25 user nova-compute[74039]: </disk>
Oct 20 09:02:25 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:02:25 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Successfully detached device vdb from instance 03e487d1-90aa-436d-9c2f-468f9791af91 from the persistent domain config.
Oct 20 09:02:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03e487d1-90aa-436d-9c2f-468f9791af91 from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:02:25 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:02:25 user nova-compute[74039]:   <source dev="/dev/sdd"/>
Oct 20 09:02:25 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:02:25 user nova-compute[74039]:   <serial>9142d9e6-9d0b-4920-aa08-e05ace57cbbf</serial>
Oct 20 09:02:25 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 09:02:25 user nova-compute[74039]: </disk>
Oct 20 09:02:25 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG nova.compute.manager [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG nova.network.neutron [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:02:25 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:02:25 user nova-compute[74039]: DEBUG nova.compute.manager [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG nova.policy [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '644af097c95f4a26817492be77c327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7181660fb3d4a3e995e2ccd85dfe3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG nova.compute.manager [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:02:25 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Creating image(s)
Oct 20 09:02:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "/opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "/opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.181s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03e487d1-90aa-436d-9c2f-468f9791af91 {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.194s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea/disk 1073741824" returned: 0 in 0.058s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG nova.network.neutron [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Successfully created port: ab3b01d7-26b5-4041-9b32-d609e2e2663e {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG nova.compute.manager [req-ab37ae8a-006a-477f-b783-ae9d2255d497 req-0c8dab87-aa1a-482e-ad84-2a646b65f5f4 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received event network-changed-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG nova.compute.manager [req-ab37ae8a-006a-477f-b783-ae9d2255d497 req-0c8dab87-aa1a-482e-ad84-2a646b65f5f4 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Refreshing instance network info cache due to event network-changed-7f2d5682-0113-40f4-8bbb-02e87564b7ef. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ab37ae8a-006a-477f-b783-ae9d2255d497 req-0c8dab87-aa1a-482e-ad84-2a646b65f5f4 service nova] Acquiring lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ab37ae8a-006a-477f-b783-ae9d2255d497 req-0c8dab87-aa1a-482e-ad84-2a646b65f5f4 service nova] Acquired lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG nova.network.neutron [req-ab37ae8a-006a-477f-b783-ae9d2255d497 req-0c8dab87-aa1a-482e-ad84-2a646b65f5f4 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Refreshing network info cache for port 7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Cannot resize image /opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Ensure instance console log exists: /opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.network.neutron [req-ab37ae8a-006a-477f-b783-ae9d2255d497 req-0c8dab87-aa1a-482e-ad84-2a646b65f5f4 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Updated VIF entry in instance network info cache for port 7f2d5682-0113-40f4-8bbb-02e87564b7ef. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.network.neutron [req-ab37ae8a-006a-477f-b783-ae9d2255d497 req-0c8dab87-aa1a-482e-ad84-2a646b65f5f4 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Updating instance_info_cache with network_info: [{"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ab37ae8a-006a-477f-b783-ae9d2255d497 req-0c8dab87-aa1a-482e-ad84-2a646b65f5f4 service nova] Releasing lock "refresh_cache-03e487d1-90aa-436d-9c2f-468f9791af91" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Successfully updated port: ab3b01d7-26b5-4041-9b32-d609e2e2663e {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Acquiring lock "refresh_cache-f8236653-a179-4d3f-9bd3-4c91c85aeaea" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Acquired lock "refresh_cache-f8236653-a179-4d3f-9bd3-4c91c85aeaea" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-69246aa7-4cf9-4807-8229-1cb300967639 req-8f4c40e4-0f7f-491c-86c7-313845680caa service nova] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Received event network-changed-ab3b01d7-26b5-4041-9b32-d609e2e2663e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-69246aa7-4cf9-4807-8229-1cb300967639 req-8f4c40e4-0f7f-491c-86c7-313845680caa service nova] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Refreshing instance network info cache due to event network-changed-ab3b01d7-26b5-4041-9b32-d609e2e2663e. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-69246aa7-4cf9-4807-8229-1cb300967639 req-8f4c40e4-0f7f-491c-86c7-313845680caa service nova] Acquiring lock "refresh_cache-f8236653-a179-4d3f-9bd3-4c91c85aeaea" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Updating instance_info_cache with network_info: [{"id": "ab3b01d7-26b5-4041-9b32-d609e2e2663e", "address": "fa:16:3e:fb:93:8c", "network": {"id": "0d9cc42e-a86c-4a9b-bab9-179e24144ea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-339724642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7181660fb3d4a3e995e2ccd85dfe3c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3b01d7-26", "ovs_interfaceid": "ab3b01d7-26b5-4041-9b32-d609e2e2663e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Releasing lock "refresh_cache-f8236653-a179-4d3f-9bd3-4c91c85aeaea" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Instance network_info: |[{"id": "ab3b01d7-26b5-4041-9b32-d609e2e2663e", "address": "fa:16:3e:fb:93:8c", "network": {"id": "0d9cc42e-a86c-4a9b-bab9-179e24144ea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-339724642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7181660fb3d4a3e995e2ccd85dfe3c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3b01d7-26", "ovs_interfaceid": "ab3b01d7-26b5-4041-9b32-d609e2e2663e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-69246aa7-4cf9-4807-8229-1cb300967639 req-8f4c40e4-0f7f-491c-86c7-313845680caa service nova] Acquired lock "refresh_cache-f8236653-a179-4d3f-9bd3-4c91c85aeaea" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.network.neutron [req-69246aa7-4cf9-4807-8229-1cb300967639 req-8f4c40e4-0f7f-491c-86c7-313845680caa service nova] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Refreshing network info cache for port ab3b01d7-26b5-4041-9b32-d609e2e2663e {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Start _get_guest_xml network_info=[{"id": "ab3b01d7-26b5-4041-9b32-d609e2e2663e", "address": "fa:16:3e:fb:93:8c", "network": {"id": "0d9cc42e-a86c-4a9b-bab9-179e24144ea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-339724642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7181660fb3d4a3e995e2ccd85dfe3c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3b01d7-26", "ovs_interfaceid": "ab3b01d7-26b5-4041-9b32-d609e2e2663e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:02:26 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:02:26 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:02:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-580631099',display_name='tempest-VolumesActionsTest-instance-580631099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-580631099',id=26,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7181660fb3d4a3e995e2ccd85dfe3c2',ramdisk_id='',reservation_id='r-qzppjiyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2122958476',owner_user_name='tempest-VolumesActionsTest-2122958476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:02:25Z,user_data=None,user_id='644af097c95f4a26817492be77c327d9',uuid=f8236653-a179-4d3f-9bd3-4c91c85aeaea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab3b01d7-26b5-4041-9b32-d609e2e2663e", "address": "fa:16:3e:fb:93:8c", "network": {"id": "0d9cc42e-a86c-4a9b-bab9-179e24144ea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-339724642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7181660fb3d4a3e995e2ccd85dfe3c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3b01d7-26", "ovs_interfaceid": "ab3b01d7-26b5-4041-9b32-d609e2e2663e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Converting VIF {"id": "ab3b01d7-26b5-4041-9b32-d609e2e2663e", "address": "fa:16:3e:fb:93:8c", "network": {"id": "0d9cc42e-a86c-4a9b-bab9-179e24144ea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-339724642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7181660fb3d4a3e995e2ccd85dfe3c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3b01d7-26", "ovs_interfaceid": "ab3b01d7-26b5-4041-9b32-d609e2e2663e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:93:8c,bridge_name='br-int',has_traffic_filtering=True,id=ab3b01d7-26b5-4041-9b32-d609e2e2663e,network=Network(0d9cc42e-a86c-4a9b-bab9-179e24144ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3b01d7-26') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG nova.objects.instance [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lazy-loading 'pci_devices' on Instance uuid f8236653-a179-4d3f-9bd3-4c91c85aeaea {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:02:27 user nova-compute[74039]:   <uuid>f8236653-a179-4d3f-9bd3-4c91c85aeaea</uuid>
Oct 20 09:02:27 user nova-compute[74039]:   <name>instance-0000001a</name>
Oct 20 09:02:27 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:02:27 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:02:27 user nova-compute[74039]:   <metadata>
Oct 20 09:02:27 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:02:27 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:02:27 user nova-compute[74039]:       <nova:name>tempest-VolumesActionsTest-instance-580631099</nova:name>
Oct 20 09:02:27 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:02:26</nova:creationTime>
Oct 20 09:02:27 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:02:27 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:02:27 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:02:27 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:02:27 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:02:27 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:02:27 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:02:27 user nova-compute[74039]:       <nova:owner>
Oct 20 09:02:27 user nova-compute[74039]:         <nova:user uuid="644af097c95f4a26817492be77c327d9">tempest-VolumesActionsTest-2122958476-project-member</nova:user>
Oct 20 09:02:27 user nova-compute[74039]:         <nova:project uuid="e7181660fb3d4a3e995e2ccd85dfe3c2">tempest-VolumesActionsTest-2122958476</nova:project>
Oct 20 09:02:27 user nova-compute[74039]:       </nova:owner>
Oct 20 09:02:27 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:02:27 user nova-compute[74039]:       <nova:ports>
Oct 20 09:02:27 user nova-compute[74039]:         <nova:port uuid="ab3b01d7-26b5-4041-9b32-d609e2e2663e">
Oct 20 09:02:27 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 09:02:27 user nova-compute[74039]:         </nova:port>
Oct 20 09:02:27 user nova-compute[74039]:       </nova:ports>
Oct 20 09:02:27 user nova-compute[74039]:     </nova:instance>
Oct 20 09:02:27 user nova-compute[74039]:   </metadata>
Oct 20 09:02:27 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:02:27 user nova-compute[74039]:     <system>
Oct 20 09:02:27 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:02:27 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:02:27 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:02:27 user nova-compute[74039]:       <entry name="serial">f8236653-a179-4d3f-9bd3-4c91c85aeaea</entry>
Oct 20 09:02:27 user nova-compute[74039]:       <entry name="uuid">f8236653-a179-4d3f-9bd3-4c91c85aeaea</entry>
Oct 20 09:02:27 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:02:27 user nova-compute[74039]:     </system>
Oct 20 09:02:27 user nova-compute[74039]:   </sysinfo>
Oct 20 09:02:27 user nova-compute[74039]:   <os>
Oct 20 09:02:27 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:02:27 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:02:27 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:02:27 user nova-compute[74039]:   </os>
Oct 20 09:02:27 user nova-compute[74039]:   <features>
Oct 20 09:02:27 user nova-compute[74039]:     <acpi/>
Oct 20 09:02:27 user nova-compute[74039]:     <apic/>
Oct 20 09:02:27 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:02:27 user nova-compute[74039]:   </features>
Oct 20 09:02:27 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:02:27 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:02:27 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:02:27 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:02:27 user nova-compute[74039]:   </clock>
Oct 20 09:02:27 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:02:27 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:02:27 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:02:27 user nova-compute[74039]:   </cpu>
Oct 20 09:02:27 user nova-compute[74039]:   <devices>
Oct 20 09:02:27 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:02:27 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:02:27 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea/disk"/>
Oct 20 09:02:27 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:02:27 user nova-compute[74039]:     </disk>
Oct 20 09:02:27 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:02:27 user nova-compute[74039]:       <mac address="fa:16:3e:fb:93:8c"/>
Oct 20 09:02:27 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:02:27 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:02:27 user nova-compute[74039]:       <target dev="tapab3b01d7-26"/>
Oct 20 09:02:27 user nova-compute[74039]:     </interface>
Oct 20 09:02:27 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:02:27 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea/console.log" append="off"/>
Oct 20 09:02:27 user nova-compute[74039]:     </serial>
Oct 20 09:02:27 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:02:27 user nova-compute[74039]:     <video>
Oct 20 09:02:27 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:02:27 user nova-compute[74039]:     </video>
Oct 20 09:02:27 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:02:27 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:02:27 user nova-compute[74039]:     </rng>
Oct 20 09:02:27 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:02:27 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:02:27 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:02:27 user nova-compute[74039]:     </memballoon>
Oct 20 09:02:27 user nova-compute[74039]:   </devices>
Oct 20 09:02:27 user nova-compute[74039]: </domain>
Oct 20 09:02:27 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-580631099',display_name='tempest-VolumesActionsTest-instance-580631099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-580631099',id=26,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7181660fb3d4a3e995e2ccd85dfe3c2',ramdisk_id='',reservation_id='r-qzppjiyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2122958476',owner_user_name='tempest-VolumesActionsTest-2122958476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:02:25Z,user_data=None,user_id='644af097c95f4a26817492be77c327d9',uuid=f8236653-a179-4d3f-9bd3-4c91c85aeaea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab3b01d7-26b5-4041-9b32-d609e2e2663e", "address": "fa:16:3e:fb:93:8c", "network": {"id": "0d9cc42e-a86c-4a9b-bab9-179e24144ea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-339724642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7181660fb3d4a3e995e2ccd85dfe3c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3b01d7-26", "ovs_interfaceid": "ab3b01d7-26b5-4041-9b32-d609e2e2663e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Converting VIF {"id": "ab3b01d7-26b5-4041-9b32-d609e2e2663e", "address": "fa:16:3e:fb:93:8c", "network": {"id": "0d9cc42e-a86c-4a9b-bab9-179e24144ea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-339724642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7181660fb3d4a3e995e2ccd85dfe3c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3b01d7-26", "ovs_interfaceid": "ab3b01d7-26b5-4041-9b32-d609e2e2663e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:93:8c,bridge_name='br-int',has_traffic_filtering=True,id=ab3b01d7-26b5-4041-9b32-d609e2e2663e,network=Network(0d9cc42e-a86c-4a9b-bab9-179e24144ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3b01d7-26') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG os_vif [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:93:8c,bridge_name='br-int',has_traffic_filtering=True,id=ab3b01d7-26b5-4041-9b32-d609e2e2663e,network=Network(0d9cc42e-a86c-4a9b-bab9-179e24144ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3b01d7-26') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '668d1455-5ceb-5622-9d06-fdde34015d43', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab3b01d7-26, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab3b01d7-26, col_values=(('qos', UUID('03d348b0-e208-472c-826e-ecc6e2f15b2b')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab3b01d7-26, col_values=(('external_ids', {'iface-id': 'ab3b01d7-26b5-4041-9b32-d609e2e2663e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:93:8c', 'vm-uuid': 'f8236653-a179-4d3f-9bd3-4c91c85aeaea'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:27 user nova-compute[74039]: INFO os_vif [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:93:8c,bridge_name='br-int',has_traffic_filtering=True,id=ab3b01d7-26b5-4041-9b32-d609e2e2663e,network=Network(0d9cc42e-a86c-4a9b-bab9-179e24144ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3b01d7-26')
Oct 20 09:02:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] No VIF found with MAC fa:16:3e:fb:93:8c, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG nova.network.neutron [req-69246aa7-4cf9-4807-8229-1cb300967639 req-8f4c40e4-0f7f-491c-86c7-313845680caa service nova] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Updated VIF entry in instance network info cache for port ab3b01d7-26b5-4041-9b32-d609e2e2663e. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG nova.network.neutron [req-69246aa7-4cf9-4807-8229-1cb300967639 req-8f4c40e4-0f7f-491c-86c7-313845680caa service nova] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Updating instance_info_cache with network_info: [{"id": "ab3b01d7-26b5-4041-9b32-d609e2e2663e", "address": "fa:16:3e:fb:93:8c", "network": {"id": "0d9cc42e-a86c-4a9b-bab9-179e24144ea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-339724642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7181660fb3d4a3e995e2ccd85dfe3c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3b01d7-26", "ovs_interfaceid": "ab3b01d7-26b5-4041-9b32-d609e2e2663e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:02:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-69246aa7-4cf9-4807-8229-1cb300967639 req-8f4c40e4-0f7f-491c-86c7-313845680caa service nova] Releasing lock "refresh_cache-f8236653-a179-4d3f-9bd3-4c91c85aeaea" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:02:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-febd49e2-b65a-4b61-abe8-ee0ff87199e9 req-9918ca89-a8db-4b51-bdcb-d11501941366 service nova] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Received event network-vif-plugged-ab3b01d7-26b5-4041-9b32-d609e2e2663e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:02:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-febd49e2-b65a-4b61-abe8-ee0ff87199e9 req-9918ca89-a8db-4b51-bdcb-d11501941366 service nova] Acquiring lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:02:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-febd49e2-b65a-4b61-abe8-ee0ff87199e9 req-9918ca89-a8db-4b51-bdcb-d11501941366 service nova] Lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:02:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-febd49e2-b65a-4b61-abe8-ee0ff87199e9 req-9918ca89-a8db-4b51-bdcb-d11501941366 service nova] Lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:02:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-febd49e2-b65a-4b61-abe8-ee0ff87199e9 req-9918ca89-a8db-4b51-bdcb-d11501941366 service nova] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] No waiting events found dispatching network-vif-plugged-ab3b01d7-26b5-4041-9b32-d609e2e2663e {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:02:28 user nova-compute[74039]: WARNING nova.compute.manager [req-febd49e2-b65a-4b61-abe8-ee0ff87199e9 req-9918ca89-a8db-4b51-bdcb-d11501941366 service nova] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Received unexpected event network-vif-plugged-ab3b01d7-26b5-4041-9b32-d609e2e2663e for instance with vm_state building and task_state spawning.
Oct 20 09:02:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:02:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:02:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:02:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:02:29 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:02:30 user nova-compute[74039]: DEBUG nova.compute.manager [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:02:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:02:30 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Instance spawned successfully.
Oct 20 09:02:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:02:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:02:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:02:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:02:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:02:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:02:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:02:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-53e4bcb9-5af9-4b69-b0ee-5849d801e157 req-9c5029e4-960e-4494-b95c-4d9d1987c8d2 service nova] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Received event network-vif-plugged-ab3b01d7-26b5-4041-9b32-d609e2e2663e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:02:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-53e4bcb9-5af9-4b69-b0ee-5849d801e157 req-9c5029e4-960e-4494-b95c-4d9d1987c8d2 service nova] Acquiring lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:02:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-53e4bcb9-5af9-4b69-b0ee-5849d801e157 req-9c5029e4-960e-4494-b95c-4d9d1987c8d2 service nova] Lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:02:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-53e4bcb9-5af9-4b69-b0ee-5849d801e157 req-9c5029e4-960e-4494-b95c-4d9d1987c8d2 service nova] Lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:02:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-53e4bcb9-5af9-4b69-b0ee-5849d801e157 req-9c5029e4-960e-4494-b95c-4d9d1987c8d2 service nova] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] No waiting events found dispatching network-vif-plugged-ab3b01d7-26b5-4041-9b32-d609e2e2663e {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:02:30 user nova-compute[74039]: WARNING nova.compute.manager [req-53e4bcb9-5af9-4b69-b0ee-5849d801e157 req-9c5029e4-960e-4494-b95c-4d9d1987c8d2 service nova] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Received unexpected event network-vif-plugged-ab3b01d7-26b5-4041-9b32-d609e2e2663e for instance with vm_state building and task_state spawning.
Oct 20 09:02:30 user nova-compute[74039]: INFO nova.compute.manager [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Took 5.60 seconds to spawn the instance on the hypervisor.
Oct 20 09:02:30 user nova-compute[74039]: DEBUG nova.compute.manager [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:02:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:30 user nova-compute[74039]: INFO nova.compute.manager [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Took 6.52 seconds to build instance.
Oct 20 09:02:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-69a0e1dc-5746-4022-80a3-7954a200ee66 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.648s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:02:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json" returned: 0 in 0.448s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:02:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:02:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "d61f84a9-85ea-40aa-b21e-45064b3bc090" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:02:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "d61f84a9-85ea-40aa-b21e-45064b3bc090" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:02:33 user nova-compute[74039]: INFO nova.compute.manager [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Detaching volume 09600f2c-6f8a-4f8b-806a-511c7b63846e
Oct 20 09:02:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:34 user nova-compute[74039]: INFO nova.virt.block_device [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Attempting to driver detach volume 09600f2c-6f8a-4f8b-806a-511c7b63846e from mountpoint /dev/vdb
Oct 20 09:02:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Attempting to detach device vdb from instance d61f84a9-85ea-40aa-b21e-45064b3bc090 from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 09:02:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:02:34 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:02:34 user nova-compute[74039]:   <source dev="/dev/sdc"/>
Oct 20 09:02:34 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:02:34 user nova-compute[74039]:   <serial>09600f2c-6f8a-4f8b-806a-511c7b63846e</serial>
Oct 20 09:02:34 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:02:34 user nova-compute[74039]: </disk>
Oct 20 09:02:34 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:02:34 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Successfully detached device vdb from instance d61f84a9-85ea-40aa-b21e-45064b3bc090 from the persistent domain config.
Oct 20 09:02:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d61f84a9-85ea-40aa-b21e-45064b3bc090 from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 09:02:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:02:34 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:02:34 user nova-compute[74039]:   <source dev="/dev/sdc"/>
Oct 20 09:02:34 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:02:34 user nova-compute[74039]:   <serial>09600f2c-6f8a-4f8b-806a-511c7b63846e</serial>
Oct 20 09:02:34 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:02:34 user nova-compute[74039]: </disk>
Oct 20 09:02:34 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:02:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:02:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d61f84a9-85ea-40aa-b21e-45064b3bc090 {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 09:02:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:02:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:36 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:02:36 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:02:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=6933MB free_disk=25.435474395751953GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:02:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:02:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:02:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Applying migration context for instance ebaa4804-32e5-4fff-9562-0587ff7ca4ed as it has an incoming, in-progress migration 242a5b7f-5026-4dba-b30a-aeb328c19394. Migration status is finished {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 09:02:37 user nova-compute[74039]: INFO nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Updating resource usage from migration 242a5b7f-5026-4dba-b30a-aeb328c19394
Oct 20 09:02:37 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 9fe77a96-fcb5-4410-85cc-58d925548e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:02:37 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c8054dbd-c0ae-45d2-af95-dae7d05f8c69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:02:37 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:02:37 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 03e487d1-90aa-436d-9c2f-468f9791af91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:02:37 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:02:37 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance d61f84a9-85ea-40aa-b21e-45064b3bc090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:02:37 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Migration 242a5b7f-5026-4dba-b30a-aeb328c19394 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 09:02:37 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance ebaa4804-32e5-4fff-9562-0587ff7ca4ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:02:37 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 8af05cc2-c1b2-4187-b16e-5fbeb006de6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:02:37 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4f5d98e3-c1f6-4617-8847-b975e2c23990 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:02:37 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 00e09d93-3077-4770-abfd-b82ece646997 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:02:37 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance e14ecf11-28b6-421d-875f-0ce9a21999d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:02:37 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance def7ee9b-e0ed-4c95-961c-c6d79144f0ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:02:37 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance f8236653-a179-4d3f-9bd3-4c91c85aeaea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:02:37 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:02:37 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:02:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:37 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:02:37 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:02:37 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:02:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.628s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:02:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:38 user nova-compute[74039]: DEBUG nova.compute.manager [req-53c1fdde-b78a-48c8-88e5-85de84806589 req-61bd6bc2-d89f-4369-80d3-907078d9d57d service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Received event network-changed-e3f15714-c9a3-44e4-832a-953cf2dbed61 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:02:38 user nova-compute[74039]: DEBUG nova.compute.manager [req-53c1fdde-b78a-48c8-88e5-85de84806589 req-61bd6bc2-d89f-4369-80d3-907078d9d57d service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Refreshing instance network info cache due to event network-changed-e3f15714-c9a3-44e4-832a-953cf2dbed61. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:02:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-53c1fdde-b78a-48c8-88e5-85de84806589 req-61bd6bc2-d89f-4369-80d3-907078d9d57d service nova] Acquiring lock "refresh_cache-8af05cc2-c1b2-4187-b16e-5fbeb006de6a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:02:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-53c1fdde-b78a-48c8-88e5-85de84806589 req-61bd6bc2-d89f-4369-80d3-907078d9d57d service nova] Acquired lock "refresh_cache-8af05cc2-c1b2-4187-b16e-5fbeb006de6a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:02:38 user nova-compute[74039]: DEBUG nova.network.neutron [req-53c1fdde-b78a-48c8-88e5-85de84806589 req-61bd6bc2-d89f-4369-80d3-907078d9d57d service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Refreshing network info cache for port e3f15714-c9a3-44e4-832a-953cf2dbed61 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:02:39 user nova-compute[74039]: DEBUG nova.network.neutron [req-53c1fdde-b78a-48c8-88e5-85de84806589 req-61bd6bc2-d89f-4369-80d3-907078d9d57d service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Updated VIF entry in instance network info cache for port e3f15714-c9a3-44e4-832a-953cf2dbed61. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:02:39 user nova-compute[74039]: DEBUG nova.network.neutron [req-53c1fdde-b78a-48c8-88e5-85de84806589 req-61bd6bc2-d89f-4369-80d3-907078d9d57d service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Updating instance_info_cache with network_info: [{"id": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "address": "fa:16:3e:e6:1f:b2", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f15714-c9", "ovs_interfaceid": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:02:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-53c1fdde-b78a-48c8-88e5-85de84806589 req-61bd6bc2-d89f-4369-80d3-907078d9d57d service nova] Releasing lock "refresh_cache-8af05cc2-c1b2-4187-b16e-5fbeb006de6a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:02:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:02:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:02:44 user nova-compute[74039]: DEBUG nova.objects.instance [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lazy-loading 'flavor' on Instance uuid 8af05cc2-c1b2-4187-b16e-5fbeb006de6a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:02:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:02:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:02:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:02:44 user nova-compute[74039]: INFO nova.compute.manager [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Attaching volume b7bf45ae-1f15-4a0e-81c5-7a75418433e8 to /dev/vdb
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.utils [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9505437-68b1-4c65-b039-8da23c7b1224]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6a322a-ce3f-4fc9-9070-1321a1539e00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae765ca5-5f25-42a5-ae64-63dfa68bbd41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4555078-5a8b-4d45-b788-d2553601a47c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:02:45 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d04efd6-90f3-407a-bcf4-2b305298f2d8]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.utils [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Updating existing volume attachment record: 4aba3063-065a-46fb-85f4-5b714dfedcc3 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:02:45 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 03e487d1-90aa-436d-9c2f-468f9791af91 is timed out.
Oct 20 09:02:45 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Successfully detached device vdb from instance 03e487d1-90aa-436d-9c2f-468f9791af91 from the live domain config.
Oct 20 09:02:45 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBhpJRXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:02:45 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceec5173-2262-44d6-9d68-b76a7e9cd805]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:02:45 user nova-compute[74039]: No targets found.
Oct 20 09:02:45 user nova-compute[74039]: iSNS:
Oct 20 09:02:45 user nova-compute[74039]: No targets found.
Oct 20 09:02:45 user nova-compute[74039]: STATIC:
Oct 20 09:02:45 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf
Oct 20 09:02:45 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:02:45 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:02:45 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1
Oct 20 09:02:45 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:02:45 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:02:45 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84
Oct 20 09:02:45 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:02:45 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:02:45 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf
Oct 20 09:02:45 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:02:45 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:02:45 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e
Oct 20 09:02:45 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:02:45 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:02:45 user nova-compute[74039]: FIRMWARE:
Oct 20 09:02:45 user nova-compute[74039]: No targets found.
Oct 20 09:02:45 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:02:45 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:02:45 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bbaafd-4d1f-4426-a908-e1cfa55a39ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b28555-40b7-4caa-bd22-e6812c753b23]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:02:45 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 09:02:45 user nova-compute[74039]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)
Oct 20 09:02:45 user nova-compute[74039]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:02:45 user nova-compute[74039]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:02:45 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:02:45 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 09:02:45 user nova-compute[74039]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf (non-flash)
Oct 20 09:02:45 user nova-compute[74039]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:02:45 user nova-compute[74039]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:02:45 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae841e1750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf'): ({'sdd'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Removing single pathed devices sdd {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[944f68fd-fb0a-46d3-bcff-438ab78ce18b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[376dc173-a94a-4f84-9e4d-803e908eb76e]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Flushing IO for device /dev/sdd {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de261cc-3340-453d-93c9-59b1554ffcab]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6dca64-424e-4fa4-adca-e0fd91e40103]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f082507-7f16-4ff8-afd0-0f223bce2ee5]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f733c8-beea-4127-8bde-cba3edfe01a0]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf, portal: 172.16.0.220,3260]
Oct 20 09:02:45 user nova-compute[74039]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf, portal: 172.16.0.220,3260] successful.
Oct 20 09:02:45 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9142d9e6-9d0b-4920-aa08-e05ace57cbbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee1edbe-9e58-491b-bae8-ab4ab0e58a98]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] <== disconnect_volume: return (346ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:02:45 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:02:46 user nova-compute[74039]: DEBUG nova.objects.instance [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lazy-loading 'flavor' on Instance uuid 03e487d1-90aa-436d-9c2f-468f9791af91 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:02:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6624e0ad-f038-48b6-ba23-516e11c441df tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "03e487d1-90aa-436d-9c2f-468f9791af91" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.904s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:02:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-73435a50-ec95-43ba-b09e-d622913a7bf9 req-e86dd6cc-1b57-4e03-ab82-e614342730c4 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-changed-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:02:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-73435a50-ec95-43ba-b09e-d622913a7bf9 req-e86dd6cc-1b57-4e03-ab82-e614342730c4 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Refreshing instance network info cache due to event network-changed-45971bed-5f51-4ebd-9641-e2cc09d91d71. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:02:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-73435a50-ec95-43ba-b09e-d622913a7bf9 req-e86dd6cc-1b57-4e03-ab82-e614342730c4 service nova] Acquiring lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:02:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-73435a50-ec95-43ba-b09e-d622913a7bf9 req-e86dd6cc-1b57-4e03-ab82-e614342730c4 service nova] Acquired lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:02:51 user nova-compute[74039]: DEBUG nova.network.neutron [req-73435a50-ec95-43ba-b09e-d622913a7bf9 req-e86dd6cc-1b57-4e03-ab82-e614342730c4 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Refreshing network info cache for port 45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:02:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:02:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:02:52 user nova-compute[74039]: INFO nova.compute.manager [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Detaching volume 90b8f68d-643c-4def-b0f8-fa41b129e2cf
Oct 20 09:02:52 user nova-compute[74039]: DEBUG nova.network.neutron [req-73435a50-ec95-43ba-b09e-d622913a7bf9 req-e86dd6cc-1b57-4e03-ab82-e614342730c4 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Updated VIF entry in instance network info cache for port 45971bed-5f51-4ebd-9641-e2cc09d91d71. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:02:52 user nova-compute[74039]: DEBUG nova.network.neutron [req-73435a50-ec95-43ba-b09e-d622913a7bf9 req-e86dd6cc-1b57-4e03-ab82-e614342730c4 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Updating instance_info_cache with network_info: [{"id": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "address": "fa:16:3e:0c:c9:b0", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45971bed-5f", "ovs_interfaceid": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:02:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-73435a50-ec95-43ba-b09e-d622913a7bf9 req-e86dd6cc-1b57-4e03-ab82-e614342730c4 service nova] Releasing lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:02:52 user nova-compute[74039]: INFO nova.virt.block_device [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Attempting to driver detach volume 90b8f68d-643c-4def-b0f8-fa41b129e2cf from mountpoint /dev/vdb
Oct 20 09:02:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Attempting to detach device vdb from instance 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 09:02:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:02:52 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:02:52 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 09:02:52 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:02:52 user nova-compute[74039]:   <serial>90b8f68d-643c-4def-b0f8-fa41b129e2cf</serial>
Oct 20 09:02:52 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:02:52 user nova-compute[74039]: </disk>
Oct 20 09:02:52 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:02:52 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Successfully detached device vdb from instance 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 from the persistent domain config.
Oct 20 09:02:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 09:02:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:02:52 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:02:52 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 09:02:52 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:02:52 user nova-compute[74039]:   <serial>90b8f68d-643c-4def-b0f8-fa41b129e2cf</serial>
Oct 20 09:02:52 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:02:52 user nova-compute[74039]: </disk>
Oct 20 09:02:52 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:02:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 09:02:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-a193fae6-2321-4012-b8bc-c4fbb372198d req-16283bc2-2fd0-4097-9e68-fdaa70b41674 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-changed-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:02:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-a193fae6-2321-4012-b8bc-c4fbb372198d req-16283bc2-2fd0-4097-9e68-fdaa70b41674 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Refreshing instance network info cache due to event network-changed-45971bed-5f51-4ebd-9641-e2cc09d91d71. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:02:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a193fae6-2321-4012-b8bc-c4fbb372198d req-16283bc2-2fd0-4097-9e68-fdaa70b41674 service nova] Acquiring lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:02:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a193fae6-2321-4012-b8bc-c4fbb372198d req-16283bc2-2fd0-4097-9e68-fdaa70b41674 service nova] Acquired lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:02:53 user nova-compute[74039]: DEBUG nova.network.neutron [req-a193fae6-2321-4012-b8bc-c4fbb372198d req-16283bc2-2fd0-4097-9e68-fdaa70b41674 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Refreshing network info cache for port 45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG nova.network.neutron [req-a193fae6-2321-4012-b8bc-c4fbb372198d req-16283bc2-2fd0-4097-9e68-fdaa70b41674 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Updated VIF entry in instance network info cache for port 45971bed-5f51-4ebd-9641-e2cc09d91d71. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG nova.network.neutron [req-a193fae6-2321-4012-b8bc-c4fbb372198d req-16283bc2-2fd0-4097-9e68-fdaa70b41674 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Updating instance_info_cache with network_info: [{"id": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "address": "fa:16:3e:0c:c9:b0", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45971bed-5f", "ovs_interfaceid": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a193fae6-2321-4012-b8bc-c4fbb372198d req-16283bc2-2fd0-4097-9e68-fdaa70b41674 service nova] Releasing lock "refresh_cache-2ae63f29-de62-4e82-877c-8bb4a3f2beb3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:02:54 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d61f84a9-85ea-40aa-b21e-45064b3bc090 is timed out.
Oct 20 09:02:54 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Successfully detached device vdb from instance d61f84a9-85ea-40aa-b21e-45064b3bc090 from the live domain config.
Oct 20 09:02:54 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wiqSIPXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:02:54 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:02:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4592ac-e082-4ae6-bdce-e513a4ebdc48]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:02:54 user nova-compute[74039]: No targets found.
Oct 20 09:02:54 user nova-compute[74039]: iSNS:
Oct 20 09:02:54 user nova-compute[74039]: No targets found.
Oct 20 09:02:54 user nova-compute[74039]: STATIC:
Oct 20 09:02:54 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1
Oct 20 09:02:54 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:02:54 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:02:54 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84
Oct 20 09:02:54 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:02:54 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:02:54 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf
Oct 20 09:02:54 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:02:54 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:02:54 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e
Oct 20 09:02:54 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:02:54 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:02:54 user nova-compute[74039]: FIRMWARE:
Oct 20 09:02:54 user nova-compute[74039]: No targets found.
Oct 20 09:02:54 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:02:54 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:02:54 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bb84c0-819b-4f85-abea-80339c1d0628]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede68f4d-c0b5-4381-be21-4a1fda96f248]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:02:54 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 09:02:54 user nova-compute[74039]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:02:54 user nova-compute[74039]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:02:54 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:02:54 user nova-compute[74039]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e (non-flash)
Oct 20 09:02:54 user nova-compute[74039]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:02:54 user nova-compute[74039]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:02:54 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae84410c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e'): ({'sdc'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Removing single pathed devices sdc {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68cca23-2e0a-4aff-b127-743f60cb90e9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[953e5a75-761d-4774-a917-2fb998567bd5]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Flushing IO for device /dev/sdc {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[de28217d-9fcc-4925-a940-92a3bc57b373]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa6694b-02fa-47fc-a99a-bf44f748d9fd]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ea4fd1-9ffb-4495-9f23-aab5c04f1537]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:02:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8298db8c-1dbc-42bf-bde4-524bfb941249]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e, portal: 172.16.0.220,3260]
Oct 20 09:02:55 user nova-compute[74039]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e, portal: 172.16.0.220,3260] successful.
Oct 20 09:02:55 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:02:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:02:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09600f2c-6f8a-4f8b-806a-511c7b63846e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:02:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b262d1e7-0403-4af9-8b36-9f8301a03472]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:02:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:02:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:02:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] <== disconnect_volume: return (386ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:02:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:02:55 user nova-compute[74039]: DEBUG nova.objects.instance [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lazy-loading 'flavor' on Instance uuid d61f84a9-85ea-40aa-b21e-45064b3bc090 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:02:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9effd1a1-d5da-4015-958e-f1f6d6212572 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "d61f84a9-85ea-40aa-b21e-45064b3bc090" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.932s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:02:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:02:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TJFUzZwD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:03:02 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:03:02 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:03:02 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[be764d66-ff72-4cae-a668-89a859d64c3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:03:02 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd71fca-b92d-4673-8d5e-a34bc13efe52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8] added
Oct 20 09:03:02 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf427a3-7da7-4c11-8442-4272fb9e9e24]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6a8151-aed4-494a-a5b7-a88d0142495f]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TJFUzZwD {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TJFUzZwD" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[db092eaf-f9ee-4532-997f-15620ff4cba7]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TJFUzZwD'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0ba666-6c02-42e1-b825-0840342dd1c6]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ca005b-f3b6-4367-bf45-625bdf1259ba]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:03:02 user nova-compute[74039]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:03:02 user nova-compute[74039]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:03:02 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:03:02 user nova-compute[74039]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:03:02 user nova-compute[74039]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:03:02 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed5704b-f59c-4e47-8889-6eb234444b1e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8, portal: 172.16.0.220,3260]
Oct 20 09:03:02 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8, portal: 172.16.0.220,3260] successful.
Oct 20 09:03:02 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[084a0d8d-1c54-4d28-8ffd-867c253dae35]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fea69c-418a-41dc-a37a-9213ee50ccc2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:03:02 user nova-compute[74039]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:03:02 user nova-compute[74039]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:03:02 user nova-compute[74039]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:02 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:03:02 user nova-compute[74039]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:03:02 user nova-compute[74039]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:03:02 user nova-compute[74039]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:02 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80b6fd1-0700-40ce-941a-acd4368c0823]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:03:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TJFUzZwD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:03:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:03:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23165303063343432', 'path': '/dev/sdc'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:03:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165303063343432', 'path': '/dev/sdc'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:03:03 user nova-compute[74039]: DEBUG nova.objects.instance [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lazy-loading 'flavor' on Instance uuid 8af05cc2-c1b2-4187-b16e-5fbeb006de6a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:03:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 09:03:03 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:03:03 user nova-compute[74039]:   <source dev="/dev/sdc"/>
Oct 20 09:03:03 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:03:03 user nova-compute[74039]:   <serial>b7bf45ae-1f15-4a0e-81c5-7a75418433e8</serial>
Oct 20 09:03:03 user nova-compute[74039]: </disk>
Oct 20 09:03:03 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 09:03:04 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:03:04 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:03:04 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] No VIF found with MAC fa:16:3e:e6:1f:b2, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:03:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-be1f9d0a-2b05-4580-9dbd-3d157590d429 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.533s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG nova.objects.instance [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lazy-loading 'flavor' on Instance uuid 8af05cc2-c1b2-4187-b16e-5fbeb006de6a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG nova.network.neutron [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Port e7d9d83f-1522-47f7-ac4c-7dd56facfea7 binding to destination host user is already ACTIVE {{(pid=74039) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquired lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG nova.network.neutron [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:10 user nova-compute[74039]: INFO nova.compute.manager [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Attaching volume fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd to /dev/vdc
Oct 20 09:03:10 user nova-compute[74039]: DEBUG os_brick.utils [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcc018b-fa79-45f7-80ec-7ae45aa90a79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50199ca-95cf-4b90-a221-587663931e32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94963c4-4574-499b-908f-8aa8ce3cb27a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[221b0390-882f-4fa5-94cf-ac8dfcd88d90]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG nova.network.neutron [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Updating instance_info_cache with network_info: [{"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:03:10 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6043846-12a5-4e55-b1bd-e8b3adca7a74]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG os_brick.utils [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Updating existing volume attachment record: 5913c8e5-115a-4bcd-b65b-feefb278e66d {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Releasing lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Creating tmpfile /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/tmpv1r0r214 to verify with other compute node that the instance is on the same shared storage. {{(pid=74039) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-a146a7e5-249a-4360-ae06-0aa0fbba00af req-39942ebb-a098-4f28-ba89-a413d8ad43b7 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received event network-vif-unplugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a146a7e5-249a-4360-ae06-0aa0fbba00af req-39942ebb-a098-4f28-ba89-a413d8ad43b7 service nova] Acquiring lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a146a7e5-249a-4360-ae06-0aa0fbba00af req-39942ebb-a098-4f28-ba89-a413d8ad43b7 service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a146a7e5-249a-4360-ae06-0aa0fbba00af req-39942ebb-a098-4f28-ba89-a413d8ad43b7 service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:10 user nova-compute[74039]: DEBUG nova.compute.manager [req-a146a7e5-249a-4360-ae06-0aa0fbba00af req-39942ebb-a098-4f28-ba89-a413d8ad43b7 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] No waiting events found dispatching network-vif-unplugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:03:10 user nova-compute[74039]: WARNING nova.compute.manager [req-a146a7e5-249a-4360-ae06-0aa0fbba00af req-39942ebb-a098-4f28-ba89-a413d8ad43b7 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received unexpected event network-vif-unplugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 for instance with vm_state resized and task_state resize_reverting.
Oct 20 09:03:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:11 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Instance destroyed successfully.
Oct 20 09:03:11 user nova-compute[74039]: DEBUG nova.objects.instance [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lazy-loading 'resources' on Instance uuid ebaa4804-32e5-4fff-9562-0587ff7ca4ed {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-981664831',display_name='tempest-ServerActionsTestOtherB-server-981664831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-981664831',id=14,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLks5fH3OqnFIJYbiqhEyJYFZHff7b4Ae9JDwAsMmBzcCMiYxaXPw5gTAg3NjSBwdB4e4WBubdaiWR0mkFHpfIFMVWW5rKzlKquVWH/exNlZL5M7mfGJM5jL4+NyXysGbg==',key_name='tempest-keypair-748521120',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:01:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da44286b6f5b45fe9ccbd881754a9b3c',ramdisk_id='',reservation_id='r-2fnz9nzy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1010421968',owner_user_name='tempest-ServerActionsTestOtherB-1010421968-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:01:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='994701e77d9740f4a7a18390f9438996',uuid=ebaa4804-32e5-4fff-9562-0587ff7ca4ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Converting VIF {"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_vif [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7d9d83f-15, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=924f2e4c-0982-43e7-903b-1f03f7891ee8) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:11 user nova-compute[74039]: INFO os_vif [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15')
Oct 20 09:03:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZFEAJfq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:03:11 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ff8da7-7488-47e1-821d-7e10d2af2323]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:03:11 user nova-compute[74039]: No targets found.
Oct 20 09:03:11 user nova-compute[74039]: iSNS:
Oct 20 09:03:11 user nova-compute[74039]: No targets found.
Oct 20 09:03:11 user nova-compute[74039]: STATIC:
Oct 20 09:03:11 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8
Oct 20 09:03:11 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:03:11 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:03:11 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1
Oct 20 09:03:11 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:03:11 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:03:11 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84
Oct 20 09:03:11 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:03:11 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:03:11 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf
Oct 20 09:03:11 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:03:11 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:03:11 user nova-compute[74039]: FIRMWARE:
Oct 20 09:03:11 user nova-compute[74039]: No targets found.
Oct 20 09:03:11 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:03:11 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:03:11 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[73157a65-ad44-4710-b29b-4b8bf10e7602]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4553f7ee-a850-4d5b-83b3-274544b22f53]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:03:11 user nova-compute[74039]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:03:11 user nova-compute[74039]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:03:11 user nova-compute[74039]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:11 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:03:11 user nova-compute[74039]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:03:11 user nova-compute[74039]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:03:11 user nova-compute[74039]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:11 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae7c146950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84'): ({'sde'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Removing single pathed devices sde {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5bfcae-f245-42ef-9b8b-7ca37f2c16bb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2919d8-f935-412f-bf51-067ea1a3bfdc]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Flushing IO for device /dev/sde {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e9ccdd-1727-4197-ad67-1f0abf7a22d2]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ed2a12-8bac-4d6c-b2b4-0af3ffba9e25]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] SCSI volumes sde have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e84056-c019-4a05-a10e-c22b3c78b5cf]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[11eb9aa5-b7cb-45ee-ab28-3dfff48f9922]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260]
Oct 20 09:03:11 user nova-compute[74039]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260] successful.
Oct 20 09:03:11 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0db1db-fa4e-4d3e-ae62-0387ab5f467c]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] <== disconnect_volume: return (325ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:03:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG nova.objects.instance [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lazy-loading 'migration_context' on Instance uuid ebaa4804-32e5-4fff-9562-0587ff7ca4ed {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG nova.objects.base [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Object Instance<ebaa4804-32e5-4fff-9562-0587ff7ca4ed> lazy-loaded attributes: resources,migration_context {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:03:12 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 is timed out.
Oct 20 09:03:12 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Successfully detached device vdb from instance 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 from the live domain config.
Oct 20 09:03:12 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPMDhJmO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:03:12 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:03:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[687acfa8-b468-4d65-873e-a88942b89383]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:03:12 user nova-compute[74039]: No targets found.
Oct 20 09:03:12 user nova-compute[74039]: iSNS:
Oct 20 09:03:12 user nova-compute[74039]: No targets found.
Oct 20 09:03:12 user nova-compute[74039]: STATIC:
Oct 20 09:03:12 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8
Oct 20 09:03:12 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:03:12 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:03:12 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1
Oct 20 09:03:12 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:03:12 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:03:12 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf
Oct 20 09:03:12 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:03:12 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:03:12 user nova-compute[74039]: FIRMWARE:
Oct 20 09:03:12 user nova-compute[74039]: No targets found.
Oct 20 09:03:12 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:03:12 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:03:12 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5250e4e-69da-4903-8806-1ca3225f226b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f06aae-4c5d-43a8-b0ee-c7588a02e163]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:03:12 user nova-compute[74039]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:03:12 user nova-compute[74039]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:12 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf (non-flash)
Oct 20 09:03:12 user nova-compute[74039]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:03:12 user nova-compute[74039]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:12 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae8442c040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf'): ({'sdb'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Removing single pathed devices sdb {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG nova.compute.manager [req-fe79e6ed-5406-4b39-b0cb-2219ab697beb req-7a33d69f-cf82-4bf5-87e2-25331d6f9db1 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received event network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-fe79e6ed-5406-4b39-b0cb-2219ab697beb req-7a33d69f-cf82-4bf5-87e2-25331d6f9db1 service nova] Acquiring lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-fe79e6ed-5406-4b39-b0cb-2219ab697beb req-7a33d69f-cf82-4bf5-87e2-25331d6f9db1 service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-fe79e6ed-5406-4b39-b0cb-2219ab697beb req-7a33d69f-cf82-4bf5-87e2-25331d6f9db1 service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG nova.compute.manager [req-fe79e6ed-5406-4b39-b0cb-2219ab697beb req-7a33d69f-cf82-4bf5-87e2-25331d6f9db1 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] No waiting events found dispatching network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:03:12 user nova-compute[74039]: WARNING nova.compute.manager [req-fe79e6ed-5406-4b39-b0cb-2219ab697beb req-7a33d69f-cf82-4bf5-87e2-25331d6f9db1 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received unexpected event network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 for instance with vm_state resized and task_state resize_reverting.
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61a8b0b-3ef2-4198-b16c-c32f7092dd88]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc77096-01a8-4fd1-a023-c49e0fbe61be]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Flushing IO for device /dev/sdb {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f894561-2aff-41c0-8386-4bdaadb22525]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[619bb93d-f9b3-4d65-a650-c7794ffc079b]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:12 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a13fec-c5ee-42a9-bee1-e1cc69b4dfeb]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c91d2e-e7a9-46b1-9806-8970db04f713]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf, portal: 172.16.0.220,3260]
Oct 20 09:03:13 user nova-compute[74039]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf, portal: 172.16.0.220,3260] successful.
Oct 20 09:03:13 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b8f68d-643c-4def-b0f8-fa41b129e2cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[807066e7-90e3-4fcb-bf3f-68a829398cf7]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] <== disconnect_volume: return (306ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.527s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:13 user nova-compute[74039]: INFO nova.compute.manager [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Swapping old allocation on dict_keys(['2e813dfe-3db6-40c5-8768-7e4aa3c40bcb']) held by migration 242a5b7f-5026-4dba-b30a-aeb328c19394 for instance
Oct 20 09:03:13 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Overwriting current allocation {'allocations': {'2e813dfe-3db6-40c5-8768-7e4aa3c40bcb': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 30}}, 'project_id': 'da44286b6f5b45fe9ccbd881754a9b3c', 'user_id': '994701e77d9740f4a7a18390f9438996', 'consumer_generation': 1} on consumer ebaa4804-32e5-4fff-9562-0587ff7ca4ed {{(pid=74039) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquired lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG nova.network.neutron [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG nova.network.neutron [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Updating instance_info_cache with network_info: [{"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Releasing lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG os_brick.utils [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed49b8cd-7c91-49ed-930d-69510244dcfc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e1241c-a0d2-4e43-b9df-c641055e028e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG nova.objects.instance [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'flavor' on Instance uuid 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ca1270-9fd4-4e91-94d8-27a55703f5a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d2b0d1-50db-44ce-8312-e6928c64e17b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:03:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:03:14 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:03:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[962f6737-f62c-43b2-a5ee-e45f4fe0f7bb]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:03:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:03:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:03:14 user nova-compute[74039]: DEBUG os_brick.utils [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:03:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d56fa351-f3ac-4791-ae5b-d711816e21ff tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.904s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:15 user nova-compute[74039]: DEBUG nova.compute.manager [req-80d4f05c-aa6a-4769-bd07-74e2e68694da req-d4ad9d74-178b-46c5-8cc5-8589677ad2e2 service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Received event network-changed-558d1748-92c4-4e5d-a341-b3b5c0389c45 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:15 user nova-compute[74039]: DEBUG nova.compute.manager [req-80d4f05c-aa6a-4769-bd07-74e2e68694da req-d4ad9d74-178b-46c5-8cc5-8589677ad2e2 service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Refreshing instance network info cache due to event network-changed-558d1748-92c4-4e5d-a341-b3b5c0389c45. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:03:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-80d4f05c-aa6a-4769-bd07-74e2e68694da req-d4ad9d74-178b-46c5-8cc5-8589677ad2e2 service nova] Acquiring lock "refresh_cache-4f5d98e3-c1f6-4617-8847-b975e2c23990" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:03:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-80d4f05c-aa6a-4769-bd07-74e2e68694da req-d4ad9d74-178b-46c5-8cc5-8589677ad2e2 service nova] Acquired lock "refresh_cache-4f5d98e3-c1f6-4617-8847-b975e2c23990" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:03:15 user nova-compute[74039]: DEBUG nova.network.neutron [req-80d4f05c-aa6a-4769-bd07-74e2e68694da req-d4ad9d74-178b-46c5-8cc5-8589677ad2e2 service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Refreshing network info cache for port 558d1748-92c4-4e5d-a341-b3b5c0389c45 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:03:15 user nova-compute[74039]: DEBUG nova.network.neutron [req-80d4f05c-aa6a-4769-bd07-74e2e68694da req-d4ad9d74-178b-46c5-8cc5-8589677ad2e2 service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Updated VIF entry in instance network info cache for port 558d1748-92c4-4e5d-a341-b3b5c0389c45. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:03:15 user nova-compute[74039]: DEBUG nova.network.neutron [req-80d4f05c-aa6a-4769-bd07-74e2e68694da req-d4ad9d74-178b-46c5-8cc5-8589677ad2e2 service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Updating instance_info_cache with network_info: [{"id": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "address": "fa:16:3e:00:9a:92", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558d1748-92", "ovs_interfaceid": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:03:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-80d4f05c-aa6a-4769-bd07-74e2e68694da req-d4ad9d74-178b-46c5-8cc5-8589677ad2e2 service nova] Releasing lock "refresh_cache-4f5d98e3-c1f6-4617-8847-b975e2c23990" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "4f5d98e3-c1f6-4617-8847-b975e2c23990" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG nova.objects.instance [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lazy-loading 'flavor' on Instance uuid 4f5d98e3-c1f6-4617-8847-b975e2c23990 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "4f5d98e3-c1f6-4617-8847-b975e2c23990" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:16 user nova-compute[74039]: INFO nova.compute.manager [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Attaching volume 30376c3e-e117-4d49-8409-16419f2ec016 to /dev/vdb
Oct 20 09:03:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG os_brick.utils [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[af16c480-f61b-447e-b971-c86b5e8b6881]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18ed474-3e6a-46fa-b74b-05dd31ddb710]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ed7541-3f64-4433-bda4-f224253ccf73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f297fe56-f903-443e-8ec3-fc7a843d40c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:03:16 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:03:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5ace70-ef14-4e3b-bace-7f827c4de66f]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG os_brick.utils [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:03:16 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Updating existing volume attachment record: d31fa492-14d6-497f-b61f-c8e25b134d29 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:03:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-d881ac6a-7d88-4ef9-adad-378fa4de633f req-11281356-dc0a-4ec5-9c58-ce4ea0dbe985 service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Received event network-changed-708d272c-3434-4525-bcbd-3ee50e71eb47 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-d881ac6a-7d88-4ef9-adad-378fa4de633f req-11281356-dc0a-4ec5-9c58-ce4ea0dbe985 service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Refreshing instance network info cache due to event network-changed-708d272c-3434-4525-bcbd-3ee50e71eb47. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:03:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d881ac6a-7d88-4ef9-adad-378fa4de633f req-11281356-dc0a-4ec5-9c58-ce4ea0dbe985 service nova] Acquiring lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:03:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d881ac6a-7d88-4ef9-adad-378fa4de633f req-11281356-dc0a-4ec5-9c58-ce4ea0dbe985 service nova] Acquired lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:03:23 user nova-compute[74039]: DEBUG nova.network.neutron [req-d881ac6a-7d88-4ef9-adad-378fa4de633f req-11281356-dc0a-4ec5-9c58-ce4ea0dbe985 service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Refreshing network info cache for port 708d272c-3434-4525-bcbd-3ee50e71eb47 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:03:24 user nova-compute[74039]: DEBUG nova.network.neutron [req-d881ac6a-7d88-4ef9-adad-378fa4de633f req-11281356-dc0a-4ec5-9c58-ce4ea0dbe985 service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Updated VIF entry in instance network info cache for port 708d272c-3434-4525-bcbd-3ee50e71eb47. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:03:24 user nova-compute[74039]: DEBUG nova.network.neutron [req-d881ac6a-7d88-4ef9-adad-378fa4de633f req-11281356-dc0a-4ec5-9c58-ce4ea0dbe985 service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Updating instance_info_cache with network_info: [{"id": "708d272c-3434-4525-bcbd-3ee50e71eb47", "address": "fa:16:3e:3f:80:75", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708d272c-34", "ovs_interfaceid": "708d272c-3434-4525-bcbd-3ee50e71eb47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:03:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d881ac6a-7d88-4ef9-adad-378fa4de633f req-11281356-dc0a-4ec5-9c58-ce4ea0dbe985 service nova] Releasing lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:03:25 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:03:25 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:03:25 user nova-compute[74039]: DEBUG nova.compute.manager [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Stashing vm_state: active {{(pid=74039) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 20 09:03:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:03:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:03:25 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:03:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:03:25 user nova-compute[74039]: INFO nova.compute.claims [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Claim successful on node user
Oct 20 09:03:25 user nova-compute[74039]: INFO nova.compute.resource_tracker [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Updating resource usage from migration 2b9c803f-f223-4920-ae16-5e8bcf7f1c91
Oct 20 09:03:25 user nova-compute[74039]: DEBUG nova.compute.manager [req-778e5271-0df0-49c6-abd8-999f4e1a18a6 req-ed9b699f-7584-4a7a-8273-5c44789676ff service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received event network-changed-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:25 user nova-compute[74039]: DEBUG nova.compute.manager [req-778e5271-0df0-49c6-abd8-999f4e1a18a6 req-ed9b699f-7584-4a7a-8273-5c44789676ff service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Refreshing instance network info cache due to event network-changed-d5f62963-3776-4468-b582-f2d31bf6a2be. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:03:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-778e5271-0df0-49c6-abd8-999f4e1a18a6 req-ed9b699f-7584-4a7a-8273-5c44789676ff service nova] Acquiring lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:03:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-778e5271-0df0-49c6-abd8-999f4e1a18a6 req-ed9b699f-7584-4a7a-8273-5c44789676ff service nova] Acquired lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:03:25 user nova-compute[74039]: DEBUG nova.network.neutron [req-778e5271-0df0-49c6-abd8-999f4e1a18a6 req-ed9b699f-7584-4a7a-8273-5c44789676ff service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Refreshing network info cache for port d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Updating instance_info_cache with network_info: [{"id": "708d272c-3434-4525-bcbd-3ee50e71eb47", "address": "fa:16:3e:3f:80:75", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708d272c-34", "ovs_interfaceid": "708d272c-3434-4525-bcbd-3ee50e71eb47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.523s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:26 user nova-compute[74039]: INFO nova.compute.manager [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Migrating
Oct 20 09:03:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG nova.network.neutron [req-778e5271-0df0-49c6-abd8-999f4e1a18a6 req-ed9b699f-7584-4a7a-8273-5c44789676ff service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Updated VIF entry in instance network info cache for port d5f62963-3776-4468-b582-f2d31bf6a2be. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG nova.network.neutron [req-778e5271-0df0-49c6-abd8-999f4e1a18a6 req-ed9b699f-7584-4a7a-8273-5c44789676ff service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Updating instance_info_cache with network_info: [{"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-778e5271-0df0-49c6-abd8-999f4e1a18a6 req-ed9b699f-7584-4a7a-8273-5c44789676ff service nova] Releasing lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquired lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Updating instance_info_cache with network_info: [{"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Releasing lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Starting migrate_disk_and_power_off {{(pid=74039) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-9ee80095-a80e-44a9-84ff-2bae58606fac req-90ad0e03-d457-4b22-9779-df4aa718648c service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received event network-vif-unplugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9ee80095-a80e-44a9-84ff-2bae58606fac req-90ad0e03-d457-4b22-9779-df4aa718648c service nova] Acquiring lock "00e09d93-3077-4770-abfd-b82ece646997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9ee80095-a80e-44a9-84ff-2bae58606fac req-90ad0e03-d457-4b22-9779-df4aa718648c service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9ee80095-a80e-44a9-84ff-2bae58606fac req-90ad0e03-d457-4b22-9779-df4aa718648c service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-9ee80095-a80e-44a9-84ff-2bae58606fac req-90ad0e03-d457-4b22-9779-df4aa718648c service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] No waiting events found dispatching network-vif-unplugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:03:27 user nova-compute[74039]: WARNING nova.compute.manager [req-9ee80095-a80e-44a9-84ff-2bae58606fac req-90ad0e03-d457-4b22-9779-df4aa718648c service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received unexpected event network-vif-unplugged-d5f62963-3776-4468-b582-f2d31bf6a2be for instance with vm_state active and task_state resize_migrating.
Oct 20 09:03:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:27 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Instance destroyed successfully.
Oct 20 09:03:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-456868217',display_name='tempest-ServerActionsTestOtherA-server-456868217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-456868217',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyyJ62onAPVNIcWwPgu8Qk09h8heuIgT4K5VQCSSgQo1m6HsMw9upnfKrs0KtZmErwiBvOSQvzot9EsqbPyLMmcaHuqRr6HWOREqecRp8rh7oJxELHXOR3Is97nl7PEUA==',key_name='tempest-keypair-612179765',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:02:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='88a58985dce3491d8e45e6e468e0e549',ramdisk_id='',reservation_id='r-ed0qaebc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1138208404',owner_user_name='tempest-ServerActionsTestOtherA-1138208404-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:03:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb823f0374a04657be729eb153160659',uuid=00e09d93-3077-4770-abfd-b82ece646997,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-945485380-network", "vif_mac": "fa:16:3e:d7:28:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converting VIF {"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-945485380-network", "vif_mac": "fa:16:3e:d7:28:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:28:6b,bridge_name='br-int',has_traffic_filtering=True,id=d5f62963-3776-4468-b582-f2d31bf6a2be,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f62963-37') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_vif [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:28:6b,bridge_name='br-int',has_traffic_filtering=True,id=d5f62963-3776-4468-b582-f2d31bf6a2be,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f62963-37') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5f62963-37, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b41af2c3-2bab-4486-9b69-fe65cbbac80d) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:27 user nova-compute[74039]: INFO os_vif [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:28:6b,bridge_name='br-int',has_traffic_filtering=True,id=d5f62963-3776-4468-b582-f2d31bf6a2be,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f62963-37')
Oct 20 09:03:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKlBfatR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:03:27 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfbe4d0-5795-4f8a-9cf1-b95c894f5657]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:03:27 user nova-compute[74039]: No targets found.
Oct 20 09:03:27 user nova-compute[74039]: iSNS:
Oct 20 09:03:27 user nova-compute[74039]: No targets found.
Oct 20 09:03:27 user nova-compute[74039]: STATIC:
Oct 20 09:03:27 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8
Oct 20 09:03:27 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:03:27 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:03:27 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1
Oct 20 09:03:27 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:03:27 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:03:27 user nova-compute[74039]: FIRMWARE:
Oct 20 09:03:27 user nova-compute[74039]: No targets found.
Oct 20 09:03:27 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:03:27 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:03:27 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce216f75-2445-45a2-a06e-d3d362b3b185]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a633b0-552d-47c7-b5a8-6e55912f2d6f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:03:27 user nova-compute[74039]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:27 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:03:27 user nova-compute[74039]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:27 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae8445f370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1'): ({'sdf'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Removing single pathed devices sdf {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e59da5-e93c-467b-9542-b02afa74457f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[371308c5-951f-483b-abcd-014f74b1a08b]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Flushing IO for device /dev/sdf {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcff7bd-5ff8-4a91-9dda-84380aed1587]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcfcdeb-2e67-455f-8519-a80a0a95cb2b]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] SCSI volumes sdf have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4edee0b-30ae-4492-8966-06a842826f2a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1931e8-5e70-446e-b392-564421c073a4]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1, portal: 172.16.0.220,3260]
Oct 20 09:03:27 user nova-compute[74039]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1, portal: 172.16.0.220,3260] successful.
Oct 20 09:03:27 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f9c768-0423-4176-87fe-358066c3670c]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] <== disconnect_volume: return (313ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:03:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLoGUxYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:03:28 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:03:28 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:03:28 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5059b5ad-8d97-4542-9903-b79309181fc0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:03:28 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f54b3e-fee7-4211-9143-05874b9ca3f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd] added
Oct 20 09:03:28 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20b7fe7-9684-4899-8017-14a6a356a8a8]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43579d1-4072-44b6-8cbf-3e7e4d4737ec]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HLoGUxYt {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HLoGUxYt" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09b2f23-1a7b-40ec-ac6e-30fb96f05fda]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HLoGUxYt'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97796f6-18cd-4749-8dbc-9e08958ffd42]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51586ae-07e4-4b75-a287-b839afd49561]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:28 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:28 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9082f42c-2984-4ccc-a2ca-760571f44137]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd, portal: 172.16.0.220,3260]
Oct 20 09:03:28 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd, portal: 172.16.0.220,3260] successful.
Oct 20 09:03:28 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[984c158a-7a63-4904-8470-677c2f1de37b]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f389adee-0af0-4c2a-bbd9-600b97670bef]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:28 user nova-compute[74039]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)
Oct 20 09:03:28 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:28 user nova-compute[74039]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)
Oct 20 09:03:28 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[54121ba9-b42e-4840-9059-6aafa832ffda]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:28 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: None {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "d61f84a9-85ea-40aa-b21e-45064b3bc090" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "d61f84a9-85ea-40aa-b21e-45064b3bc090" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "d61f84a9-85ea-40aa-b21e-45064b3bc090-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "d61f84a9-85ea-40aa-b21e-45064b3bc090-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "d61f84a9-85ea-40aa-b21e-45064b3bc090-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:29 user nova-compute[74039]: INFO nova.compute.manager [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Terminating instance
Oct 20 09:03:29 user nova-compute[74039]: DEBUG nova.compute.manager [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-00332f90-63e4-4f92-905a-5120d0f3a2d9 req-7d65a148-b4c4-425c-a47a-f37fc2839c89 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received event network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-00332f90-63e4-4f92-905a-5120d0f3a2d9 req-7d65a148-b4c4-425c-a47a-f37fc2839c89 service nova] Acquiring lock "00e09d93-3077-4770-abfd-b82ece646997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-00332f90-63e4-4f92-905a-5120d0f3a2d9 req-7d65a148-b4c4-425c-a47a-f37fc2839c89 service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-00332f90-63e4-4f92-905a-5120d0f3a2d9 req-7d65a148-b4c4-425c-a47a-f37fc2839c89 service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-00332f90-63e4-4f92-905a-5120d0f3a2d9 req-7d65a148-b4c4-425c-a47a-f37fc2839c89 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] No waiting events found dispatching network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:03:29 user nova-compute[74039]: WARNING nova.compute.manager [req-00332f90-63e4-4f92-905a-5120d0f3a2d9 req-7d65a148-b4c4-425c-a47a-f37fc2839c89 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received unexpected event network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be for instance with vm_state active and task_state resize_migrating.
Oct 20 09:03:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-00332f90-63e4-4f92-905a-5120d0f3a2d9 req-7d65a148-b4c4-425c-a47a-f37fc2839c89 service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Received event network-vif-unplugged-b244a5a8-584d-426b-92f9-cbdd4c770a51 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-00332f90-63e4-4f92-905a-5120d0f3a2d9 req-7d65a148-b4c4-425c-a47a-f37fc2839c89 service nova] Acquiring lock "d61f84a9-85ea-40aa-b21e-45064b3bc090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-00332f90-63e4-4f92-905a-5120d0f3a2d9 req-7d65a148-b4c4-425c-a47a-f37fc2839c89 service nova] Lock "d61f84a9-85ea-40aa-b21e-45064b3bc090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-00332f90-63e4-4f92-905a-5120d0f3a2d9 req-7d65a148-b4c4-425c-a47a-f37fc2839c89 service nova] Lock "d61f84a9-85ea-40aa-b21e-45064b3bc090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-00332f90-63e4-4f92-905a-5120d0f3a2d9 req-7d65a148-b4c4-425c-a47a-f37fc2839c89 service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] No waiting events found dispatching network-vif-unplugged-b244a5a8-584d-426b-92f9-cbdd4c770a51 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-00332f90-63e4-4f92-905a-5120d0f3a2d9 req-7d65a148-b4c4-425c-a47a-f37fc2839c89 service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Received event network-vif-unplugged-b244a5a8-584d-426b-92f9-cbdd4c770a51 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-00332f90-63e4-4f92-905a-5120d0f3a2d9 req-7d65a148-b4c4-425c-a47a-f37fc2839c89 service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Received event network-vif-plugged-b244a5a8-584d-426b-92f9-cbdd4c770a51 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-00332f90-63e4-4f92-905a-5120d0f3a2d9 req-7d65a148-b4c4-425c-a47a-f37fc2839c89 service nova] Acquiring lock "d61f84a9-85ea-40aa-b21e-45064b3bc090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-00332f90-63e4-4f92-905a-5120d0f3a2d9 req-7d65a148-b4c4-425c-a47a-f37fc2839c89 service nova] Lock "d61f84a9-85ea-40aa-b21e-45064b3bc090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-00332f90-63e4-4f92-905a-5120d0f3a2d9 req-7d65a148-b4c4-425c-a47a-f37fc2839c89 service nova] Lock "d61f84a9-85ea-40aa-b21e-45064b3bc090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-00332f90-63e4-4f92-905a-5120d0f3a2d9 req-7d65a148-b4c4-425c-a47a-f37fc2839c89 service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] No waiting events found dispatching network-vif-plugged-b244a5a8-584d-426b-92f9-cbdd4c770a51 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:03:29 user nova-compute[74039]: WARNING nova.compute.manager [req-00332f90-63e4-4f92-905a-5120d0f3a2d9 req-7d65a148-b4c4-425c-a47a-f37fc2839c89 service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Received unexpected event network-vif-plugged-b244a5a8-584d-426b-92f9-cbdd4c770a51 for instance with vm_state active and task_state deleting.
Oct 20 09:03:29 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Instance destroyed successfully.
Oct 20 09:03:29 user nova-compute[74039]: DEBUG nova.objects.instance [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lazy-loading 'resources' on Instance uuid d61f84a9-85ea-40aa-b21e-45064b3bc090 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1763804474',display_name='tempest-AttachVolumeNegativeTest-server-1763804474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1763804474',id=18,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnFzRJgurlVdQXqAdfMnpEhkAb4cVlW7KPQF3o095djtkf/NWdcHOBnzFAb6TRmgwz0scCUR3cVpbnkLGhYxXxORR2Hyfh2wGAhM0Mjm/r5J07UZeykxwn+xWNS2xn05w==',key_name='tempest-keypair-1600517727',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:57:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='143bda69e4714560b4b2286adaefb4c5',ramdisk_id='',reservation_id='r-imuqtx2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-639731200',owner_user_name='tempest-AttachVolumeNegativeTest-639731200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:57:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6faf5f2e03204805a06ac9f83b9a61bb',uuid=d61f84a9-85ea-40aa-b21e-45064b3bc090,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "address": "fa:16:3e:f4:2a:6c", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb244a5a8-58", "ovs_interfaceid": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converting VIF {"id": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "address": "fa:16:3e:f4:2a:6c", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb244a5a8-58", "ovs_interfaceid": "b244a5a8-584d-426b-92f9-cbdd4c770a51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:2a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b244a5a8-584d-426b-92f9-cbdd4c770a51,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb244a5a8-58') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG os_vif [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:2a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b244a5a8-584d-426b-92f9-cbdd4c770a51,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb244a5a8-58') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb244a5a8-58, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1185b2f-2d1a-45f2-8c2a-5f338be16627) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:29 user nova-compute[74039]: INFO os_vif [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:2a:6c,bridge_name='br-int',has_traffic_filtering=True,id=b244a5a8-584d-426b-92f9-cbdd4c770a51,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb244a5a8-58')
Oct 20 09:03:29 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Deleting instance files /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090_del
Oct 20 09:03:29 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Deletion of /opt/stack/data/nova/instances/d61f84a9-85ea-40aa-b21e-45064b3bc090_del complete
Oct 20 09:03:29 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLoGUxYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26437643132396134', 'path': '/dev/sdb'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437643132396134', 'path': '/dev/sdb'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:03:29 user nova-compute[74039]: DEBUG nova.objects.instance [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lazy-loading 'flavor' on Instance uuid 8af05cc2-c1b2-4187-b16e-5fbeb006de6a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:03:30 user nova-compute[74039]: INFO nova.compute.manager [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 20 09:03:30 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 09:03:30 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:03:30 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 09:03:30 user nova-compute[74039]:   <target dev="vdc" bus="virtio"/>
Oct 20 09:03:30 user nova-compute[74039]:   <serial>fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd</serial>
Oct 20 09:03:30 user nova-compute[74039]: </disk>
Oct 20 09:03:30 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG nova.network.neutron [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Port d5f62963-3776-4468-b582-f2d31bf6a2be binding to destination host user is already ACTIVE {{(pid=74039) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "00e09d93-3077-4770-abfd-b82ece646997-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquired lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG nova.network.neutron [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] No VIF found with MAC fa:16:3e:e6:1f:b2, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ff7aac6-a449-420c-8217-91739453b71b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.334s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:03:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-baf6b484-165a-4334-b7d2-037312d94ef6 req-c9759039-e7ce-441f-96ba-a2d757d72afa service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Received event network-vif-deleted-b244a5a8-584d-426b-92f9-cbdd4c770a51 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:31 user nova-compute[74039]: INFO nova.compute.manager [req-baf6b484-165a-4334-b7d2-037312d94ef6 req-c9759039-e7ce-441f-96ba-a2d757d72afa service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Neutron deleted interface b244a5a8-584d-426b-92f9-cbdd4c770a51; detaching it from the instance and deleting it from the info cache
Oct 20 09:03:31 user nova-compute[74039]: DEBUG nova.network.neutron [req-baf6b484-165a-4334-b7d2-037312d94ef6 req-c9759039-e7ce-441f-96ba-a2d757d72afa service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:03:31 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Took 1.28 seconds to deallocate network for instance.
Oct 20 09:03:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-baf6b484-165a-4334-b7d2-037312d94ef6 req-c9759039-e7ce-441f-96ba-a2d757d72afa service nova] [instance: d61f84a9-85ea-40aa-b21e-45064b3bc090] Detach interface failed, port_id=b244a5a8-584d-426b-92f9-cbdd4c770a51, reason: Instance d61f84a9-85ea-40aa-b21e-45064b3bc090 could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG nova.network.neutron [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Updating instance_info_cache with network_info: [{"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Releasing lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG os_brick.utils [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8839374-3a28-4a6e-9212-3108e2fba556]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e6108e-cefd-41d9-ae29-4bd3a1595d27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e88cc40-eb2b-4df6-9c17-2c97b79a1e07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfa0020-c8d2-4fc7-9385-dbbe4bf041d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:03:31 user nova-compute[74039]: INFO nova.compute.manager [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Detaching volume b7bf45ae-1f15-4a0e-81c5-7a75418433e8
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:03:31 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3242a0-b4bf-45ae-8adf-ced19bbe6c04]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG os_brick.utils [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:32 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:03:32 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:03:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.719s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:32 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Deleted allocations for instance d61f84a9-85ea-40aa-b21e-45064b3bc090
Oct 20 09:03:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-15d6bdc5-74e4-4d77-a15d-ea3be6896294 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "d61f84a9-85ea-40aa-b21e-45064b3bc090" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.198s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.255s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVDnwWBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:03:34 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:03:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:03:34 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:03:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:03:34 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:03:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8292f78a-b69e-4f79-adaa-5e440ffc7433]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:03:34 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:34 user nova-compute[74039]: INFO nova.virt.block_device [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Attempting to driver detach volume b7bf45ae-1f15-4a0e-81c5-7a75418433e8 from mountpoint /dev/vdb
Oct 20 09:03:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Attempting to detach device vdb from instance 8af05cc2-c1b2-4187-b16e-5fbeb006de6a from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:03:34 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:03:34 user nova-compute[74039]:   <source dev="/dev/sdc"/>
Oct 20 09:03:34 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:03:34 user nova-compute[74039]:   <serial>b7bf45ae-1f15-4a0e-81c5-7a75418433e8</serial>
Oct 20 09:03:34 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:03:34 user nova-compute[74039]: </disk>
Oct 20 09:03:34 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[047ea2b1-b786-456b-9536-9853202f1df0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016] added
Oct 20 09:03:34 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:34 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Successfully detached device vdb from instance 8af05cc2-c1b2-4187-b16e-5fbeb006de6a from the persistent domain config.
Oct 20 09:03:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8af05cc2-c1b2-4187-b16e-5fbeb006de6a from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:03:34 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:03:34 user nova-compute[74039]:   <source dev="/dev/sdc"/>
Oct 20 09:03:34 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:03:34 user nova-compute[74039]:   <serial>b7bf45ae-1f15-4a0e-81c5-7a75418433e8</serial>
Oct 20 09:03:34 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:03:34 user nova-compute[74039]: </disk>
Oct 20 09:03:34 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9def585f-f4d4-4214-92cf-826102bc14d1]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdf8b41-7304-4fab-94b0-cf41d045edb9]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YVDnwWBS {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YVDnwWBS" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3483039a-98bf-4c86-ac05-b5cc0a1c915b]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YVDnwWBS'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f75c455-0f64-4898-967d-4ae022125626]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fa3515-7b6e-40a7-a7be-a55184130398]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:35 user nova-compute[74039]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)
Oct 20 09:03:35 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:35 user nova-compute[74039]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)
Oct 20 09:03:35 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[64331a08-ed5d-4fee-ae6d-913328a110a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016, portal: 172.16.0.220,3260]
Oct 20 09:03:35 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016, portal: 172.16.0.220,3260] successful.
Oct 20 09:03:35 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b09edd-fe82-42fb-9d24-6338b92301db]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c60357d-3b57-4b70-b321-88421540afee]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:35 user nova-compute[74039]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)
Oct 20 09:03:35 user nova-compute[74039]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 (non-flash)
Oct 20 09:03:35 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:35 user nova-compute[74039]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)
Oct 20 09:03:35 user nova-compute[74039]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 (non-flash)
Oct 20 09:03:35 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c4976b-774b-45af-9fb0-b06fcfce6813]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVDnwWBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8af05cc2-c1b2-4187-b16e-5fbeb006de6a {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 09:03:35 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:03:35 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:03:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7356MB free_disk=25.432170867919922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Applying migration context for instance 00e09d93-3077-4770-abfd-b82ece646997 as it has an incoming, in-progress migration 2b9c803f-f223-4920-ae16-5e8bcf7f1c91. Migration status is post-migrating {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 09:03:35 user nova-compute[74039]: INFO nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Updating resource usage from migration 2b9c803f-f223-4920-ae16-5e8bcf7f1c91
Oct 20 09:03:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 9fe77a96-fcb5-4410-85cc-58d925548e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c8054dbd-c0ae-45d2-af95-dae7d05f8c69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 03e487d1-90aa-436d-9c2f-468f9791af91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 8af05cc2-c1b2-4187-b16e-5fbeb006de6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4f5d98e3-c1f6-4617-8847-b975e2c23990 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance e14ecf11-28b6-421d-875f-0ce9a21999d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance def7ee9b-e0ed-4c95-961c-c6d79144f0ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance f8236653-a179-4d3f-9bd3-4c91c85aeaea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance ebaa4804-32e5-4fff-9562-0587ff7ca4ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Migration 2b9c803f-f223-4920-ae16-5e8bcf7f1c91 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 00e09d93-3077-4770-abfd-b82ece646997 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:03:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:03:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:03:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26161666633346239', 'path': '/dev/sdd'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:03:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161666633346239', 'path': '/dev/sdd'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:03:36 user nova-compute[74039]: DEBUG nova.objects.instance [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lazy-loading 'flavor' on Instance uuid 4f5d98e3-c1f6-4617-8847-b975e2c23990 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:03:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 09:03:36 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:03:36 user nova-compute[74039]:   <source dev="/dev/sdd"/>
Oct 20 09:03:36 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:03:36 user nova-compute[74039]:   <serial>30376c3e-e117-4d49-8409-16419f2ec016</serial>
Oct 20 09:03:36 user nova-compute[74039]: </disk>
Oct 20 09:03:36 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 09:03:36 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:03:36 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:03:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:03:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.635s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:03:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:03:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] No VIF found with MAC fa:16:3e:00:9a:92, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:03:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-434836a4-65ea-4752-ae91-615663b5f0b5 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.616s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "4f5d98e3-c1f6-4617-8847-b975e2c23990" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:38 user nova-compute[74039]: INFO nova.compute.manager [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Detaching volume 30376c3e-e117-4d49-8409-16419f2ec016
Oct 20 09:03:39 user nova-compute[74039]: INFO nova.virt.block_device [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Attempting to driver detach volume 30376c3e-e117-4d49-8409-16419f2ec016 from mountpoint /dev/vdb
Oct 20 09:03:39 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Attempting to detach device vdb from instance 4f5d98e3-c1f6-4617-8847-b975e2c23990 from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 09:03:39 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:03:39 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:03:39 user nova-compute[74039]:   <source dev="/dev/sdd"/>
Oct 20 09:03:39 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:03:39 user nova-compute[74039]:   <serial>30376c3e-e117-4d49-8409-16419f2ec016</serial>
Oct 20 09:03:39 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:03:39 user nova-compute[74039]: </disk>
Oct 20 09:03:39 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:03:39 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Successfully detached device vdb from instance 4f5d98e3-c1f6-4617-8847-b975e2c23990 from the persistent domain config.
Oct 20 09:03:39 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4f5d98e3-c1f6-4617-8847-b975e2c23990 from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 09:03:39 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:03:39 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:03:39 user nova-compute[74039]:   <source dev="/dev/sdd"/>
Oct 20 09:03:39 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:03:39 user nova-compute[74039]:   <serial>30376c3e-e117-4d49-8409-16419f2ec016</serial>
Oct 20 09:03:39 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:03:39 user nova-compute[74039]: </disk>
Oct 20 09:03:39 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:03:39 user nova-compute[74039]: DEBUG nova.compute.manager [req-93f88c54-d5aa-4612-ab63-f3eafc217681 req-bd95abbc-46f8-48c0-98e4-a8a02677bf02 service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Received event network-changed-e70313a0-8859-4514-b8e8-ec4355e6bd40 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:39 user nova-compute[74039]: DEBUG nova.compute.manager [req-93f88c54-d5aa-4612-ab63-f3eafc217681 req-bd95abbc-46f8-48c0-98e4-a8a02677bf02 service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Refreshing instance network info cache due to event network-changed-e70313a0-8859-4514-b8e8-ec4355e6bd40. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:03:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-93f88c54-d5aa-4612-ab63-f3eafc217681 req-bd95abbc-46f8-48c0-98e4-a8a02677bf02 service nova] Acquiring lock "refresh_cache-e14ecf11-28b6-421d-875f-0ce9a21999d3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:03:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-93f88c54-d5aa-4612-ab63-f3eafc217681 req-bd95abbc-46f8-48c0-98e4-a8a02677bf02 service nova] Acquired lock "refresh_cache-e14ecf11-28b6-421d-875f-0ce9a21999d3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:03:39 user nova-compute[74039]: DEBUG nova.network.neutron [req-93f88c54-d5aa-4612-ab63-f3eafc217681 req-bd95abbc-46f8-48c0-98e4-a8a02677bf02 service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Refreshing network info cache for port e70313a0-8859-4514-b8e8-ec4355e6bd40 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:03:39 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4f5d98e3-c1f6-4617-8847-b975e2c23990 {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 09:03:39 user nova-compute[74039]: DEBUG nova.network.neutron [req-93f88c54-d5aa-4612-ab63-f3eafc217681 req-bd95abbc-46f8-48c0-98e4-a8a02677bf02 service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Updated VIF entry in instance network info cache for port e70313a0-8859-4514-b8e8-ec4355e6bd40. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:03:39 user nova-compute[74039]: DEBUG nova.network.neutron [req-93f88c54-d5aa-4612-ab63-f3eafc217681 req-bd95abbc-46f8-48c0-98e4-a8a02677bf02 service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Updating instance_info_cache with network_info: [{"id": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "address": "fa:16:3e:4c:10:22", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70313a0-88", "ovs_interfaceid": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:03:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-93f88c54-d5aa-4612-ab63-f3eafc217681 req-bd95abbc-46f8-48c0-98e4-a8a02677bf02 service nova] Releasing lock "refresh_cache-e14ecf11-28b6-421d-875f-0ce9a21999d3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:03:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "e14ecf11-28b6-421d-875f-0ce9a21999d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:40 user nova-compute[74039]: DEBUG nova.objects.instance [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lazy-loading 'flavor' on Instance uuid e14ecf11-28b6-421d-875f-0ce9a21999d3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:03:40 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Ignoring supplied device name: /dev/vdb
Oct 20 09:03:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "e14ecf11-28b6-421d-875f-0ce9a21999d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:40 user nova-compute[74039]: INFO nova.compute.manager [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Attaching volume ca4bcc71-c61a-49a0-ae06-58300cbc4af5 to /dev/vdb
Oct 20 09:03:40 user nova-compute[74039]: DEBUG os_brick.utils [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:03:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a15e73-3cbf-460b-a135-637a20e13d1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e73560e-3b0f-4990-ac27-a16fd581697e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad7981d-d19c-40f9-a101-7c23f9c23377]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2051bc8e-68b0-42f5-9a48-1edd92ce8a1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:03:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:03:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:03:41 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:03:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcc9993-80ac-4163-a507-880e0015dff2]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:03:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:03:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:03:41 user nova-compute[74039]: DEBUG os_brick.utils [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:03:41 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Updating existing volume attachment record: 4ce4eaab-5b46-4087-8328-7c2ab5819af3 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:03:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "03e487d1-90aa-436d-9c2f-468f9791af91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "03e487d1-90aa-436d-9c2f-468f9791af91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:50 user nova-compute[74039]: INFO nova.compute.manager [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Terminating instance
Oct 20 09:03:50 user nova-compute[74039]: DEBUG nova.compute.manager [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:03:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:50 user nova-compute[74039]: INFO nova.compute.manager [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Terminating instance
Oct 20 09:03:50 user nova-compute[74039]: DEBUG nova.compute.manager [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-5b3131c5-0547-4040-83d7-250a5690300d req-b23db0db-9e34-43a6-83d0-241b901a4ec0 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received event network-vif-unplugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5b3131c5-0547-4040-83d7-250a5690300d req-b23db0db-9e34-43a6-83d0-241b901a4ec0 service nova] Acquiring lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5b3131c5-0547-4040-83d7-250a5690300d req-b23db0db-9e34-43a6-83d0-241b901a4ec0 service nova] Lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5b3131c5-0547-4040-83d7-250a5690300d req-b23db0db-9e34-43a6-83d0-241b901a4ec0 service nova] Lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-5b3131c5-0547-4040-83d7-250a5690300d req-b23db0db-9e34-43a6-83d0-241b901a4ec0 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] No waiting events found dispatching network-vif-unplugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-5b3131c5-0547-4040-83d7-250a5690300d req-b23db0db-9e34-43a6-83d0-241b901a4ec0 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received event network-vif-unplugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Starting finish_revert_migration {{(pid=74039) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Start _get_guest_xml network_info=[{"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '466f439b-04f0-418b-9bb4-502ab921c507', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZFEAJfq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ebaa4804-32e5-4fff-9562-0587ff7ca4ed', 'attached_at': '2023-10-20T09:03:50.000000', 'detached_at': '', 'volume_id': 'fddcdc2d-8bc1-4ba3-90c0-5607af95bc84', 'serial': 'fddcdc2d-8bc1-4ba3-90c0-5607af95bc84'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:03:51 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:03:51 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.objects.instance [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lazy-loading 'vcpu_model' on Instance uuid ebaa4804-32e5-4fff-9562-0587ff7ca4ed {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZFEAJfq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:03:51 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:03:51 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:03:51 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[849822a4-e38d-455f-9356-70353b3c9089]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:03:51 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9e5be9-b506-4b1e-a832-f702709fd2f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84] added
Oct 20 09:03:51 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0568785a-e137-4d6c-894e-d10da9ff2277]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.042s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde9fb77-0991-4a4c-8be7-c08229e0d051]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZFEAJfq {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZFEAJfq" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10b019f-2699-4dad-a7b9-80b713cd1872]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wZFEAJfq'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[463a2ead-2524-442a-b258-d3939f0ca282]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8500d9f-cd00-4785-8a0f-e652bc149c45]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:51 user nova-compute[74039]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)
Oct 20 09:03:51 user nova-compute[74039]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 (non-flash)
Oct 20 09:03:51 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:51 user nova-compute[74039]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)
Oct 20 09:03:51 user nova-compute[74039]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 (non-flash)
Oct 20 09:03:51 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6137690f-ad0a-48c8-a658-d5e864f722e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260]
Oct 20 09:03:51 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260] successful.
Oct 20 09:03:51 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a6f0cb-3d0c-447a-95bd-99f89c4d9c5f]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:51 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Instance destroyed successfully.
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.objects.instance [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lazy-loading 'resources' on Instance uuid 03e487d1-90aa-436d-9c2f-468f9791af91 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:03:51 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Instance destroyed successfully.
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.objects.instance [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'resources' on Instance uuid 2ae63f29-de62-4e82-877c-8bb4a3f2beb3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-672455651',display_name='tempest-ServerRescueNegativeTestJSON-server-672455651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-672455651',id=16,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/4hHvbGoEk8NCxt9ELjeY9iZ2B0QwhUSOtV9sftmfCgRXaPDsyLfZUde/IDIYj+13oBjVfPBDVNN+VD63zEivAAHfkwfA/NCYJYdBOqj0F8bFDm7gPMUHQ93MvUkhiGA==',key_name='tempest-keypair-763047870',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:59:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d74bb65080a343afb5cbcea1b5481938',ramdisk_id='',reservation_id='r-byof0x6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1580334620',owner_user_name='tempest-ServerRescueNegativeTestJSON-1580334620-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:01:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4024fa0ccfda49e0a070b9e6166e37ed',uuid=2ae63f29-de62-4e82-877c-8bb4a3f2beb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "address": "fa:16:3e:0c:c9:b0", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45971bed-5f", "ovs_interfaceid": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converting VIF {"id": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "address": "fa:16:3e:0c:c9:b0", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45971bed-5f", "ovs_interfaceid": "45971bed-5f51-4ebd-9641-e2cc09d91d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:c9:b0,bridge_name='br-int',has_traffic_filtering=True,id=45971bed-5f51-4ebd-9641-e2cc09d91d71,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45971bed-5f') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_vif [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:c9:b0,bridge_name='br-int',has_traffic_filtering=True,id=45971bed-5f51-4ebd-9641-e2cc09d91d71,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45971bed-5f') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4660632e-5e18-4082-991c-c1001117ebbc]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:51 user nova-compute[74039]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)
Oct 20 09:03:51 user nova-compute[74039]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 (non-flash)
Oct 20 09:03:51 user nova-compute[74039]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:03:51 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:51 user nova-compute[74039]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)
Oct 20 09:03:51 user nova-compute[74039]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 (non-flash)
Oct 20 09:03:51 user nova-compute[74039]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:03:51 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45971bed-5f, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-250189437',display_name='tempest-TestMinimumBasicScenario-server-250189437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-250189437',id=15,image_ref='60dbb338-0365-4d23-b037-a87dd89bac9a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+AsAZbu9hcOCbYGhFUvhYYTHLMoxYc4EjEdPTCNq64vpVX20iz3IE00/FA+6f425LVCuWxeFU/Of+ZYFOw9aQG00fS5587QvPqvWaQSGIHlsyM60P0361dJXLYB5FnyQ==',key_name='tempest-TestMinimumBasicScenario-1222695517',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:56:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9d044b69c56433ca011f220f8578407',ramdisk_id='',reservation_id='r-mltvrcs2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='60dbb338-0365-4d23-b037-a87dd89bac9a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1802809099',owner_user_name='tempest-TestMinimumBasicScenario-1802809099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:00:39Z,user_data=None,user_id='af6af67060414d48b96ee116b9e6dbdb',uuid=03e487d1-90aa-436d-9c2f-468f9791af91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Converting VIF {"id": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "address": "fa:16:3e:41:36:6d", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f2d5682-01", "ovs_interfaceid": "7f2d5682-0113-40f4-8bbb-02e87564b7ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:36:6d,bridge_name='br-int',has_traffic_filtering=True,id=7f2d5682-0113-40f4-8bbb-02e87564b7ef,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d5682-01') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_vif [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:36:6d,bridge_name='br-int',has_traffic_filtering=True,id=7f2d5682-0113-40f4-8bbb-02e87564b7ef,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d5682-01') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f2d5682-01, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec32650-6e4f-40f3-9622-24057a57a619]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZFEAJfq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6568a52e-cd33-43b7-a4e2-f555160f5e85) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54616e7e-010e-469c-a4d4-a3d2b6396d39) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:51 user nova-compute[74039]: INFO os_vif [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:c9:b0,bridge_name='br-int',has_traffic_filtering=True,id=45971bed-5f51-4ebd-9641-e2cc09d91d71,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45971bed-5f')
Oct 20 09:03:51 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Deleting instance files /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3_del
Oct 20 09:03:51 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Deletion of /opt/stack/data/nova/instances/2ae63f29-de62-4e82-877c-8bb4a3f2beb3_del complete
Oct 20 09:03:51 user nova-compute[74039]: INFO os_vif [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:36:6d,bridge_name='br-int',has_traffic_filtering=True,id=7f2d5682-0113-40f4-8bbb-02e87564b7ef,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f2d5682-01')
Oct 20 09:03:51 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Deleting instance files /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91_del
Oct 20 09:03:51 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Deletion of /opt/stack/data/nova/instances/03e487d1-90aa-436d-9c2f-468f9791af91_del complete
Oct 20 09:03:51 user nova-compute[74039]: INFO nova.compute.manager [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Took 1.09 seconds to destroy the instance on the hypervisor.
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:03:51 user nova-compute[74039]: INFO nova.compute.manager [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Took 1.36 seconds to destroy the instance on the hypervisor.
Oct 20 09:03:51 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23933633139383531', 'path': '/dev/sde'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933633139383531', 'path': '/dev/sde'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-981664831',display_name='tempest-ServerActionsTestOtherB-server-981664831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-981664831',id=14,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLks5fH3OqnFIJYbiqhEyJYFZHff7b4Ae9JDwAsMmBzcCMiYxaXPw5gTAg3NjSBwdB4e4WBubdaiWR0mkFHpfIFMVWW5rKzlKquVWH/exNlZL5M7mfGJM5jL4+NyXysGbg==',key_name='tempest-keypair-748521120',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:01:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='da44286b6f5b45fe9ccbd881754a9b3c',ramdisk_id='',reservation_id='r-2fnz9nzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1010421968',owner_user_name='tempest-ServerActionsTestOtherB-1010421968-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:03:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='994701e77d9740f4a7a18390f9438996',uuid=ebaa4804-32e5-4fff-9562-0587ff7ca4ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Converting VIF {"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:03:52 user nova-compute[74039]:   <uuid>ebaa4804-32e5-4fff-9562-0587ff7ca4ed</uuid>
Oct 20 09:03:52 user nova-compute[74039]:   <name>instance-0000000e</name>
Oct 20 09:03:52 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:03:52 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:03:52 user nova-compute[74039]:   <metadata>
Oct 20 09:03:52 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:03:52 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:03:52 user nova-compute[74039]:       <nova:name>tempest-ServerActionsTestOtherB-server-981664831</nova:name>
Oct 20 09:03:52 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:03:51</nova:creationTime>
Oct 20 09:03:52 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:03:52 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:03:52 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:03:52 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:03:52 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:03:52 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:03:52 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:03:52 user nova-compute[74039]:       <nova:owner>
Oct 20 09:03:52 user nova-compute[74039]:         <nova:user uuid="994701e77d9740f4a7a18390f9438996">tempest-ServerActionsTestOtherB-1010421968-project-member</nova:user>
Oct 20 09:03:52 user nova-compute[74039]:         <nova:project uuid="da44286b6f5b45fe9ccbd881754a9b3c">tempest-ServerActionsTestOtherB-1010421968</nova:project>
Oct 20 09:03:52 user nova-compute[74039]:       </nova:owner>
Oct 20 09:03:52 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:03:52 user nova-compute[74039]:       <nova:ports>
Oct 20 09:03:52 user nova-compute[74039]:         <nova:port uuid="e7d9d83f-1522-47f7-ac4c-7dd56facfea7">
Oct 20 09:03:52 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 09:03:52 user nova-compute[74039]:         </nova:port>
Oct 20 09:03:52 user nova-compute[74039]:       </nova:ports>
Oct 20 09:03:52 user nova-compute[74039]:     </nova:instance>
Oct 20 09:03:52 user nova-compute[74039]:   </metadata>
Oct 20 09:03:52 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:03:52 user nova-compute[74039]:     <system>
Oct 20 09:03:52 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:03:52 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:03:52 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:03:52 user nova-compute[74039]:       <entry name="serial">ebaa4804-32e5-4fff-9562-0587ff7ca4ed</entry>
Oct 20 09:03:52 user nova-compute[74039]:       <entry name="uuid">ebaa4804-32e5-4fff-9562-0587ff7ca4ed</entry>
Oct 20 09:03:52 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:03:52 user nova-compute[74039]:     </system>
Oct 20 09:03:52 user nova-compute[74039]:   </sysinfo>
Oct 20 09:03:52 user nova-compute[74039]:   <os>
Oct 20 09:03:52 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:03:52 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:03:52 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:03:52 user nova-compute[74039]:   </os>
Oct 20 09:03:52 user nova-compute[74039]:   <features>
Oct 20 09:03:52 user nova-compute[74039]:     <acpi/>
Oct 20 09:03:52 user nova-compute[74039]:     <apic/>
Oct 20 09:03:52 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:03:52 user nova-compute[74039]:   </features>
Oct 20 09:03:52 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:03:52 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:03:52 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:03:52 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:03:52 user nova-compute[74039]:   </clock>
Oct 20 09:03:52 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:03:52 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:03:52 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:03:52 user nova-compute[74039]:   </cpu>
Oct 20 09:03:52 user nova-compute[74039]:   <devices>
Oct 20 09:03:52 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:03:52 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:03:52 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk"/>
Oct 20 09:03:52 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:03:52 user nova-compute[74039]:     </disk>
Oct 20 09:03:52 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 09:03:52 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:03:52 user nova-compute[74039]:       <source dev="/dev/sde"/>
Oct 20 09:03:52 user nova-compute[74039]:       <target dev="vdb" bus="virtio"/>
Oct 20 09:03:52 user nova-compute[74039]:       <serial>fddcdc2d-8bc1-4ba3-90c0-5607af95bc84</serial>
Oct 20 09:03:52 user nova-compute[74039]:     </disk>
Oct 20 09:03:52 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:03:52 user nova-compute[74039]:       <mac address="fa:16:3e:0d:87:c4"/>
Oct 20 09:03:52 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:03:52 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:03:52 user nova-compute[74039]:       <target dev="tape7d9d83f-15"/>
Oct 20 09:03:52 user nova-compute[74039]:     </interface>
Oct 20 09:03:52 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:03:52 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/console.log" append="off"/>
Oct 20 09:03:52 user nova-compute[74039]:     </serial>
Oct 20 09:03:52 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:03:52 user nova-compute[74039]:     <video>
Oct 20 09:03:52 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:03:52 user nova-compute[74039]:     </video>
Oct 20 09:03:52 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:03:52 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:03:52 user nova-compute[74039]:     </rng>
Oct 20 09:03:52 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:03:52 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:03:52 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:03:52 user nova-compute[74039]:     </memballoon>
Oct 20 09:03:52 user nova-compute[74039]:   </devices>
Oct 20 09:03:52 user nova-compute[74039]: </domain>
Oct 20 09:03:52 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-981664831',display_name='tempest-ServerActionsTestOtherB-server-981664831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-981664831',id=14,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLks5fH3OqnFIJYbiqhEyJYFZHff7b4Ae9JDwAsMmBzcCMiYxaXPw5gTAg3NjSBwdB4e4WBubdaiWR0mkFHpfIFMVWW5rKzlKquVWH/exNlZL5M7mfGJM5jL4+NyXysGbg==',key_name='tempest-keypair-748521120',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:01:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='da44286b6f5b45fe9ccbd881754a9b3c',ramdisk_id='',reservation_id='r-2fnz9nzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1010421968',owner_user_name='tempest-ServerActionsTestOtherB-1010421968-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:03:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='994701e77d9740f4a7a18390f9438996',uuid=ebaa4804-32e5-4fff-9562-0587ff7ca4ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Converting VIF {"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG os_vif [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5add5f42-8609-5905-a571-e6b6f840a84e', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7d9d83f-15, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7d9d83f-15, col_values=(('qos', UUID('ef06564e-fe43-4d1b-841e-8d7fac5c9b42')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7d9d83f-15, col_values=(('external_ids', {'iface-id': 'e7d9d83f-1522-47f7-ac4c-7dd56facfea7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:87:c4', 'vm-uuid': 'ebaa4804-32e5-4fff-9562-0587ff7ca4ed'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:52 user nova-compute[74039]: INFO os_vif [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15')
Oct 20 09:03:52 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:03:52 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Took 0.99 seconds to deallocate network for instance.
Oct 20 09:03:52 user nova-compute[74039]: DEBUG nova.compute.manager [req-d9451227-0d75-4c13-af4e-c3fa998dd141 req-f9d300d4-fe9d-4d9d-bbc6-d71428c0d8c1 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received event network-vif-deleted-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:52 user nova-compute[74039]: INFO nova.compute.manager [req-d9451227-0d75-4c13-af4e-c3fa998dd141 req-f9d300d4-fe9d-4d9d-bbc6-d71428c0d8c1 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Neutron deleted interface 7f2d5682-0113-40f4-8bbb-02e87564b7ef; detaching it from the instance and deleting it from the info cache
Oct 20 09:03:52 user nova-compute[74039]: DEBUG nova.network.neutron [req-d9451227-0d75-4c13-af4e-c3fa998dd141 req-f9d300d4-fe9d-4d9d-bbc6-d71428c0d8c1 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG nova.compute.manager [req-d9451227-0d75-4c13-af4e-c3fa998dd141 req-f9d300d4-fe9d-4d9d-bbc6-d71428c0d8c1 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Detach interface failed, port_id=7f2d5682-0113-40f4-8bbb-02e87564b7ef, reason: Instance 03e487d1-90aa-436d-9c2f-468f9791af91 could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:52 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Took 1.13 seconds to deallocate network for instance.
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received event network-vif-plugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Acquiring lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Lock "03e487d1-90aa-436d-9c2f-468f9791af91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] No waiting events found dispatching network-vif-plugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:03:53 user nova-compute[74039]: WARNING nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 03e487d1-90aa-436d-9c2f-468f9791af91] Received unexpected event network-vif-plugged-7f2d5682-0113-40f4-8bbb-02e87564b7ef for instance with vm_state deleted and task_state None.
Oct 20 09:03:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-vif-unplugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] No waiting events found dispatching network-vif-unplugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:03:53 user nova-compute[74039]: WARNING nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received unexpected event network-vif-unplugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 for instance with vm_state deleted and task_state None.
Oct 20 09:03:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] No waiting events found dispatching network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:03:53 user nova-compute[74039]: WARNING nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received unexpected event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 for instance with vm_state deleted and task_state None.
Oct 20 09:03:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] No waiting events found dispatching network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:03:53 user nova-compute[74039]: WARNING nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received unexpected event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 for instance with vm_state deleted and task_state None.
Oct 20 09:03:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] No waiting events found dispatching network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:03:53 user nova-compute[74039]: WARNING nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received unexpected event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 for instance with vm_state deleted and task_state None.
Oct 20 09:03:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-vif-unplugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] No waiting events found dispatching network-vif-unplugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:03:53 user nova-compute[74039]: WARNING nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received unexpected event network-vif-unplugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 for instance with vm_state deleted and task_state None.
Oct 20 09:03:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Acquiring lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] No waiting events found dispatching network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:03:53 user nova-compute[74039]: WARNING nova.compute.manager [req-ac59301b-1ca0-4acd-9158-f74cec31cbac req-3035a87b-8833-4d51-95e7-fb09ccef77c5 service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received unexpected event network-vif-plugged-45971bed-5f51-4ebd-9641-e2cc09d91d71 for instance with vm_state deleted and task_state None.
Oct 20 09:03:53 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.361s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:53 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Deleted allocations for instance 03e487d1-90aa-436d-9c2f-468f9791af91
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-34ef783b-47a3-42a6-a4e0-62c71b0d1898 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "03e487d1-90aa-436d-9c2f-468f9791af91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.058s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:03:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.469s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:53 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Deleted allocations for instance 2ae63f29-de62-4e82-877c-8bb4a3f2beb3
Oct 20 09:03:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-64553efc-25c8-4d64-912e-8b316608a593 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "2ae63f29-de62-4e82-877c-8bb4a3f2beb3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.243s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-69e96f6b-39cc-45d1-8549-3b2dc543c78b req-fed57c7d-e645-4b2b-b0a4-ebf692ac27ee service nova] [instance: 2ae63f29-de62-4e82-877c-8bb4a3f2beb3] Received event network-vif-deleted-45971bed-5f51-4ebd-9641-e2cc09d91d71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-1789fa5d-7845-49f5-8521-69a3d48d57db req-1df0ba62-80dc-4908-9c20-87993e9fe9b6 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received event network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1789fa5d-7845-49f5-8521-69a3d48d57db req-1df0ba62-80dc-4908-9c20-87993e9fe9b6 service nova] Acquiring lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1789fa5d-7845-49f5-8521-69a3d48d57db req-1df0ba62-80dc-4908-9c20-87993e9fe9b6 service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1789fa5d-7845-49f5-8521-69a3d48d57db req-1df0ba62-80dc-4908-9c20-87993e9fe9b6 service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-1789fa5d-7845-49f5-8521-69a3d48d57db req-1df0ba62-80dc-4908-9c20-87993e9fe9b6 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] No waiting events found dispatching network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:03:55 user nova-compute[74039]: WARNING nova.compute.manager [req-1789fa5d-7845-49f5-8521-69a3d48d57db req-1df0ba62-80dc-4908-9c20-87993e9fe9b6 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received unexpected event network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 for instance with vm_state resized and task_state resize_reverting.
Oct 20 09:03:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-1789fa5d-7845-49f5-8521-69a3d48d57db req-1df0ba62-80dc-4908-9c20-87993e9fe9b6 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received event network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1789fa5d-7845-49f5-8521-69a3d48d57db req-1df0ba62-80dc-4908-9c20-87993e9fe9b6 service nova] Acquiring lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1789fa5d-7845-49f5-8521-69a3d48d57db req-1df0ba62-80dc-4908-9c20-87993e9fe9b6 service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1789fa5d-7845-49f5-8521-69a3d48d57db req-1df0ba62-80dc-4908-9c20-87993e9fe9b6 service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-1789fa5d-7845-49f5-8521-69a3d48d57db req-1df0ba62-80dc-4908-9c20-87993e9fe9b6 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] No waiting events found dispatching network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:03:55 user nova-compute[74039]: WARNING nova.compute.manager [req-1789fa5d-7845-49f5-8521-69a3d48d57db req-1df0ba62-80dc-4908-9c20-87993e9fe9b6 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received unexpected event network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 for instance with vm_state resized and task_state resize_reverting.
Oct 20 09:03:55 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8af05cc2-c1b2-4187-b16e-5fbeb006de6a is timed out.
Oct 20 09:03:55 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Successfully detached device vdb from instance 8af05cc2-c1b2-4187-b16e-5fbeb006de6a from the live domain config.
Oct 20 09:03:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TJFUzZwD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:03:55 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:03:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf93eb5-cd5e-4e32-be29-4bec47e4c6d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:03:55 user nova-compute[74039]: No targets found.
Oct 20 09:03:55 user nova-compute[74039]: iSNS:
Oct 20 09:03:55 user nova-compute[74039]: No targets found.
Oct 20 09:03:55 user nova-compute[74039]: STATIC:
Oct 20 09:03:55 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8
Oct 20 09:03:55 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:03:55 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:03:55 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016
Oct 20 09:03:55 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:03:55 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:03:55 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84
Oct 20 09:03:55 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:03:55 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:03:55 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd
Oct 20 09:03:55 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:03:55 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:03:55 user nova-compute[74039]: FIRMWARE:
Oct 20 09:03:55 user nova-compute[74039]: No targets found.
Oct 20 09:03:55 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:03:55 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:03:55 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ef92ea-915f-4ca5-b6a8-422269804559]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24293d4-b196-4466-9d1b-dddd85f9c037]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:55 user nova-compute[74039]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)
Oct 20 09:03:55 user nova-compute[74039]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 (non-flash)
Oct 20 09:03:55 user nova-compute[74039]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:03:55 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 (non-flash)
Oct 20 09:03:55 user nova-compute[74039]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)
Oct 20 09:03:55 user nova-compute[74039]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 (non-flash)
Oct 20 09:03:55 user nova-compute[74039]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:03:55 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae8445df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8'): ({'sdc'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Removing single pathed devices sdc {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c6c119-a52b-4e62-81cf-7165f3313cf7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa58223f-22c0-428b-b267-563df8d2549a]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Flushing IO for device /dev/sdc {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6692ab37-1e68-4111-86fa-f6546500fda3]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29b7bcb-7c43-4f11-ac46-c7b4807f6f6c]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:03:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:03:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:03:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[68271297-0feb-44cb-b60b-2e870de87bc7]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbde8db-7c33-44a5-9ce9-f727390d5a7e]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8, portal: 172.16.0.220,3260]
Oct 20 09:03:56 user nova-compute[74039]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8, portal: 172.16.0.220,3260] successful.
Oct 20 09:03:56 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7bf45ae-1f15-4a0e-81c5-7a75418433e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0aace1-3f34-4723-8782-1f9016a6beeb]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:03:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] <== disconnect_volume: return (345ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:03:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:03:56 user nova-compute[74039]: DEBUG nova.compute.manager [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:03:56 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Instance running successfully.
Oct 20 09:03:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] finish_revert_migration finished successfully. {{(pid=74039) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG nova.objects.instance [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lazy-loading 'flavor' on Instance uuid 8af05cc2-c1b2-4187-b16e-5fbeb006de6a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-36288434-24c0-4d5c-bcf9-60965c04c4c4 tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.475s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:57 user nova-compute[74039]: INFO nova.compute.manager [None req-9201453c-e967-48d0-a0fb-89a6bc8f9a8c tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Updating instance to original state: 'active'
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Acquiring lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG nova.objects.instance [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lazy-loading 'flavor' on Instance uuid def7ee9b-e0ed-4c95-961c-c6d79144f0ca {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Acquiring lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:57 user nova-compute[74039]: INFO nova.compute.manager [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Attaching volume 699aa8be-48fd-4ce8-91df-ab9801667d19 to /dev/vdb
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:03:57 user nova-compute[74039]: INFO nova.compute.manager [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Detaching volume fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd
Oct 20 09:03:57 user nova-compute[74039]: DEBUG os_brick.utils [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6680045f-5612-4cd8-96b5-df5f907ce77f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89d4ef4-3dbe-4728-8a84-f5cca7945fea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:57 user nova-compute[74039]: INFO nova.virt.block_device [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Attempting to driver detach volume fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd from mountpoint /dev/vdc
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[684a859e-6ff7-41d6-882f-a3cdf99287f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea0cff7-dba3-4796-995f-8f1a69541439]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Attempting to detach device vdc from instance 8af05cc2-c1b2-4187-b16e-5fbeb006de6a from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:03:57 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:03:57 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 09:03:57 user nova-compute[74039]:   <target dev="vdc" bus="virtio"/>
Oct 20 09:03:57 user nova-compute[74039]:   <serial>fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd</serial>
Oct 20 09:03:57 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 09:03:57 user nova-compute[74039]: </disk>
Oct 20 09:03:57 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:03:57 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:03:57 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6dfe69-3084-413f-922e-e048ae9ec41b]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG os_brick.utils [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Updating existing volume attachment record: b70940ff-35e3-4606-aaf8-7fcf68037a47 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:03:57 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Successfully detached device vdc from instance 8af05cc2-c1b2-4187-b16e-5fbeb006de6a from the persistent domain config.
Oct 20 09:03:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8af05cc2-c1b2-4187-b16e-5fbeb006de6a from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 09:03:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:03:57 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:03:57 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 09:03:57 user nova-compute[74039]:   <target dev="vdc" bus="virtio"/>
Oct 20 09:03:57 user nova-compute[74039]:   <serial>fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd</serial>
Oct 20 09:03:57 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 09:03:57 user nova-compute[74039]: </disk>
Oct 20 09:03:57 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:03:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8af05cc2-c1b2-4187-b16e-5fbeb006de6a {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 09:03:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:03:59 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4f5d98e3-c1f6-4617-8847-b975e2c23990 is timed out.
Oct 20 09:03:59 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Successfully detached device vdb from instance 4f5d98e3-c1f6-4617-8847-b975e2c23990 from the live domain config.
Oct 20 09:03:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVDnwWBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:03:59 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:03:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d1fcbe-3e2b-4dff-8749-c6e6d70a35f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:03:59 user nova-compute[74039]: No targets found.
Oct 20 09:03:59 user nova-compute[74039]: iSNS:
Oct 20 09:03:59 user nova-compute[74039]: No targets found.
Oct 20 09:03:59 user nova-compute[74039]: STATIC:
Oct 20 09:03:59 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016
Oct 20 09:03:59 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:03:59 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:03:59 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84
Oct 20 09:03:59 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:03:59 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:03:59 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd
Oct 20 09:03:59 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:03:59 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:03:59 user nova-compute[74039]: FIRMWARE:
Oct 20 09:03:59 user nova-compute[74039]: No targets found.
Oct 20 09:03:59 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:03:59 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:03:59 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47d003e-b3a8-4516-b2dc-013c93c2effc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efa4ad9-7bf4-461b-a592-e54e29c1ccd8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)
Oct 20 09:03:59 user nova-compute[74039]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 (non-flash)
Oct 20 09:03:59 user nova-compute[74039]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:03:59 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)
Oct 20 09:03:59 user nova-compute[74039]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 (non-flash)
Oct 20 09:03:59 user nova-compute[74039]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:03:59 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae8445d240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016'): ({'sdd'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Removing single pathed devices sdd {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[539c3466-da5d-4237-bbbb-5015d5d98138]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[686f48ab-9b23-4ac4-ae83-1118e49b0eb9]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Flushing IO for device /dev/sdd {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0be341-f996-49f9-a197-25f246ada9b9]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e6b314-11f2-4359-bc82-1338f48018d4]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ae8a34-2c0a-4cb8-a3f3-68df84ea9d63]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b110ffa6-7f50-445f-9088-c0bb90ea8dd8]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016, portal: 172.16.0.220,3260]
Oct 20 09:03:59 user nova-compute[74039]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016, portal: 172.16.0.220,3260] successful.
Oct 20 09:03:59 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30376c3e-e117-4d49-8409-16419f2ec016 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3cb884-ddcc-4de6-9a56-0f6d587ce3b1]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] <== disconnect_volume: return (305ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:03:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:04:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:04:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:04:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:04:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:04:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVHZqdLJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:04:16 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:04:16 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:04:16 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9413eee5-9cfd-4e9e-8eef-2b06b5756d24]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:04:16 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbffb85-ac34-4f2e-baa4-2a4f38afc557]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19] added
Oct 20 09:04:16 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[64535a73-0316-41c9-a247-728efac6d635]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b249992-0cae-4bc5-81c1-89257e8798a3]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KVHZqdLJ {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KVHZqdLJ" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5c84f1-9ddc-4120-baa3-98922675d3ab]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KVHZqdLJ'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[10debe21-e0c0-4a6a-a2c1-00e6d7643d28]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6647cd38-9892-4329-a11e-a77eb46c948f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)
Oct 20 09:04:16 user nova-compute[74039]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:04:16 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)
Oct 20 09:04:16 user nova-compute[74039]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:04:16 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1aa7a2-095a-4ee0-843a-ca6741b43765]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19, portal: 172.16.0.220,3260]
Oct 20 09:04:16 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19, portal: 172.16.0.220,3260] successful.
Oct 20 09:04:16 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ef5a6b-ab5b-48ab-92b0-355e59b58545]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[21eabfd0-f314-47f5-91c8-8bf23c6ea0e6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)
Oct 20 09:04:16 user nova-compute[74039]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:04:16 user nova-compute[74039]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)
Oct 20 09:04:16 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)
Oct 20 09:04:16 user nova-compute[74039]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:04:16 user nova-compute[74039]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)
Oct 20 09:04:16 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fa31c3-2bc2-48cd-82db-5da6204a2212]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVHZqdLJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG nova.objects.instance [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lazy-loading 'flavor' on Instance uuid 4f5d98e3-c1f6-4617-8847-b975e2c23990 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:04:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-29753ece-29bc-4910-af44-6a30b8dc340a tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 37.996s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26465623139636364', 'path': '/dev/sdc'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465623139636364', 'path': '/dev/sdc'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG nova.objects.instance [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lazy-loading 'flavor' on Instance uuid def7ee9b-e0ed-4c95-961c-c6d79144f0ca {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 09:04:17 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:04:17 user nova-compute[74039]:   <source dev="/dev/sdc"/>
Oct 20 09:04:17 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:04:17 user nova-compute[74039]:   <serial>699aa8be-48fd-4ce8-91df-ab9801667d19</serial>
Oct 20 09:04:17 user nova-compute[74039]: </disk>
Oct 20 09:04:17 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Acquiring lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Acquiring lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:17 user nova-compute[74039]: INFO nova.compute.manager [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Terminating instance
Oct 20 09:04:17 user nova-compute[74039]: DEBUG nova.compute.manager [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] No VIF found with MAC fa:16:3e:ab:3b:34, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG nova.compute.manager [req-951dea19-431d-4263-9b0d-7674c24839ea req-493429f3-a9d3-43cf-9131-acff06aab322 service nova] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Received event network-vif-unplugged-ab3b01d7-26b5-4041-9b32-d609e2e2663e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-951dea19-431d-4263-9b0d-7674c24839ea req-493429f3-a9d3-43cf-9131-acff06aab322 service nova] Acquiring lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-951dea19-431d-4263-9b0d-7674c24839ea req-493429f3-a9d3-43cf-9131-acff06aab322 service nova] Lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-951dea19-431d-4263-9b0d-7674c24839ea req-493429f3-a9d3-43cf-9131-acff06aab322 service nova] Lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG nova.compute.manager [req-951dea19-431d-4263-9b0d-7674c24839ea req-493429f3-a9d3-43cf-9131-acff06aab322 service nova] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] No waiting events found dispatching network-vif-unplugged-ab3b01d7-26b5-4041-9b32-d609e2e2663e {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:04:17 user nova-compute[74039]: DEBUG nova.compute.manager [req-951dea19-431d-4263-9b0d-7674c24839ea req-493429f3-a9d3-43cf-9131-acff06aab322 service nova] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Received event network-vif-unplugged-ab3b01d7-26b5-4041-9b32-d609e2e2663e for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-27425539-05dd-4df8-9e16-d753887a086c tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.437s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:18 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Instance destroyed successfully.
Oct 20 09:04:18 user nova-compute[74039]: DEBUG nova.objects.instance [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lazy-loading 'resources' on Instance uuid f8236653-a179-4d3f-9bd3-4c91c85aeaea {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-580631099',display_name='tempest-VolumesActionsTest-instance-580631099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-580631099',id=26,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:02:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7181660fb3d4a3e995e2ccd85dfe3c2',ramdisk_id='',reservation_id='r-qzppjiyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2122958476',owner_user_name='tempest-VolumesActionsTest-2122958476-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:02:31Z,user_data=None,user_id='644af097c95f4a26817492be77c327d9',uuid=f8236653-a179-4d3f-9bd3-4c91c85aeaea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab3b01d7-26b5-4041-9b32-d609e2e2663e", "address": "fa:16:3e:fb:93:8c", "network": {"id": "0d9cc42e-a86c-4a9b-bab9-179e24144ea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-339724642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7181660fb3d4a3e995e2ccd85dfe3c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3b01d7-26", "ovs_interfaceid": "ab3b01d7-26b5-4041-9b32-d609e2e2663e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Converting VIF {"id": "ab3b01d7-26b5-4041-9b32-d609e2e2663e", "address": "fa:16:3e:fb:93:8c", "network": {"id": "0d9cc42e-a86c-4a9b-bab9-179e24144ea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-339724642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7181660fb3d4a3e995e2ccd85dfe3c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3b01d7-26", "ovs_interfaceid": "ab3b01d7-26b5-4041-9b32-d609e2e2663e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:93:8c,bridge_name='br-int',has_traffic_filtering=True,id=ab3b01d7-26b5-4041-9b32-d609e2e2663e,network=Network(0d9cc42e-a86c-4a9b-bab9-179e24144ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3b01d7-26') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_vif [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:93:8c,bridge_name='br-int',has_traffic_filtering=True,id=ab3b01d7-26b5-4041-9b32-d609e2e2663e,network=Network(0d9cc42e-a86c-4a9b-bab9-179e24144ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3b01d7-26') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab3b01d7-26, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03d348b0-e208-472c-826e-ecc6e2f15b2b) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:18 user nova-compute[74039]: INFO os_vif [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:93:8c,bridge_name='br-int',has_traffic_filtering=True,id=ab3b01d7-26b5-4041-9b32-d609e2e2663e,network=Network(0d9cc42e-a86c-4a9b-bab9-179e24144ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3b01d7-26')
Oct 20 09:04:18 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Deleting instance files /opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea_del
Oct 20 09:04:18 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Deletion of /opt/stack/data/nova/instances/f8236653-a179-4d3f-9bd3-4c91c85aeaea_del complete
Oct 20 09:04:18 user nova-compute[74039]: INFO nova.compute.manager [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Took 0.74 seconds to destroy the instance on the hypervisor.
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:04:18 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 8af05cc2-c1b2-4187-b16e-5fbeb006de6a is timed out.
Oct 20 09:04:18 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Successfully detached device vdc from instance 8af05cc2-c1b2-4187-b16e-5fbeb006de6a from the live domain config.
Oct 20 09:04:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLoGUxYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:04:18 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7935964-f205-487a-adad-4b7a3b1dc739]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:04:18 user nova-compute[74039]: No targets found.
Oct 20 09:04:18 user nova-compute[74039]: iSNS:
Oct 20 09:04:18 user nova-compute[74039]: No targets found.
Oct 20 09:04:18 user nova-compute[74039]: STATIC:
Oct 20 09:04:18 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84
Oct 20 09:04:18 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:04:18 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:04:18 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd
Oct 20 09:04:18 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:04:18 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:04:18 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19
Oct 20 09:04:18 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:04:18 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:04:18 user nova-compute[74039]: FIRMWARE:
Oct 20 09:04:18 user nova-compute[74039]: No targets found.
Oct 20 09:04:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:04:18 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:04:18 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b735123-05f4-42ea-89df-911f2a249ca9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[032dc614-d9f0-408f-a8a0-ed4243182de9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)
Oct 20 09:04:18 user nova-compute[74039]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:04:18 user nova-compute[74039]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)
Oct 20 09:04:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd (non-flash)
Oct 20 09:04:18 user nova-compute[74039]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:04:18 user nova-compute[74039]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)
Oct 20 09:04:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae8445c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd'): ({'sdb'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Removing single pathed devices sdb {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6f7926-a9f5-4ba6-9d5f-4c3158190d98]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[20160144-8005-46c6-81da-f8c20993df6c]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Flushing IO for device /dev/sdb {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0745af6f-2d40-46f3-ab84-a25cd2f39cdc]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Acquiring lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Acquiring lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:18 user nova-compute[74039]: INFO nova.compute.manager [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Terminating instance
Oct 20 09:04:18 user nova-compute[74039]: DEBUG nova.compute.manager [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[632a306b-ea42-4695-a8f9-2ce3f6e3ac6e]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d60578-acad-4daf-9fac-06cf60581539]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be4a712-8065-4b03-aeb4-f4ad0e994468]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd, portal: 172.16.0.220,3260]
Oct 20 09:04:18 user nova-compute[74039]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd, portal: 172.16.0.220,3260] successful.
Oct 20 09:04:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd9e247-c4d9-4e1a-87a8-f5ac69e405fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[003a42e0-22fa-4fec-a862-ee3b58eefa36]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] <== disconnect_volume: return (355ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:04:18 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:04:18 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Took 0.62 seconds to deallocate network for instance.
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.compute.manager [req-93588ea5-2234-4d8e-89ad-67af0f5aad5b req-ef16b95c-5d7d-43c7-ab61-d8cd6e384ea0 service nova] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Received event network-vif-deleted-ab3b01d7-26b5-4041-9b32-d609e2e2663e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVNjlEom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:04:19 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:04:19 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:04:19 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Starting finish_migration {{(pid=74039) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Instance directory exists: not creating {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 09:04:19 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Creating image(s)
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Did not create local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Ensure instance console log exists: /opt/stack/data/nova/instances/00e09d93-3077-4770-abfd-b82ece646997/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Start _get_guest_xml network_info=[{"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-945485380-network", "vif_mac": "fa:16:3e:d7:28:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c09f8b5e-dab2-42d4-b713-873803d575c2', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKlBfatR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '00e09d93-3077-4770-abfd-b82ece646997', 'attached_at': '2023-10-20T09:04:19.000000', 'detached_at': '', 'volume_id': '761590b5-010a-47bc-9316-294b487cf5c1', 'serial': '761590b5-010a-47bc-9316-294b487cf5c1'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b7c47e-52db-48ef-b097-810930c75db0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:04:19 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:19 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:04:19 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e80d725-27eb-45aa-b08f-70b3dbb0b76b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5] added
Oct 20 09:04:19 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKlBfatR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:04:19 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9405098-ea43-453f-8b4f-dd9775a6bab6]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:19 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Instance destroyed successfully.
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.objects.instance [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lazy-loading 'resources' on Instance uuid def7ee9b-e0ed-4c95-961c-c6d79144f0ca {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b3e571-9ae5-49ae-affd-b57815f7e3ae]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:01:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-462159413',display_name='tempest-DeleteServersTestJSON-server-462159413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-462159413',id=25,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:02:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1aae6f3e74c41769474f7618b0f3a0b',ramdisk_id='',reservation_id='r-37blellu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1719064105',owner_user_name='tempest-DeleteServersTestJSON-1719064105-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:02:00Z,user_data=None,user_id='935ac4f4da314ed585a4d4a2b053884b',uuid=def7ee9b-e0ed-4c95-961c-c6d79144f0ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "841a8134-5b00-46f0-9e3a-604831e8ef1f", "address": "fa:16:3e:ab:3b:34", "network": {"id": "eaffdf13-e72f-4493-8da9-2d079001d9a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-993230787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1aae6f3e74c41769474f7618b0f3a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a8134-5b", "ovs_interfaceid": "841a8134-5b00-46f0-9e3a-604831e8ef1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Converting VIF {"id": "841a8134-5b00-46f0-9e3a-604831e8ef1f", "address": "fa:16:3e:ab:3b:34", "network": {"id": "eaffdf13-e72f-4493-8da9-2d079001d9a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-993230787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1aae6f3e74c41769474f7618b0f3a0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841a8134-5b", "ovs_interfaceid": "841a8134-5b00-46f0-9e3a-604831e8ef1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:3b:34,bridge_name='br-int',has_traffic_filtering=True,id=841a8134-5b00-46f0-9e3a-604831e8ef1f,network=Network(eaffdf13-e72f-4493-8da9-2d079001d9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a8134-5b') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_vif [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:3b:34,bridge_name='br-int',has_traffic_filtering=True,id=841a8134-5b00-46f0-9e3a-604831e8ef1f,network=Network(eaffdf13-e72f-4493-8da9-2d079001d9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a8134-5b') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hVNjlEom {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap841a8134-5b, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6b579e5-ef28-4ca4-810e-3f47ad68adea) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hVNjlEom" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c87f20-222d-435c-955f-b7c048a88ae1]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hVNjlEom'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:19 user nova-compute[74039]: INFO os_vif [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:3b:34,bridge_name='br-int',has_traffic_filtering=True,id=841a8134-5b00-46f0-9e3a-604831e8ef1f,network=Network(eaffdf13-e72f-4493-8da9-2d079001d9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841a8134-5b')
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVHZqdLJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:04:19 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1f4baf-b091-4ded-b094-0b564e09aa44]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[59078cd5-ac29-4255-8258-eb1f3ca5ac2a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:04:19 user nova-compute[74039]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)
Oct 20 09:04:19 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:04:19 user nova-compute[74039]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)
Oct 20 09:04:19 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a29d74a-9c54-4d11-8a1c-a3c8a64b3d20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5, portal: 172.16.0.220,3260]
Oct 20 09:04:19 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5, portal: 172.16.0.220,3260] successful.
Oct 20 09:04:19 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacfedd8-fb37-41e4-ab05-f55806ea4c5b]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:19 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Deleted allocations for instance f8236653-a179-4d3f-9bd3-4c91c85aeaea
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a5b765-565a-4d04-8366-1ac4a1b14962]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:04:19 user nova-compute[74039]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)
Oct 20 09:04:19 user nova-compute[74039]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 (non-flash)
Oct 20 09:04:19 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:04:19 user nova-compute[74039]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)
Oct 20 09:04:19 user nova-compute[74039]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 (non-flash)
Oct 20 09:04:19 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[614de85a-8d98-459b-8f89-59279fb17b0a]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVNjlEom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fd3c5954-7054-4e2e-b68b-f83cd3aadc41 tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.043s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG nova.objects.instance [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lazy-loading 'flavor' on Instance uuid 8af05cc2-c1b2-4187-b16e-5fbeb006de6a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:04:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7643d921-e354-4803-bdeb-551c5302bc0c tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.159s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-483188f8-9f23-4381-b04f-ef3d6e8b772c req-3fdf1e9b-1fd7-47ab-a2b6-db3a5e98341f service nova] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Received event network-vif-plugged-ab3b01d7-26b5-4041-9b32-d609e2e2663e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-483188f8-9f23-4381-b04f-ef3d6e8b772c req-3fdf1e9b-1fd7-47ab-a2b6-db3a5e98341f service nova] Acquiring lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-483188f8-9f23-4381-b04f-ef3d6e8b772c req-3fdf1e9b-1fd7-47ab-a2b6-db3a5e98341f service nova] Lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-483188f8-9f23-4381-b04f-ef3d6e8b772c req-3fdf1e9b-1fd7-47ab-a2b6-db3a5e98341f service nova] Lock "f8236653-a179-4d3f-9bd3-4c91c85aeaea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-483188f8-9f23-4381-b04f-ef3d6e8b772c req-3fdf1e9b-1fd7-47ab-a2b6-db3a5e98341f service nova] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] No waiting events found dispatching network-vif-plugged-ab3b01d7-26b5-4041-9b32-d609e2e2663e {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:04:20 user nova-compute[74039]: WARNING nova.compute.manager [req-483188f8-9f23-4381-b04f-ef3d6e8b772c req-3fdf1e9b-1fd7-47ab-a2b6-db3a5e98341f service nova] [instance: f8236653-a179-4d3f-9bd3-4c91c85aeaea] Received unexpected event network-vif-plugged-ab3b01d7-26b5-4041-9b32-d609e2e2663e for instance with vm_state deleted and task_state None.
Oct 20 09:04:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-483188f8-9f23-4381-b04f-ef3d6e8b772c req-3fdf1e9b-1fd7-47ab-a2b6-db3a5e98341f service nova] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Received event network-vif-unplugged-841a8134-5b00-46f0-9e3a-604831e8ef1f {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-483188f8-9f23-4381-b04f-ef3d6e8b772c req-3fdf1e9b-1fd7-47ab-a2b6-db3a5e98341f service nova] Acquiring lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-483188f8-9f23-4381-b04f-ef3d6e8b772c req-3fdf1e9b-1fd7-47ab-a2b6-db3a5e98341f service nova] Lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-483188f8-9f23-4381-b04f-ef3d6e8b772c req-3fdf1e9b-1fd7-47ab-a2b6-db3a5e98341f service nova] Lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-483188f8-9f23-4381-b04f-ef3d6e8b772c req-3fdf1e9b-1fd7-47ab-a2b6-db3a5e98341f service nova] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] No waiting events found dispatching network-vif-unplugged-841a8134-5b00-46f0-9e3a-604831e8ef1f {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-483188f8-9f23-4381-b04f-ef3d6e8b772c req-3fdf1e9b-1fd7-47ab-a2b6-db3a5e98341f service nova] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Received event network-vif-unplugged-841a8134-5b00-46f0-9e3a-604831e8ef1f for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-483188f8-9f23-4381-b04f-ef3d6e8b772c req-3fdf1e9b-1fd7-47ab-a2b6-db3a5e98341f service nova] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Received event network-vif-plugged-841a8134-5b00-46f0-9e3a-604831e8ef1f {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-483188f8-9f23-4381-b04f-ef3d6e8b772c req-3fdf1e9b-1fd7-47ab-a2b6-db3a5e98341f service nova] Acquiring lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-483188f8-9f23-4381-b04f-ef3d6e8b772c req-3fdf1e9b-1fd7-47ab-a2b6-db3a5e98341f service nova] Lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-483188f8-9f23-4381-b04f-ef3d6e8b772c req-3fdf1e9b-1fd7-47ab-a2b6-db3a5e98341f service nova] Lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-483188f8-9f23-4381-b04f-ef3d6e8b772c req-3fdf1e9b-1fd7-47ab-a2b6-db3a5e98341f service nova] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] No waiting events found dispatching network-vif-plugged-841a8134-5b00-46f0-9e3a-604831e8ef1f {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:04:20 user nova-compute[74039]: WARNING nova.compute.manager [req-483188f8-9f23-4381-b04f-ef3d6e8b772c req-3fdf1e9b-1fd7-47ab-a2b6-db3a5e98341f service nova] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Received unexpected event network-vif-plugged-841a8134-5b00-46f0-9e3a-604831e8ef1f for instance with vm_state active and task_state deleting.
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23039326262393966', 'path': '/dev/sdb'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039326262393966', 'path': '/dev/sdb'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.281s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:04:20 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:04:20 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG nova.objects.instance [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lazy-loading 'flavor' on Instance uuid e14ecf11-28b6-421d-875f-0ce9a21999d3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21a1336-08d1-4982-b609-ccbe22f32262]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:04:20 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 09:04:20 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:04:20 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 09:04:20 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:04:20 user nova-compute[74039]:   <serial>ca4bcc71-c61a-49a0-ae06-58300cbc4af5</serial>
Oct 20 09:04:20 user nova-compute[74039]: </disk>
Oct 20 09:04:20 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c9b3dd-ffc5-4ec6-963d-ca3b6a8b8c58]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1] added
Oct 20 09:04:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4db0a15-6364-4c08-92b3-01b4cdb0d6d5]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c51019-7549-439a-8e68-5ef95bc17136]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AKlBfatR {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AKlBfatR" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38398fb-7aa9-4846-912b-99d5fe6c3fd0]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AKlBfatR'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3269f755-f266-462c-b12d-56ca7b856294]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[307e0a26-05e3-4bcd-b300-f495c16e0bea]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:04:20 user nova-compute[74039]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)
Oct 20 09:04:20 user nova-compute[74039]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 (non-flash)
Oct 20 09:04:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:04:20 user nova-compute[74039]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)
Oct 20 09:04:20 user nova-compute[74039]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 (non-flash)
Oct 20 09:04:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50eab79-56fd-46dd-a53e-e658c1145fce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1, portal: 172.16.0.220,3260]
Oct 20 09:04:20 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1, portal: 172.16.0.220,3260] successful.
Oct 20 09:04:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[264172b3-7c49-4799-8edc-29fccb214abe]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[64420f91-87f3-4e10-bb01-180bac535c06]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:04:20 user nova-compute[74039]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)
Oct 20 09:04:20 user nova-compute[74039]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 (non-flash)
Oct 20 09:04:20 user nova-compute[74039]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:04:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:04:20 user nova-compute[74039]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)
Oct 20 09:04:20 user nova-compute[74039]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 (non-flash)
Oct 20 09:04:20 user nova-compute[74039]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:04:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:04:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ef9b65-4c00-4b41-acd0-7aa5d9ba6211]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:21 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:04:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKlBfatR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:04:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:04:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:04:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] No VIF found with MAC fa:16:3e:4c:10:22, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:04:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:21 user nova-compute[74039]: INFO nova.compute.manager [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Terminating instance
Oct 20 09:04:21 user nova-compute[74039]: DEBUG nova.compute.manager [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:04:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35034c27-334d-4470-ae78-f99135e9d05c tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.503s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] <== connect_volume: return (2664ms) {'type': 'block', 'scsi_wwn': '23436313132633734', 'path': '/dev/sdd'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436313132633734', 'path': '/dev/sdd'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.592s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:22 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Instance destroyed successfully.
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.objects.instance [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lazy-loading 'resources' on Instance uuid 8af05cc2-c1b2-4187-b16e-5fbeb006de6a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[659a4eb1-4b73-4ad7-9e57-30dfe07639a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:04:22 user nova-compute[74039]: No targets found.
Oct 20 09:04:22 user nova-compute[74039]: iSNS:
Oct 20 09:04:22 user nova-compute[74039]: No targets found.
Oct 20 09:04:22 user nova-compute[74039]: STATIC:
Oct 20 09:04:22 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1
Oct 20 09:04:22 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:04:22 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:04:22 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84
Oct 20 09:04:22 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:04:22 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:04:22 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19
Oct 20 09:04:22 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:04:22 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:04:22 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5
Oct 20 09:04:22 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:04:22 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:04:22 user nova-compute[74039]: FIRMWARE:
Oct 20 09:04:22 user nova-compute[74039]: No targets found.
Oct 20 09:04:22 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:04:22 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:04:22 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-545991427',display_name='tempest-AttachVolumeTestJSON-server-545991427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-545991427',id=21,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8yPCcXkGa5NGmDCjjyPeKJpDRXP/krA/BYoSZXi5PzvMQs1R74j/TXU1tP9vTRlm/U+heKByYdWrgOdwKLLPdxQVPQiWoFClS8AGJhLfSDpwHpFmNOSD8BHOegL6QgZw==',key_name='tempest-keypair-1945081547',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:00:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39bff5237c144002a806235775eda215',ramdisk_id='',reservation_id='r-unx3bj5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1630150217',owner_user_name='tempest-AttachVolumeTestJSON-1630150217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:00:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='907a4bffd1d34559b3dd1ede3be227ee',uuid=8af05cc2-c1b2-4187-b16e-5fbeb006de6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "address": "fa:16:3e:e6:1f:b2", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f15714-c9", "ovs_interfaceid": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Converting VIF {"id": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "address": "fa:16:3e:e6:1f:b2", "network": {"id": "07b19de8-22c5-4d12-86ed-3e443540c21f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1849192083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bff5237c144002a806235775eda215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f15714-c9", "ovs_interfaceid": "e3f15714-c9a3-44e4-832a-953cf2dbed61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:1f:b2,bridge_name='br-int',has_traffic_filtering=True,id=e3f15714-c9a3-44e4-832a-953cf2dbed61,network=Network(07b19de8-22c5-4d12-86ed-3e443540c21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f15714-c9') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_vif [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:1f:b2,bridge_name='br-int',has_traffic_filtering=True,id=e3f15714-c9a3-44e4-832a-953cf2dbed61,network=Network(07b19de8-22c5-4d12-86ed-3e443540c21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f15714-c9') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3f15714-c9, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33616106-ae85-4ff3-a001-e3807f0b06d6) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[16529b28-6bdb-44ad-a0be-aefc95cc94a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:22 user nova-compute[74039]: INFO os_vif [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:1f:b2,bridge_name='br-int',has_traffic_filtering=True,id=e3f15714-c9a3-44e4-832a-953cf2dbed61,network=Network(07b19de8-22c5-4d12-86ed-3e443540c21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f15714-c9')
Oct 20 09:04:22 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Deleting instance files /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a_del
Oct 20 09:04:22 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Deletion of /opt/stack/data/nova/instances/8af05cc2-c1b2-4187-b16e-5fbeb006de6a_del complete
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.compute.manager [req-dd804204-dd84-4824-9c69-a104f6ef83ac req-a2f58158-9896-48c3-ab31-e321cea6ed93 service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Received event network-vif-unplugged-e3f15714-c9a3-44e4-832a-953cf2dbed61 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-dd804204-dd84-4824-9c69-a104f6ef83ac req-a2f58158-9896-48c3-ab31-e321cea6ed93 service nova] Acquiring lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-dd804204-dd84-4824-9c69-a104f6ef83ac req-a2f58158-9896-48c3-ab31-e321cea6ed93 service nova] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-dd804204-dd84-4824-9c69-a104f6ef83ac req-a2f58158-9896-48c3-ab31-e321cea6ed93 service nova] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.compute.manager [req-dd804204-dd84-4824-9c69-a104f6ef83ac req-a2f58158-9896-48c3-ab31-e321cea6ed93 service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] No waiting events found dispatching network-vif-unplugged-e3f15714-c9a3-44e4-832a-953cf2dbed61 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.compute.manager [req-dd804204-dd84-4824-9c69-a104f6ef83ac req-a2f58158-9896-48c3-ab31-e321cea6ed93 service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Received event network-vif-unplugged-e3f15714-c9a3-44e4-832a-953cf2dbed61 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5416073-04df-4da3-bb53-fd8d98f3a52f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:04:22 user nova-compute[74039]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)
Oct 20 09:04:22 user nova-compute[74039]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 (non-flash)
Oct 20 09:04:22 user nova-compute[74039]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:04:22 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:04:22 user nova-compute[74039]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 (non-flash)
Oct 20 09:04:22 user nova-compute[74039]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 (non-flash)
Oct 20 09:04:22 user nova-compute[74039]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:04:22 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae8445f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19'): ({'sdc'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Removing single pathed devices sdc {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-456868217',display_name='tempest-ServerActionsTestOtherA-server-456868217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-456868217',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyyJ62onAPVNIcWwPgu8Qk09h8heuIgT4K5VQCSSgQo1m6HsMw9upnfKrs0KtZmErwiBvOSQvzot9EsqbPyLMmcaHuqRr6HWOREqecRp8rh7oJxELHXOR3Is97nl7PEUA==',key_name='tempest-keypair-612179765',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:02:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='88a58985dce3491d8e45e6e468e0e549',ramdisk_id='',reservation_id='r-ed0qaebc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1138208404',owner_user_name='tempest-ServerActionsTestOtherA-1138208404-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb823f0374a04657be729eb153160659',uuid=00e09d93-3077-4770-abfd-b82ece646997,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-945485380-network", "vif_mac": "fa:16:3e:d7:28:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converting VIF {"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-945485380-network", "vif_mac": "fa:16:3e:d7:28:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:28:6b,bridge_name='br-int',has_traffic_filtering=True,id=d5f62963-3776-4468-b582-f2d31bf6a2be,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f62963-37') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:04:22 user nova-compute[74039]:   <uuid>00e09d93-3077-4770-abfd-b82ece646997</uuid>
Oct 20 09:04:22 user nova-compute[74039]:   <name>instance-00000017</name>
Oct 20 09:04:22 user nova-compute[74039]:   <memory>2097152</memory>
Oct 20 09:04:22 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:04:22 user nova-compute[74039]:   <metadata>
Oct 20 09:04:22 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:04:22 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:04:22 user nova-compute[74039]:       <nova:name>tempest-ServerActionsTestOtherA-server-456868217</nova:name>
Oct 20 09:04:22 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:04:19</nova:creationTime>
Oct 20 09:04:22 user nova-compute[74039]:       <nova:flavor name="m1.small">
Oct 20 09:04:22 user nova-compute[74039]:         <nova:memory>2048</nova:memory>
Oct 20 09:04:22 user nova-compute[74039]:         <nova:disk>20</nova:disk>
Oct 20 09:04:22 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:04:22 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:04:22 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:04:22 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:04:22 user nova-compute[74039]:       <nova:owner>
Oct 20 09:04:22 user nova-compute[74039]:         <nova:user uuid="cb823f0374a04657be729eb153160659">tempest-ServerActionsTestOtherA-1138208404-project-member</nova:user>
Oct 20 09:04:22 user nova-compute[74039]:         <nova:project uuid="88a58985dce3491d8e45e6e468e0e549">tempest-ServerActionsTestOtherA-1138208404</nova:project>
Oct 20 09:04:22 user nova-compute[74039]:       </nova:owner>
Oct 20 09:04:22 user nova-compute[74039]:       <nova:ports>
Oct 20 09:04:22 user nova-compute[74039]:         <nova:port uuid="d5f62963-3776-4468-b582-f2d31bf6a2be">
Oct 20 09:04:22 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 09:04:22 user nova-compute[74039]:         </nova:port>
Oct 20 09:04:22 user nova-compute[74039]:       </nova:ports>
Oct 20 09:04:22 user nova-compute[74039]:     </nova:instance>
Oct 20 09:04:22 user nova-compute[74039]:   </metadata>
Oct 20 09:04:22 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:04:22 user nova-compute[74039]:     <system>
Oct 20 09:04:22 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:04:22 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:04:22 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:04:22 user nova-compute[74039]:       <entry name="serial">00e09d93-3077-4770-abfd-b82ece646997</entry>
Oct 20 09:04:22 user nova-compute[74039]:       <entry name="uuid">00e09d93-3077-4770-abfd-b82ece646997</entry>
Oct 20 09:04:22 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:04:22 user nova-compute[74039]:     </system>
Oct 20 09:04:22 user nova-compute[74039]:   </sysinfo>
Oct 20 09:04:22 user nova-compute[74039]:   <os>
Oct 20 09:04:22 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:04:22 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:04:22 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:04:22 user nova-compute[74039]:   </os>
Oct 20 09:04:22 user nova-compute[74039]:   <features>
Oct 20 09:04:22 user nova-compute[74039]:     <acpi/>
Oct 20 09:04:22 user nova-compute[74039]:     <apic/>
Oct 20 09:04:22 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:04:22 user nova-compute[74039]:   </features>
Oct 20 09:04:22 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:04:22 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:04:22 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:04:22 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:04:22 user nova-compute[74039]:   </clock>
Oct 20 09:04:22 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:04:22 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:04:22 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:04:22 user nova-compute[74039]:   </cpu>
Oct 20 09:04:22 user nova-compute[74039]:   <devices>
Oct 20 09:04:22 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 09:04:22 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:04:22 user nova-compute[74039]:       <source dev="/dev/sdd"/>
Oct 20 09:04:22 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:04:22 user nova-compute[74039]:       <serial>761590b5-010a-47bc-9316-294b487cf5c1</serial>
Oct 20 09:04:22 user nova-compute[74039]:     </disk>
Oct 20 09:04:22 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:04:22 user nova-compute[74039]:       <mac address="fa:16:3e:d7:28:6b"/>
Oct 20 09:04:22 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:04:22 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:04:22 user nova-compute[74039]:       <target dev="tapd5f62963-37"/>
Oct 20 09:04:22 user nova-compute[74039]:     </interface>
Oct 20 09:04:22 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:04:22 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/00e09d93-3077-4770-abfd-b82ece646997/console.log" append="off"/>
Oct 20 09:04:22 user nova-compute[74039]:     </serial>
Oct 20 09:04:22 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:04:22 user nova-compute[74039]:     <video>
Oct 20 09:04:22 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:04:22 user nova-compute[74039]:     </video>
Oct 20 09:04:22 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:04:22 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:04:22 user nova-compute[74039]:     </rng>
Oct 20 09:04:22 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:04:22 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:04:22 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:04:22 user nova-compute[74039]:     </memballoon>
Oct 20 09:04:22 user nova-compute[74039]:   </devices>
Oct 20 09:04:22 user nova-compute[74039]: </domain>
Oct 20 09:04:22 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-456868217',display_name='tempest-ServerActionsTestOtherA-server-456868217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-456868217',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyyJ62onAPVNIcWwPgu8Qk09h8heuIgT4K5VQCSSgQo1m6HsMw9upnfKrs0KtZmErwiBvOSQvzot9EsqbPyLMmcaHuqRr6HWOREqecRp8rh7oJxELHXOR3Is97nl7PEUA==',key_name='tempest-keypair-612179765',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:02:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='88a58985dce3491d8e45e6e468e0e549',ramdisk_id='',reservation_id='r-ed0qaebc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1138208404',owner_user_name='tempest-ServerActionsTestOtherA-1138208404-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb823f0374a04657be729eb153160659',uuid=00e09d93-3077-4770-abfd-b82ece646997,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-945485380-network", "vif_mac": "fa:16:3e:d7:28:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converting VIF {"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-945485380-network", "vif_mac": "fa:16:3e:d7:28:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:28:6b,bridge_name='br-int',has_traffic_filtering=True,id=d5f62963-3776-4468-b582-f2d31bf6a2be,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f62963-37') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_vif [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:28:6b,bridge_name='br-int',has_traffic_filtering=True,id=d5f62963-3776-4468-b582-f2d31bf6a2be,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f62963-37') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f012767-f693-4879-a32e-265040f73831]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '899230dd-2c5b-5384-a04d-a24f330f6656', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5f62963-37, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5f62963-37, col_values=(('qos', UUID('db9332d1-fe6e-455e-a036-3d9bcaa1e208')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5f62963-37, col_values=(('external_ids', {'iface-id': 'd5f62963-3776-4468-b582-f2d31bf6a2be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:28:6b', 'vm-uuid': '00e09d93-3077-4770-abfd-b82ece646997'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[22aa2f40-aced-4049-93c9-609fb0c6c6ef]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Flushing IO for device /dev/sdc {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:22 user nova-compute[74039]: INFO os_vif [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:28:6b,bridge_name='br-int',has_traffic_filtering=True,id=d5f62963-3776-4468-b582-f2d31bf6a2be,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f62963-37')
Oct 20 09:04:22 user nova-compute[74039]: INFO nova.compute.manager [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.030s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbda42b4-08e4-407c-9807-ecbb83323a45]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89e345b-9d95-426a-ae0e-8f71861a2b8d]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] No VIF found with MAC fa:16:3e:d7:28:6b, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19e9e42-60fb-434a-9204-fb6d6d0547e7]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2ae057-5799-4f8c-bceb-48a8d77634f5]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19, portal: 172.16.0.220,3260]
Oct 20 09:04:22 user nova-compute[74039]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19, portal: 172.16.0.220,3260] successful.
Oct 20 09:04:22 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:699aa8be-48fd-4ce8-91df-ab9801667d19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a42d82-7a4f-467d-9623-8f1d67f9f663]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] <== disconnect_volume: return (2965ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:04:22 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Deleting instance files /opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca_del
Oct 20 09:04:22 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Deletion of /opt/stack/data/nova/instances/def7ee9b-e0ed-4c95-961c-c6d79144f0ca_del complete
Oct 20 09:04:22 user nova-compute[74039]: INFO nova.compute.manager [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Took 4.00 seconds to destroy the instance on the hypervisor.
Oct 20 09:04:22 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "f470b048-6069-425e-b3f9-65d538674321" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "f470b048-6069-425e-b3f9-65d538674321" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:23 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Took 1.13 seconds to deallocate network for instance.
Oct 20 09:04:23 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:04:23 user nova-compute[74039]: INFO nova.compute.claims [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Claim successful on node user
Oct 20 09:04:23 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Took 1.53 seconds to deallocate network for instance.
Oct 20 09:04:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-d8156f1d-dd5f-45e7-9272-8efa3bf2f4ec req-5d3d29fc-7bfc-4b6b-9eee-f00c1b0377fc service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received event network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d8156f1d-dd5f-45e7-9272-8efa3bf2f4ec req-5d3d29fc-7bfc-4b6b-9eee-f00c1b0377fc service nova] Acquiring lock "00e09d93-3077-4770-abfd-b82ece646997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d8156f1d-dd5f-45e7-9272-8efa3bf2f4ec req-5d3d29fc-7bfc-4b6b-9eee-f00c1b0377fc service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d8156f1d-dd5f-45e7-9272-8efa3bf2f4ec req-5d3d29fc-7bfc-4b6b-9eee-f00c1b0377fc service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-d8156f1d-dd5f-45e7-9272-8efa3bf2f4ec req-5d3d29fc-7bfc-4b6b-9eee-f00c1b0377fc service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] No waiting events found dispatching network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:04:23 user nova-compute[74039]: WARNING nova.compute.manager [req-d8156f1d-dd5f-45e7-9272-8efa3bf2f4ec req-5d3d29fc-7bfc-4b6b-9eee-f00c1b0377fc service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received unexpected event network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be for instance with vm_state active and task_state resize_finish.
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Updating instance_info_cache with network_info: [{"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-ebaa4804-32e5-4fff-9562-0587ff7ca4ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.compute.manager [req-a549d40e-6926-4b71-aae4-f5172873e255 req-62378b8d-5ec2-4feb-8cda-51d9335c2493 service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Received event network-vif-plugged-e3f15714-c9a3-44e4-832a-953cf2dbed61 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a549d40e-6926-4b71-aae4-f5172873e255 req-62378b8d-5ec2-4feb-8cda-51d9335c2493 service nova] Acquiring lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a549d40e-6926-4b71-aae4-f5172873e255 req-62378b8d-5ec2-4feb-8cda-51d9335c2493 service nova] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a549d40e-6926-4b71-aae4-f5172873e255 req-62378b8d-5ec2-4feb-8cda-51d9335c2493 service nova] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.compute.manager [req-a549d40e-6926-4b71-aae4-f5172873e255 req-62378b8d-5ec2-4feb-8cda-51d9335c2493 service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] No waiting events found dispatching network-vif-plugged-e3f15714-c9a3-44e4-832a-953cf2dbed61 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:04:24 user nova-compute[74039]: WARNING nova.compute.manager [req-a549d40e-6926-4b71-aae4-f5172873e255 req-62378b8d-5ec2-4feb-8cda-51d9335c2493 service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Received unexpected event network-vif-plugged-e3f15714-c9a3-44e4-832a-953cf2dbed61 for instance with vm_state deleted and task_state None.
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.compute.manager [req-a549d40e-6926-4b71-aae4-f5172873e255 req-62378b8d-5ec2-4feb-8cda-51d9335c2493 service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Received event network-vif-plugged-e3f15714-c9a3-44e4-832a-953cf2dbed61 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a549d40e-6926-4b71-aae4-f5172873e255 req-62378b8d-5ec2-4feb-8cda-51d9335c2493 service nova] Acquiring lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a549d40e-6926-4b71-aae4-f5172873e255 req-62378b8d-5ec2-4feb-8cda-51d9335c2493 service nova] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a549d40e-6926-4b71-aae4-f5172873e255 req-62378b8d-5ec2-4feb-8cda-51d9335c2493 service nova] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.compute.manager [req-a549d40e-6926-4b71-aae4-f5172873e255 req-62378b8d-5ec2-4feb-8cda-51d9335c2493 service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] No waiting events found dispatching network-vif-plugged-e3f15714-c9a3-44e4-832a-953cf2dbed61 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:04:24 user nova-compute[74039]: WARNING nova.compute.manager [req-a549d40e-6926-4b71-aae4-f5172873e255 req-62378b8d-5ec2-4feb-8cda-51d9335c2493 service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Received unexpected event network-vif-plugged-e3f15714-c9a3-44e4-832a-953cf2dbed61 for instance with vm_state deleted and task_state None.
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.compute.manager [req-a549d40e-6926-4b71-aae4-f5172873e255 req-62378b8d-5ec2-4feb-8cda-51d9335c2493 service nova] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Received event network-vif-deleted-841a8134-5b00-46f0-9e3a-604831e8ef1f {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.compute.manager [req-a549d40e-6926-4b71-aae4-f5172873e255 req-62378b8d-5ec2-4feb-8cda-51d9335c2493 service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Received event network-vif-plugged-e3f15714-c9a3-44e4-832a-953cf2dbed61 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a549d40e-6926-4b71-aae4-f5172873e255 req-62378b8d-5ec2-4feb-8cda-51d9335c2493 service nova] Acquiring lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a549d40e-6926-4b71-aae4-f5172873e255 req-62378b8d-5ec2-4feb-8cda-51d9335c2493 service nova] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a549d40e-6926-4b71-aae4-f5172873e255 req-62378b8d-5ec2-4feb-8cda-51d9335c2493 service nova] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.compute.manager [req-a549d40e-6926-4b71-aae4-f5172873e255 req-62378b8d-5ec2-4feb-8cda-51d9335c2493 service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] No waiting events found dispatching network-vif-plugged-e3f15714-c9a3-44e4-832a-953cf2dbed61 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:04:24 user nova-compute[74039]: WARNING nova.compute.manager [req-a549d40e-6926-4b71-aae4-f5172873e255 req-62378b8d-5ec2-4feb-8cda-51d9335c2493 service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Received unexpected event network-vif-plugged-e3f15714-c9a3-44e4-832a-953cf2dbed61 for instance with vm_state deleted and task_state None.
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.compute.manager [req-a549d40e-6926-4b71-aae4-f5172873e255 req-62378b8d-5ec2-4feb-8cda-51d9335c2493 service nova] [instance: 8af05cc2-c1b2-4187-b16e-5fbeb006de6a] Received event network-vif-deleted-e3f15714-c9a3-44e4-832a-953cf2dbed61 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.493s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.network.neutron [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:04:24 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.policy [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6faf5f2e03204805a06ac9f83b9a61bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143bda69e4714560b4b2286adaefb4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:04:24 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Creating image(s)
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "/opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "/opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "/opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:24 user nova-compute[74039]: INFO nova.compute.manager [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] [instance: def7ee9b-e0ed-4c95-961c-c6d79144f0ca] Took 0.93 seconds to detach 1 volumes for instance.
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.344s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.661s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.287s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.network.neutron [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Successfully created port: fe70147e-8713-4dd0-8d30-16aca37e8433 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.219s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk 1073741824" returned: 0 in 0.055s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:25 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Deleted allocations for instance 8af05cc2-c1b2-4187-b16e-5fbeb006de6a
Oct 20 09:04:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-23c106dd-620f-4ceb-b7fd-845ef4a27d4b tempest-AttachVolumeTestJSON-1630150217 tempest-AttachVolumeTestJSON-1630150217-project-member] Lock "8af05cc2-c1b2-4187-b16e-5fbeb006de6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.110s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.182s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Cannot resize image /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Ensure instance console log exists: /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.669s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.network.neutron [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Successfully updated port: fe70147e-8713-4dd0-8d30-16aca37e8433 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:04:25 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Deleted allocations for instance def7ee9b-e0ed-4c95-961c-c6d79144f0ca
Oct 20 09:04:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "refresh_cache-f470b048-6069-425e-b3f9-65d538674321" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquired lock "refresh_cache-f470b048-6069-425e-b3f9-65d538674321" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.network.neutron [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.network.neutron [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-09e3e9f6-eb74-4916-8564-e8c38281c2d0 tempest-DeleteServersTestJSON-1719064105 tempest-DeleteServersTestJSON-1719064105-project-member] Lock "def7ee9b-e0ed-4c95-961c-c6d79144f0ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.220s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.network.neutron [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Updating instance_info_cache with network_info: [{"id": "fe70147e-8713-4dd0-8d30-16aca37e8433", "address": "fa:16:3e:b0:e1:65", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe70147e-87", "ovs_interfaceid": "fe70147e-8713-4dd0-8d30-16aca37e8433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Releasing lock "refresh_cache-f470b048-6069-425e-b3f9-65d538674321" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.compute.manager [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Instance network_info: |[{"id": "fe70147e-8713-4dd0-8d30-16aca37e8433", "address": "fa:16:3e:b0:e1:65", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe70147e-87", "ovs_interfaceid": "fe70147e-8713-4dd0-8d30-16aca37e8433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Start _get_guest_xml network_info=[{"id": "fe70147e-8713-4dd0-8d30-16aca37e8433", "address": "fa:16:3e:b0:e1:65", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe70147e-87", "ovs_interfaceid": "fe70147e-8713-4dd0-8d30-16aca37e8433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:04:25 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:04:25 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:04:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1661466613',display_name='tempest-AttachVolumeNegativeTest-server-1661466613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1661466613',id=27,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLc96UAm+lpzBqu0WjmmwSlT9z4wDjfPJP4twE3G9tgGiAvfl5e1qV7SQzKSp+CRld3sQEmV1fPHHIAuWi6XwfDWX/s2mstm3RlsnMuiR1+BbtAgln8aTGSH5uDtzVEcGg==',key_name='tempest-keypair-676320587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='143bda69e4714560b4b2286adaefb4c5',ramdisk_id='',reservation_id='r-4covyjmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-639731200',owner_user_name='tempest-AttachVolumeNegativeTest-639731200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6faf5f2e03204805a06ac9f83b9a61bb',uuid=f470b048-6069-425e-b3f9-65d538674321,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe70147e-8713-4dd0-8d30-16aca37e8433", "address": "fa:16:3e:b0:e1:65", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe70147e-87", "ovs_interfaceid": "fe70147e-8713-4dd0-8d30-16aca37e8433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converting VIF {"id": "fe70147e-8713-4dd0-8d30-16aca37e8433", "address": "fa:16:3e:b0:e1:65", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe70147e-87", "ovs_interfaceid": "fe70147e-8713-4dd0-8d30-16aca37e8433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e1:65,bridge_name='br-int',has_traffic_filtering=True,id=fe70147e-8713-4dd0-8d30-16aca37e8433,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe70147e-87') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG nova.objects.instance [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lazy-loading 'pci_devices' on Instance uuid f470b048-6069-425e-b3f9-65d538674321 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-6d1eeb86-f5c5-4503-8aeb-4ef0d7ab89a2 req-2db52889-a645-4965-835b-f76cf0d05750 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received event network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6d1eeb86-f5c5-4503-8aeb-4ef0d7ab89a2 req-2db52889-a645-4965-835b-f76cf0d05750 service nova] Acquiring lock "00e09d93-3077-4770-abfd-b82ece646997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6d1eeb86-f5c5-4503-8aeb-4ef0d7ab89a2 req-2db52889-a645-4965-835b-f76cf0d05750 service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6d1eeb86-f5c5-4503-8aeb-4ef0d7ab89a2 req-2db52889-a645-4965-835b-f76cf0d05750 service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-6d1eeb86-f5c5-4503-8aeb-4ef0d7ab89a2 req-2db52889-a645-4965-835b-f76cf0d05750 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] No waiting events found dispatching network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:04:26 user nova-compute[74039]: WARNING nova.compute.manager [req-6d1eeb86-f5c5-4503-8aeb-4ef0d7ab89a2 req-2db52889-a645-4965-835b-f76cf0d05750 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received unexpected event network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be for instance with vm_state active and task_state resize_finish.
Oct 20 09:04:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:04:26 user nova-compute[74039]:   <uuid>f470b048-6069-425e-b3f9-65d538674321</uuid>
Oct 20 09:04:26 user nova-compute[74039]:   <name>instance-0000001b</name>
Oct 20 09:04:26 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:04:26 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:04:26 user nova-compute[74039]:   <metadata>
Oct 20 09:04:26 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:04:26 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:04:26 user nova-compute[74039]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1661466613</nova:name>
Oct 20 09:04:26 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:04:25</nova:creationTime>
Oct 20 09:04:26 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:04:26 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:04:26 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:04:26 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:04:26 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:04:26 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:04:26 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:04:26 user nova-compute[74039]:       <nova:owner>
Oct 20 09:04:26 user nova-compute[74039]:         <nova:user uuid="6faf5f2e03204805a06ac9f83b9a61bb">tempest-AttachVolumeNegativeTest-639731200-project-member</nova:user>
Oct 20 09:04:26 user nova-compute[74039]:         <nova:project uuid="143bda69e4714560b4b2286adaefb4c5">tempest-AttachVolumeNegativeTest-639731200</nova:project>
Oct 20 09:04:26 user nova-compute[74039]:       </nova:owner>
Oct 20 09:04:26 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:04:26 user nova-compute[74039]:       <nova:ports>
Oct 20 09:04:26 user nova-compute[74039]:         <nova:port uuid="fe70147e-8713-4dd0-8d30-16aca37e8433">
Oct 20 09:04:26 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 09:04:26 user nova-compute[74039]:         </nova:port>
Oct 20 09:04:26 user nova-compute[74039]:       </nova:ports>
Oct 20 09:04:26 user nova-compute[74039]:     </nova:instance>
Oct 20 09:04:26 user nova-compute[74039]:   </metadata>
Oct 20 09:04:26 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:04:26 user nova-compute[74039]:     <system>
Oct 20 09:04:26 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:04:26 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:04:26 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:04:26 user nova-compute[74039]:       <entry name="serial">f470b048-6069-425e-b3f9-65d538674321</entry>
Oct 20 09:04:26 user nova-compute[74039]:       <entry name="uuid">f470b048-6069-425e-b3f9-65d538674321</entry>
Oct 20 09:04:26 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:04:26 user nova-compute[74039]:     </system>
Oct 20 09:04:26 user nova-compute[74039]:   </sysinfo>
Oct 20 09:04:26 user nova-compute[74039]:   <os>
Oct 20 09:04:26 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:04:26 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:04:26 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:04:26 user nova-compute[74039]:   </os>
Oct 20 09:04:26 user nova-compute[74039]:   <features>
Oct 20 09:04:26 user nova-compute[74039]:     <acpi/>
Oct 20 09:04:26 user nova-compute[74039]:     <apic/>
Oct 20 09:04:26 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:04:26 user nova-compute[74039]:   </features>
Oct 20 09:04:26 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:04:26 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:04:26 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:04:26 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:04:26 user nova-compute[74039]:   </clock>
Oct 20 09:04:26 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:04:26 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:04:26 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:04:26 user nova-compute[74039]:   </cpu>
Oct 20 09:04:26 user nova-compute[74039]:   <devices>
Oct 20 09:04:26 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:04:26 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:04:26 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk"/>
Oct 20 09:04:26 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:04:26 user nova-compute[74039]:     </disk>
Oct 20 09:04:26 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:04:26 user nova-compute[74039]:       <mac address="fa:16:3e:b0:e1:65"/>
Oct 20 09:04:26 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:04:26 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:04:26 user nova-compute[74039]:       <target dev="tapfe70147e-87"/>
Oct 20 09:04:26 user nova-compute[74039]:     </interface>
Oct 20 09:04:26 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:04:26 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/console.log" append="off"/>
Oct 20 09:04:26 user nova-compute[74039]:     </serial>
Oct 20 09:04:26 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:04:26 user nova-compute[74039]:     <video>
Oct 20 09:04:26 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:04:26 user nova-compute[74039]:     </video>
Oct 20 09:04:26 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:04:26 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:04:26 user nova-compute[74039]:     </rng>
Oct 20 09:04:26 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:04:26 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:04:26 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:04:26 user nova-compute[74039]:     </memballoon>
Oct 20 09:04:26 user nova-compute[74039]:   </devices>
Oct 20 09:04:26 user nova-compute[74039]: </domain>
Oct 20 09:04:26 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1661466613',display_name='tempest-AttachVolumeNegativeTest-server-1661466613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1661466613',id=27,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLc96UAm+lpzBqu0WjmmwSlT9z4wDjfPJP4twE3G9tgGiAvfl5e1qV7SQzKSp+CRld3sQEmV1fPHHIAuWi6XwfDWX/s2mstm3RlsnMuiR1+BbtAgln8aTGSH5uDtzVEcGg==',key_name='tempest-keypair-676320587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='143bda69e4714560b4b2286adaefb4c5',ramdisk_id='',reservation_id='r-4covyjmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-639731200',owner_user_name='tempest-AttachVolumeNegativeTest-639731200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6faf5f2e03204805a06ac9f83b9a61bb',uuid=f470b048-6069-425e-b3f9-65d538674321,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe70147e-8713-4dd0-8d30-16aca37e8433", "address": "fa:16:3e:b0:e1:65", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe70147e-87", "ovs_interfaceid": "fe70147e-8713-4dd0-8d30-16aca37e8433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converting VIF {"id": "fe70147e-8713-4dd0-8d30-16aca37e8433", "address": "fa:16:3e:b0:e1:65", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe70147e-87", "ovs_interfaceid": "fe70147e-8713-4dd0-8d30-16aca37e8433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e1:65,bridge_name='br-int',has_traffic_filtering=True,id=fe70147e-8713-4dd0-8d30-16aca37e8433,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe70147e-87') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG os_vif [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e1:65,bridge_name='br-int',has_traffic_filtering=True,id=fe70147e-8713-4dd0-8d30-16aca37e8433,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe70147e-87') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69539728-35a0-55aa-af3b-16fec330e147', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:04:26 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Instance running successfully.
Oct 20 09:04:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe70147e-87, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe70147e-87, col_values=(('qos', UUID('4b9c0428-dfc5-4987-9f07-99acf565f20c')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe70147e-87, col_values=(('external_ids', {'iface-id': 'fe70147e-8713-4dd0-8d30-16aca37e8433', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:e1:65', 'vm-uuid': 'f470b048-6069-425e-b3f9-65d538674321'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Failed to set time: agent not configured {{(pid=74039) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-a8de9ef5-4d66-429f-95eb-52699bf3dbfd tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] finish_migration finished successfully. {{(pid=74039) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:26 user nova-compute[74039]: INFO os_vif [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e1:65,bridge_name='br-int',has_traffic_filtering=True,id=fe70147e-8713-4dd0-8d30-16aca37e8433,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe70147e-87')
Oct 20 09:04:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] No VIF found with MAC fa:16:3e:b0:e1:65, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-72b25ad3-e0cb-4215-93ef-9da444d2fc84 req-8aa6ca45-79db-4077-8465-e7a6aae57a1c service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Received event network-changed-fe70147e-8713-4dd0-8d30-16aca37e8433 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-72b25ad3-e0cb-4215-93ef-9da444d2fc84 req-8aa6ca45-79db-4077-8465-e7a6aae57a1c service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Refreshing instance network info cache due to event network-changed-fe70147e-8713-4dd0-8d30-16aca37e8433. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-72b25ad3-e0cb-4215-93ef-9da444d2fc84 req-8aa6ca45-79db-4077-8465-e7a6aae57a1c service nova] Acquiring lock "refresh_cache-f470b048-6069-425e-b3f9-65d538674321" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-72b25ad3-e0cb-4215-93ef-9da444d2fc84 req-8aa6ca45-79db-4077-8465-e7a6aae57a1c service nova] Acquired lock "refresh_cache-f470b048-6069-425e-b3f9-65d538674321" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG nova.network.neutron [req-72b25ad3-e0cb-4215-93ef-9da444d2fc84 req-8aa6ca45-79db-4077-8465-e7a6aae57a1c service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Refreshing network info cache for port fe70147e-8713-4dd0-8d30-16aca37e8433 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG nova.network.neutron [req-72b25ad3-e0cb-4215-93ef-9da444d2fc84 req-8aa6ca45-79db-4077-8465-e7a6aae57a1c service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Updated VIF entry in instance network info cache for port fe70147e-8713-4dd0-8d30-16aca37e8433. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG nova.network.neutron [req-72b25ad3-e0cb-4215-93ef-9da444d2fc84 req-8aa6ca45-79db-4077-8465-e7a6aae57a1c service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Updating instance_info_cache with network_info: [{"id": "fe70147e-8713-4dd0-8d30-16aca37e8433", "address": "fa:16:3e:b0:e1:65", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe70147e-87", "ovs_interfaceid": "fe70147e-8713-4dd0-8d30-16aca37e8433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:04:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-72b25ad3-e0cb-4215-93ef-9da444d2fc84 req-8aa6ca45-79db-4077-8465-e7a6aae57a1c service nova] Releasing lock "refresh_cache-f470b048-6069-425e-b3f9-65d538674321" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:04:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:04:27 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Cleaning up deleted instances {{(pid=74039) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 09:04:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-e3f3b0fc-da64-4a17-9ad2-ef6a8fe0e230 req-b2529fe5-fd55-4bc9-8146-0d3d860984ab service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Received event network-vif-plugged-fe70147e-8713-4dd0-8d30-16aca37e8433 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e3f3b0fc-da64-4a17-9ad2-ef6a8fe0e230 req-b2529fe5-fd55-4bc9-8146-0d3d860984ab service nova] Acquiring lock "f470b048-6069-425e-b3f9-65d538674321-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e3f3b0fc-da64-4a17-9ad2-ef6a8fe0e230 req-b2529fe5-fd55-4bc9-8146-0d3d860984ab service nova] Lock "f470b048-6069-425e-b3f9-65d538674321-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e3f3b0fc-da64-4a17-9ad2-ef6a8fe0e230 req-b2529fe5-fd55-4bc9-8146-0d3d860984ab service nova] Lock "f470b048-6069-425e-b3f9-65d538674321-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-e3f3b0fc-da64-4a17-9ad2-ef6a8fe0e230 req-b2529fe5-fd55-4bc9-8146-0d3d860984ab service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] No waiting events found dispatching network-vif-plugged-fe70147e-8713-4dd0-8d30-16aca37e8433 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:04:27 user nova-compute[74039]: WARNING nova.compute.manager [req-e3f3b0fc-da64-4a17-9ad2-ef6a8fe0e230 req-b2529fe5-fd55-4bc9-8146-0d3d860984ab service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Received unexpected event network-vif-plugged-fe70147e-8713-4dd0-8d30-16aca37e8433 for instance with vm_state building and task_state spawning.
Oct 20 09:04:27 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] There are 0 instances to clean {{(pid=74039) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 09:04:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:28 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:04:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:04:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-849b5d18-c2e4-4237-b1de-25ad926811f7 req-84ba941c-a83c-489f-8737-8d4289263210 service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Received event network-vif-plugged-fe70147e-8713-4dd0-8d30-16aca37e8433 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-849b5d18-c2e4-4237-b1de-25ad926811f7 req-84ba941c-a83c-489f-8737-8d4289263210 service nova] Acquiring lock "f470b048-6069-425e-b3f9-65d538674321-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-849b5d18-c2e4-4237-b1de-25ad926811f7 req-84ba941c-a83c-489f-8737-8d4289263210 service nova] Lock "f470b048-6069-425e-b3f9-65d538674321-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-849b5d18-c2e4-4237-b1de-25ad926811f7 req-84ba941c-a83c-489f-8737-8d4289263210 service nova] Lock "f470b048-6069-425e-b3f9-65d538674321-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-849b5d18-c2e4-4237-b1de-25ad926811f7 req-84ba941c-a83c-489f-8737-8d4289263210 service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] No waiting events found dispatching network-vif-plugged-fe70147e-8713-4dd0-8d30-16aca37e8433 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:04:29 user nova-compute[74039]: WARNING nova.compute.manager [req-849b5d18-c2e4-4237-b1de-25ad926811f7 req-84ba941c-a83c-489f-8737-8d4289263210 service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Received unexpected event network-vif-plugged-fe70147e-8713-4dd0-8d30-16aca37e8433 for instance with vm_state building and task_state spawning.
Oct 20 09:04:29 user nova-compute[74039]: DEBUG nova.compute.manager [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:04:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:04:29 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: f470b048-6069-425e-b3f9-65d538674321] Instance spawned successfully.
Oct 20 09:04:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:04:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:04:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:04:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:04:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:04:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:04:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:04:29 user nova-compute[74039]: INFO nova.compute.manager [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Took 5.42 seconds to spawn the instance on the hypervisor.
Oct 20 09:04:29 user nova-compute[74039]: DEBUG nova.compute.manager [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:04:30 user nova-compute[74039]: INFO nova.compute.manager [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Took 6.37 seconds to build instance.
Oct 20 09:04:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-741f8144-1d4b-475a-9ee5-93c87e961350 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "f470b048-6069-425e-b3f9-65d538674321" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.608s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:32 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:04:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:32 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:04:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:04:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:04:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:04:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:36 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:04:36 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:04:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7751MB free_disk=25.586673736572266GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:04:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Applying migration context for instance 00e09d93-3077-4770-abfd-b82ece646997 as it has an incoming, in-progress migration 2b9c803f-f223-4920-ae16-5e8bcf7f1c91. Migration status is finished {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 09:04:36 user nova-compute[74039]: INFO nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Updating resource usage from migration 2b9c803f-f223-4920-ae16-5e8bcf7f1c91
Oct 20 09:04:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 9fe77a96-fcb5-4410-85cc-58d925548e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:04:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c8054dbd-c0ae-45d2-af95-dae7d05f8c69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:04:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:04:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4f5d98e3-c1f6-4617-8847-b975e2c23990 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:04:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance e14ecf11-28b6-421d-875f-0ce9a21999d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:04:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance ebaa4804-32e5-4fff-9562-0587ff7ca4ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:04:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Migration 2b9c803f-f223-4920-ae16-5e8bcf7f1c91 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 09:04:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 00e09d93-3077-4770-abfd-b82ece646997 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:04:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance f470b048-6069-425e-b3f9-65d538674321 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:04:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:04:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:04:36 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:04:36 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:04:37 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:04:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:37 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:04:37 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74039) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 09:04:39 user nova-compute[74039]: DEBUG nova.compute.manager [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:04:39 user nova-compute[74039]: INFO nova.compute.manager [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] instance snapshotting
Oct 20 09:04:39 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Beginning live snapshot process
Oct 20 09:04:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json -f qcow2 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json -f qcow2 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppryv7uhg/1c3d61d6820144c3be7966fe6702cd02.delta 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppryv7uhg/1c3d61d6820144c3be7966fe6702cd02.delta 1073741824" returned: 0 in 0.054s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:40 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 09:04:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 09:04:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] COPY block job progress, current cursor: 27394048 final cursor: 75563008 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 09:04:42 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 09:04:42 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 09:04:42 user nova-compute[74039]: DEBUG nova.privsep.utils [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74039) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 09:04:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppryv7uhg/1c3d61d6820144c3be7966fe6702cd02.delta /opt/stack/data/nova/instances/snapshots/tmppryv7uhg/1c3d61d6820144c3be7966fe6702cd02 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppryv7uhg/1c3d61d6820144c3be7966fe6702cd02.delta /opt/stack/data/nova/instances/snapshots/tmppryv7uhg/1c3d61d6820144c3be7966fe6702cd02" returned: 0 in 0.680s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:42 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Snapshot extracted, beginning image upload
Oct 20 09:04:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "eca753ae-f542-431d-bb70-197394e6c566" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "eca753ae-f542-431d-bb70-197394e6c566" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:45 user nova-compute[74039]: DEBUG nova.compute.manager [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:04:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:45 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:04:45 user nova-compute[74039]: INFO nova.compute.claims [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Claim successful on node user
Oct 20 09:04:45 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Snapshot image upload complete
Oct 20 09:04:45 user nova-compute[74039]: INFO nova.compute.manager [None req-e7c56002-d9b4-4508-8c43-2dd2bd38b981 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Took 6.31 seconds to snapshot the instance on the hypervisor.
Oct 20 09:04:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:46 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:04:46 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:04:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:46 user nova-compute[74039]: DEBUG nova.compute.manager [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:04:46 user nova-compute[74039]: DEBUG nova.compute.manager [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:04:46 user nova-compute[74039]: DEBUG nova.network.neutron [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:04:46 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:04:46 user nova-compute[74039]: DEBUG nova.compute.manager [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:04:46 user nova-compute[74039]: DEBUG nova.policy [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af6af67060414d48b96ee116b9e6dbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d044b69c56433ca011f220f8578407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:04:46 user nova-compute[74039]: DEBUG nova.compute.manager [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:04:46 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:04:46 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Creating image(s)
Oct 20 09:04:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "/opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "/opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "/opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "ce7ce80c2565c5592fc174ee604368fe1d34c604" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "ce7ce80c2565c5592fc174ee604368fe1d34c604" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce7ce80c2565c5592fc174ee604368fe1d34c604.part --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce7ce80c2565c5592fc174ee604368fe1d34c604.part --force-share --output=json" returned: 0 in 0.210s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:47 user nova-compute[74039]: DEBUG nova.virt.images [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] 7cdfd334-c521-4c85-8c40-c3028dfa0fda was qcow2, converting to raw {{(pid=74039) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 09:04:47 user nova-compute[74039]: DEBUG nova.privsep.utils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74039) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 09:04:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ce7ce80c2565c5592fc174ee604368fe1d34c604.part /opt/stack/data/nova/instances/_base/ce7ce80c2565c5592fc174ee604368fe1d34c604.converted {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ce7ce80c2565c5592fc174ee604368fe1d34c604.part /opt/stack/data/nova/instances/_base/ce7ce80c2565c5592fc174ee604368fe1d34c604.converted" returned: 0 in 0.385s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce7ce80c2565c5592fc174ee604368fe1d34c604.converted --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:47 user nova-compute[74039]: DEBUG nova.network.neutron [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Successfully created port: fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:04:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:47 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:04:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce7ce80c2565c5592fc174ee604368fe1d34c604.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "ce7ce80c2565c5592fc174ee604368fe1d34c604" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.246s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce7ce80c2565c5592fc174ee604368fe1d34c604 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:04:48 user nova-compute[74039]: INFO nova.compute.claims [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Claim successful on node user
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce7ce80c2565c5592fc174ee604368fe1d34c604 --force-share --output=json" returned: 0 in 0.196s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "ce7ce80c2565c5592fc174ee604368fe1d34c604" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "ce7ce80c2565c5592fc174ee604368fe1d34c604" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce7ce80c2565c5592fc174ee604368fe1d34c604 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce7ce80c2565c5592fc174ee604368fe1d34c604 --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce7ce80c2565c5592fc174ee604368fe1d34c604,backing_fmt=raw /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce7ce80c2565c5592fc174ee604368fe1d34c604,backing_fmt=raw /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk 1073741824" returned: 0 in 0.052s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "ce7ce80c2565c5592fc174ee604368fe1d34c604" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce7ce80c2565c5592fc174ee604368fe1d34c604 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.network.neutron [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Successfully updated port: fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquired lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.network.neutron [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.compute.manager [req-0c6137c3-1959-49f8-8670-886ed431b937 req-ddc4c165-e017-424e-b99f-5b3e8e02834c service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received event network-changed-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.compute.manager [req-0c6137c3-1959-49f8-8670-886ed431b937 req-ddc4c165-e017-424e-b99f-5b3e8e02834c service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Refreshing instance network info cache due to event network-changed-fea0e0ca-2480-435a-b0de-0381ebf787e7. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0c6137c3-1959-49f8-8670-886ed431b937 req-ddc4c165-e017-424e-b99f-5b3e8e02834c service nova] Acquiring lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce7ce80c2565c5592fc174ee604368fe1d34c604 --force-share --output=json" returned: 0 in 0.208s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.network.neutron [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.776s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Cannot resize image /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Ensure instance console log exists: /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:04:48 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.policy [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '521e273869c2472195ea7f956c47cfca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976dd013512742419a09db1bcd91c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.network.neutron [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Updating instance_info_cache with network_info: [{"id": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "address": "fa:16:3e:40:f2:06", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea0e0ca-24", "ovs_interfaceid": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Releasing lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Instance network_info: |[{"id": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "address": "fa:16:3e:40:f2:06", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea0e0ca-24", "ovs_interfaceid": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0c6137c3-1959-49f8-8670-886ed431b937 req-ddc4c165-e017-424e-b99f-5b3e8e02834c service nova] Acquired lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.network.neutron [req-0c6137c3-1959-49f8-8670-886ed431b937 req-ddc4c165-e017-424e-b99f-5b3e8e02834c service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Refreshing network info cache for port fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Start _get_guest_xml network_info=[{"id": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "address": "fa:16:3e:40:f2:06", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea0e0ca-24", "ovs_interfaceid": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T09:04:42Z,direct_url=<?>,disk_format='qcow2',id=7cdfd334-c521-4c85-8c40-c3028dfa0fda,min_disk=0,min_ram=0,name='tempest-scenario-img--206901283',owner='d9d044b69c56433ca011f220f8578407',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T09:04:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': '7cdfd334-c521-4c85-8c40-c3028dfa0fda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:04:48 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:04:48 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:04:48 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Creating image(s)
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "/opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "/opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "/opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "6af971ea22dad70845cd1059f4bdf374647efdd7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "6af971ea22dad70845cd1059f4bdf374647efdd7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:04:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T09:04:42Z,direct_url=<?>,disk_format='qcow2',id=7cdfd334-c521-4c85-8c40-c3028dfa0fda,min_disk=0,min_ram=0,name='tempest-scenario-img--206901283',owner='d9d044b69c56433ca011f220f8578407',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T09:04:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1306062082',display_name='tempest-TestMinimumBasicScenario-server-1306062082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1306062082',id=28,image_ref='7cdfd334-c521-4c85-8c40-c3028dfa0fda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6OQrU6pZWixXAqtelPx1ZMTVSD0YEQXx9QVD1Qj9Mbp+ioNoFjbCbAW5cLdbKj6X/7XWn7NnKiwHscyMbHShiOzkNFZP4EoWAKJy88WSFI12WOamrK4nJYDchu4x69rQ==',key_name='tempest-TestMinimumBasicScenario-1024941050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9d044b69c56433ca011f220f8578407',ramdisk_id='',reservation_id='r-0rpof6tn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7cdfd334-c521-4c85-8c40-c3028dfa0fda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1802809099',owner_user_name='tempest-TestMinimumBasicScenario-1802809099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:04:46Z,user_data=None,user_id='af6af67060414d48b96ee116b9e6dbdb',uuid=eca753ae-f542-431d-bb70-197394e6c566,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "address": "fa:16:3e:40:f2:06", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea0e0ca-24", "ovs_interfaceid": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Converting VIF {"id": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "address": "fa:16:3e:40:f2:06", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea0e0ca-24", "ovs_interfaceid": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:f2:06,bridge_name='br-int',has_traffic_filtering=True,id=fea0e0ca-2480-435a-b0de-0381ebf787e7,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea0e0ca-24') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG nova.objects.instance [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lazy-loading 'pci_devices' on Instance uuid eca753ae-f542-431d-bb70-197394e6c566 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:04:49 user nova-compute[74039]:   <uuid>eca753ae-f542-431d-bb70-197394e6c566</uuid>
Oct 20 09:04:49 user nova-compute[74039]:   <name>instance-0000001c</name>
Oct 20 09:04:49 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:04:49 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:04:49 user nova-compute[74039]:   <metadata>
Oct 20 09:04:49 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:04:49 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:04:49 user nova-compute[74039]:       <nova:name>tempest-TestMinimumBasicScenario-server-1306062082</nova:name>
Oct 20 09:04:49 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:04:48</nova:creationTime>
Oct 20 09:04:49 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:04:49 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:04:49 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:04:49 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:04:49 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:04:49 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:04:49 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:04:49 user nova-compute[74039]:       <nova:owner>
Oct 20 09:04:49 user nova-compute[74039]:         <nova:user uuid="af6af67060414d48b96ee116b9e6dbdb">tempest-TestMinimumBasicScenario-1802809099-project-member</nova:user>
Oct 20 09:04:49 user nova-compute[74039]:         <nova:project uuid="d9d044b69c56433ca011f220f8578407">tempest-TestMinimumBasicScenario-1802809099</nova:project>
Oct 20 09:04:49 user nova-compute[74039]:       </nova:owner>
Oct 20 09:04:49 user nova-compute[74039]:       <nova:root type="image" uuid="7cdfd334-c521-4c85-8c40-c3028dfa0fda"/>
Oct 20 09:04:49 user nova-compute[74039]:       <nova:ports>
Oct 20 09:04:49 user nova-compute[74039]:         <nova:port uuid="fea0e0ca-2480-435a-b0de-0381ebf787e7">
Oct 20 09:04:49 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 09:04:49 user nova-compute[74039]:         </nova:port>
Oct 20 09:04:49 user nova-compute[74039]:       </nova:ports>
Oct 20 09:04:49 user nova-compute[74039]:     </nova:instance>
Oct 20 09:04:49 user nova-compute[74039]:   </metadata>
Oct 20 09:04:49 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:04:49 user nova-compute[74039]:     <system>
Oct 20 09:04:49 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:04:49 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:04:49 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:04:49 user nova-compute[74039]:       <entry name="serial">eca753ae-f542-431d-bb70-197394e6c566</entry>
Oct 20 09:04:49 user nova-compute[74039]:       <entry name="uuid">eca753ae-f542-431d-bb70-197394e6c566</entry>
Oct 20 09:04:49 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:04:49 user nova-compute[74039]:     </system>
Oct 20 09:04:49 user nova-compute[74039]:   </sysinfo>
Oct 20 09:04:49 user nova-compute[74039]:   <os>
Oct 20 09:04:49 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:04:49 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:04:49 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:04:49 user nova-compute[74039]:   </os>
Oct 20 09:04:49 user nova-compute[74039]:   <features>
Oct 20 09:04:49 user nova-compute[74039]:     <acpi/>
Oct 20 09:04:49 user nova-compute[74039]:     <apic/>
Oct 20 09:04:49 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:04:49 user nova-compute[74039]:   </features>
Oct 20 09:04:49 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:04:49 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:04:49 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:04:49 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:04:49 user nova-compute[74039]:   </clock>
Oct 20 09:04:49 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:04:49 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:04:49 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:04:49 user nova-compute[74039]:   </cpu>
Oct 20 09:04:49 user nova-compute[74039]:   <devices>
Oct 20 09:04:49 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:04:49 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:04:49 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk"/>
Oct 20 09:04:49 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:04:49 user nova-compute[74039]:     </disk>
Oct 20 09:04:49 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:04:49 user nova-compute[74039]:       <mac address="fa:16:3e:40:f2:06"/>
Oct 20 09:04:49 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:04:49 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:04:49 user nova-compute[74039]:       <target dev="tapfea0e0ca-24"/>
Oct 20 09:04:49 user nova-compute[74039]:     </interface>
Oct 20 09:04:49 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:04:49 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/console.log" append="off"/>
Oct 20 09:04:49 user nova-compute[74039]:     </serial>
Oct 20 09:04:49 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:04:49 user nova-compute[74039]:     <video>
Oct 20 09:04:49 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:04:49 user nova-compute[74039]:     </video>
Oct 20 09:04:49 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:04:49 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:04:49 user nova-compute[74039]:     </rng>
Oct 20 09:04:49 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:04:49 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:04:49 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:04:49 user nova-compute[74039]:     </memballoon>
Oct 20 09:04:49 user nova-compute[74039]:   </devices>
Oct 20 09:04:49 user nova-compute[74039]: </domain>
Oct 20 09:04:49 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1306062082',display_name='tempest-TestMinimumBasicScenario-server-1306062082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1306062082',id=28,image_ref='7cdfd334-c521-4c85-8c40-c3028dfa0fda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6OQrU6pZWixXAqtelPx1ZMTVSD0YEQXx9QVD1Qj9Mbp+ioNoFjbCbAW5cLdbKj6X/7XWn7NnKiwHscyMbHShiOzkNFZP4EoWAKJy88WSFI12WOamrK4nJYDchu4x69rQ==',key_name='tempest-TestMinimumBasicScenario-1024941050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9d044b69c56433ca011f220f8578407',ramdisk_id='',reservation_id='r-0rpof6tn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7cdfd334-c521-4c85-8c40-c3028dfa0fda',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1802809099',owner_user_name='tempest-TestMinimumBasicScenario-1802809099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:04:46Z,user_data=None,user_id='af6af67060414d48b96ee116b9e6dbdb',uuid=eca753ae-f542-431d-bb70-197394e6c566,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "address": "fa:16:3e:40:f2:06", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea0e0ca-24", "ovs_interfaceid": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Converting VIF {"id": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "address": "fa:16:3e:40:f2:06", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea0e0ca-24", "ovs_interfaceid": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:f2:06,bridge_name='br-int',has_traffic_filtering=True,id=fea0e0ca-2480-435a-b0de-0381ebf787e7,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea0e0ca-24') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG os_vif [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:f2:06,bridge_name='br-int',has_traffic_filtering=True,id=fea0e0ca-2480-435a-b0de-0381ebf787e7,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea0e0ca-24') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e8fb69e-1dd2-588d-a199-e3595bce51ce', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfea0e0ca-24, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfea0e0ca-24, col_values=(('qos', UUID('1a5b59be-3d91-436b-9931-7e50401e6381')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfea0e0ca-24, col_values=(('external_ids', {'iface-id': 'fea0e0ca-2480-435a-b0de-0381ebf787e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:f2:06', 'vm-uuid': 'eca753ae-f542-431d-bb70-197394e6c566'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:04:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6af971ea22dad70845cd1059f4bdf374647efdd7.part --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:50 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Successfully created port: a08cc444-8f39-47df-b452-7c1cb4c951ad {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:04:50 user nova-compute[74039]: INFO os_vif [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:f2:06,bridge_name='br-int',has_traffic_filtering=True,id=fea0e0ca-2480-435a-b0de-0381ebf787e7,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea0e0ca-24')
Oct 20 09:04:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:04:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] No VIF found with MAC fa:16:3e:40:f2:06, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:04:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6af971ea22dad70845cd1059f4bdf374647efdd7.part --force-share --output=json" returned: 0 in 0.200s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:50 user nova-compute[74039]: DEBUG nova.virt.images [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] 7912e61c-424f-4eb4-a2b4-857f01f6e43c was qcow2, converting to raw {{(pid=74039) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 09:04:50 user nova-compute[74039]: DEBUG nova.privsep.utils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74039) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 09:04:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6af971ea22dad70845cd1059f4bdf374647efdd7.part /opt/stack/data/nova/instances/_base/6af971ea22dad70845cd1059f4bdf374647efdd7.converted {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:50 user nova-compute[74039]: DEBUG nova.network.neutron [req-0c6137c3-1959-49f8-8670-886ed431b937 req-ddc4c165-e017-424e-b99f-5b3e8e02834c service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Updated VIF entry in instance network info cache for port fea0e0ca-2480-435a-b0de-0381ebf787e7. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:04:50 user nova-compute[74039]: DEBUG nova.network.neutron [req-0c6137c3-1959-49f8-8670-886ed431b937 req-ddc4c165-e017-424e-b99f-5b3e8e02834c service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Updating instance_info_cache with network_info: [{"id": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "address": "fa:16:3e:40:f2:06", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea0e0ca-24", "ovs_interfaceid": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:04:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0c6137c3-1959-49f8-8670-886ed431b937 req-ddc4c165-e017-424e-b99f-5b3e8e02834c service nova] Releasing lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:04:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6af971ea22dad70845cd1059f4bdf374647efdd7.part /opt/stack/data/nova/instances/_base/6af971ea22dad70845cd1059f4bdf374647efdd7.converted" returned: 0 in 0.486s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6af971ea22dad70845cd1059f4bdf374647efdd7.converted --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6af971ea22dad70845cd1059f4bdf374647efdd7.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "6af971ea22dad70845cd1059f4bdf374647efdd7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.062s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6af971ea22dad70845cd1059f4bdf374647efdd7 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Successfully updated port: a08cc444-8f39-47df-b452-7c1cb4c951ad {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-62a0acc3-3ea7-4c63-95dd-17a6e2c616b0 req-c41da592-3473-4fcf-b314-e39f5c433261 service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Received event network-changed-a08cc444-8f39-47df-b452-7c1cb4c951ad {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-62a0acc3-3ea7-4c63-95dd-17a6e2c616b0 req-c41da592-3473-4fcf-b314-e39f5c433261 service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Refreshing instance network info cache due to event network-changed-a08cc444-8f39-47df-b452-7c1cb4c951ad. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62a0acc3-3ea7-4c63-95dd-17a6e2c616b0 req-c41da592-3473-4fcf-b314-e39f5c433261 service nova] Acquiring lock "refresh_cache-f53c3766-e463-42b1-acd8-f27c3ba2b0ce" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62a0acc3-3ea7-4c63-95dd-17a6e2c616b0 req-c41da592-3473-4fcf-b314-e39f5c433261 service nova] Acquired lock "refresh_cache-f53c3766-e463-42b1-acd8-f27c3ba2b0ce" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG nova.network.neutron [req-62a0acc3-3ea7-4c63-95dd-17a6e2c616b0 req-c41da592-3473-4fcf-b314-e39f5c433261 service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Refreshing network info cache for port a08cc444-8f39-47df-b452-7c1cb4c951ad {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "refresh_cache-f53c3766-e463-42b1-acd8-f27c3ba2b0ce" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6af971ea22dad70845cd1059f4bdf374647efdd7 --force-share --output=json" returned: 0 in 0.188s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "6af971ea22dad70845cd1059f4bdf374647efdd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "6af971ea22dad70845cd1059f4bdf374647efdd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6af971ea22dad70845cd1059f4bdf374647efdd7 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6af971ea22dad70845cd1059f4bdf374647efdd7 --force-share --output=json" returned: 0 in 0.205s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6af971ea22dad70845cd1059f4bdf374647efdd7,backing_fmt=raw /opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6af971ea22dad70845cd1059f4bdf374647efdd7,backing_fmt=raw /opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce/disk 1073741824" returned: 0 in 0.054s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "6af971ea22dad70845cd1059f4bdf374647efdd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6af971ea22dad70845cd1059f4bdf374647efdd7 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG nova.network.neutron [req-62a0acc3-3ea7-4c63-95dd-17a6e2c616b0 req-c41da592-3473-4fcf-b314-e39f5c433261 service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6af971ea22dad70845cd1059f4bdf374647efdd7 --force-share --output=json" returned: 0 in 0.233s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Ensure instance console log exists: /opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG nova.network.neutron [req-62a0acc3-3ea7-4c63-95dd-17a6e2c616b0 req-c41da592-3473-4fcf-b314-e39f5c433261 service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-62a0acc3-3ea7-4c63-95dd-17a6e2c616b0 req-c41da592-3473-4fcf-b314-e39f5c433261 service nova] Releasing lock "refresh_cache-f53c3766-e463-42b1-acd8-f27c3ba2b0ce" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquired lock "refresh_cache-f53c3766-e463-42b1-acd8-f27c3ba2b0ce" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:04:51 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.compute.manager [req-ff92fc28-22af-4e09-90a1-80e3c40cbba5 req-a72687f4-9d6f-4efb-9067-cd504577f843 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received event network-vif-plugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ff92fc28-22af-4e09-90a1-80e3c40cbba5 req-a72687f4-9d6f-4efb-9067-cd504577f843 service nova] Acquiring lock "eca753ae-f542-431d-bb70-197394e6c566-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ff92fc28-22af-4e09-90a1-80e3c40cbba5 req-a72687f4-9d6f-4efb-9067-cd504577f843 service nova] Lock "eca753ae-f542-431d-bb70-197394e6c566-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ff92fc28-22af-4e09-90a1-80e3c40cbba5 req-a72687f4-9d6f-4efb-9067-cd504577f843 service nova] Lock "eca753ae-f542-431d-bb70-197394e6c566-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.compute.manager [req-ff92fc28-22af-4e09-90a1-80e3c40cbba5 req-a72687f4-9d6f-4efb-9067-cd504577f843 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] No waiting events found dispatching network-vif-plugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:04:52 user nova-compute[74039]: WARNING nova.compute.manager [req-ff92fc28-22af-4e09-90a1-80e3c40cbba5 req-a72687f4-9d6f-4efb-9067-cd504577f843 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received unexpected event network-vif-plugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 for instance with vm_state building and task_state spawning.
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Updating instance_info_cache with network_info: [{"id": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "address": "fa:16:3e:f8:a4:cd", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa08cc444-8f", "ovs_interfaceid": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Releasing lock "refresh_cache-f53c3766-e463-42b1-acd8-f27c3ba2b0ce" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Instance network_info: |[{"id": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "address": "fa:16:3e:f8:a4:cd", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa08cc444-8f", "ovs_interfaceid": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Start _get_guest_xml network_info=[{"id": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "address": "fa:16:3e:f8:a4:cd", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa08cc444-8f", "ovs_interfaceid": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='54dd7930311f457abde67e334f7b17b5',container_format='bare',created_at=2023-10-20T09:04:39Z,direct_url=<?>,disk_format='qcow2',id=7912e61c-424f-4eb4-a2b4-857f01f6e43c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-383741330',owner='976dd013512742419a09db1bcd91c33f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T09:04:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': '7912e61c-424f-4eb4-a2b4-857f01f6e43c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:04:52 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:04:52 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='54dd7930311f457abde67e334f7b17b5',container_format='bare',created_at=2023-10-20T09:04:39Z,direct_url=<?>,disk_format='qcow2',id=7912e61c-424f-4eb4-a2b4-857f01f6e43c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-383741330',owner='976dd013512742419a09db1bcd91c33f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T09:04:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2041071747',display_name='tempest-TestStampPattern-server-2041071747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2041071747',id=29,image_ref='7912e61c-424f-4eb4-a2b4-857f01f6e43c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCoYAYLQAIK0eZwZlLZsSngPmiUuCavbZvZuAXBNr5s5G9UwpQhAO/A9UrKL/K+8+IO1hH8/ytdfxCHYdYzvPmR2tPylGWVvOVVSYReebeMYYdncFm19RRSUV+eGOaikQ==',key_name='tempest-TestStampPattern-2133476221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='976dd013512742419a09db1bcd91c33f',ramdisk_id='',reservation_id='r-churu4p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4f5d98e3-c1f6-4617-8847-b975e2c23990',image_min_disk='1',image_min_ram='0',image_owner_id='976dd013512742419a09db1bcd91c33f',image_owner_project_name='tempest-TestStampPattern-1484113572',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1484113572-project-member',image_user_id='521e273869c2472195ea7f956c47cfca',network_allocated='True',owner_project_name='tempest-TestStampPattern-1484113572',owner_user_name='tempest-TestStampPattern-1484113572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:04:49Z,user_data=None,user_id='521e273869c2472195ea7f956c47cfca',uuid=f53c3766-e463-42b1-acd8-f27c3ba2b0ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "address": "fa:16:3e:f8:a4:cd", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa08cc444-8f", "ovs_interfaceid": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Converting VIF {"id": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "address": "fa:16:3e:f8:a4:cd", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa08cc444-8f", "ovs_interfaceid": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a4:cd,bridge_name='br-int',has_traffic_filtering=True,id=a08cc444-8f39-47df-b452-7c1cb4c951ad,network=Network(95c63035-cc80-442a-b660-301acdda2a79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa08cc444-8f') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.objects.instance [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lazy-loading 'pci_devices' on Instance uuid f53c3766-e463-42b1-acd8-f27c3ba2b0ce {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:04:52 user nova-compute[74039]:   <uuid>f53c3766-e463-42b1-acd8-f27c3ba2b0ce</uuid>
Oct 20 09:04:52 user nova-compute[74039]:   <name>instance-0000001d</name>
Oct 20 09:04:52 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:04:52 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:04:52 user nova-compute[74039]:   <metadata>
Oct 20 09:04:52 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:04:52 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:04:52 user nova-compute[74039]:       <nova:name>tempest-TestStampPattern-server-2041071747</nova:name>
Oct 20 09:04:52 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:04:52</nova:creationTime>
Oct 20 09:04:52 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:04:52 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:04:52 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:04:52 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:04:52 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:04:52 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:04:52 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:04:52 user nova-compute[74039]:       <nova:owner>
Oct 20 09:04:52 user nova-compute[74039]:         <nova:user uuid="521e273869c2472195ea7f956c47cfca">tempest-TestStampPattern-1484113572-project-member</nova:user>
Oct 20 09:04:52 user nova-compute[74039]:         <nova:project uuid="976dd013512742419a09db1bcd91c33f">tempest-TestStampPattern-1484113572</nova:project>
Oct 20 09:04:52 user nova-compute[74039]:       </nova:owner>
Oct 20 09:04:52 user nova-compute[74039]:       <nova:root type="image" uuid="7912e61c-424f-4eb4-a2b4-857f01f6e43c"/>
Oct 20 09:04:52 user nova-compute[74039]:       <nova:ports>
Oct 20 09:04:52 user nova-compute[74039]:         <nova:port uuid="a08cc444-8f39-47df-b452-7c1cb4c951ad">
Oct 20 09:04:52 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 09:04:52 user nova-compute[74039]:         </nova:port>
Oct 20 09:04:52 user nova-compute[74039]:       </nova:ports>
Oct 20 09:04:52 user nova-compute[74039]:     </nova:instance>
Oct 20 09:04:52 user nova-compute[74039]:   </metadata>
Oct 20 09:04:52 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:04:52 user nova-compute[74039]:     <system>
Oct 20 09:04:52 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:04:52 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:04:52 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:04:52 user nova-compute[74039]:       <entry name="serial">f53c3766-e463-42b1-acd8-f27c3ba2b0ce</entry>
Oct 20 09:04:52 user nova-compute[74039]:       <entry name="uuid">f53c3766-e463-42b1-acd8-f27c3ba2b0ce</entry>
Oct 20 09:04:52 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:04:52 user nova-compute[74039]:     </system>
Oct 20 09:04:52 user nova-compute[74039]:   </sysinfo>
Oct 20 09:04:52 user nova-compute[74039]:   <os>
Oct 20 09:04:52 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:04:52 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:04:52 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:04:52 user nova-compute[74039]:   </os>
Oct 20 09:04:52 user nova-compute[74039]:   <features>
Oct 20 09:04:52 user nova-compute[74039]:     <acpi/>
Oct 20 09:04:52 user nova-compute[74039]:     <apic/>
Oct 20 09:04:52 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:04:52 user nova-compute[74039]:   </features>
Oct 20 09:04:52 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:04:52 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:04:52 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:04:52 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:04:52 user nova-compute[74039]:   </clock>
Oct 20 09:04:52 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:04:52 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:04:52 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:04:52 user nova-compute[74039]:   </cpu>
Oct 20 09:04:52 user nova-compute[74039]:   <devices>
Oct 20 09:04:52 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:04:52 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:04:52 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce/disk"/>
Oct 20 09:04:52 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:04:52 user nova-compute[74039]:     </disk>
Oct 20 09:04:52 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:04:52 user nova-compute[74039]:       <mac address="fa:16:3e:f8:a4:cd"/>
Oct 20 09:04:52 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:04:52 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:04:52 user nova-compute[74039]:       <target dev="tapa08cc444-8f"/>
Oct 20 09:04:52 user nova-compute[74039]:     </interface>
Oct 20 09:04:52 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:04:52 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce/console.log" append="off"/>
Oct 20 09:04:52 user nova-compute[74039]:     </serial>
Oct 20 09:04:52 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:04:52 user nova-compute[74039]:     <video>
Oct 20 09:04:52 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:04:52 user nova-compute[74039]:     </video>
Oct 20 09:04:52 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:04:52 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:04:52 user nova-compute[74039]:     </rng>
Oct 20 09:04:52 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:04:52 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:04:52 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:04:52 user nova-compute[74039]:     </memballoon>
Oct 20 09:04:52 user nova-compute[74039]:   </devices>
Oct 20 09:04:52 user nova-compute[74039]: </domain>
Oct 20 09:04:52 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2041071747',display_name='tempest-TestStampPattern-server-2041071747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2041071747',id=29,image_ref='7912e61c-424f-4eb4-a2b4-857f01f6e43c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCoYAYLQAIK0eZwZlLZsSngPmiUuCavbZvZuAXBNr5s5G9UwpQhAO/A9UrKL/K+8+IO1hH8/ytdfxCHYdYzvPmR2tPylGWVvOVVSYReebeMYYdncFm19RRSUV+eGOaikQ==',key_name='tempest-TestStampPattern-2133476221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='976dd013512742419a09db1bcd91c33f',ramdisk_id='',reservation_id='r-churu4p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4f5d98e3-c1f6-4617-8847-b975e2c23990',image_min_disk='1',image_min_ram='0',image_owner_id='976dd013512742419a09db1bcd91c33f',image_owner_project_name='tempest-TestStampPattern-1484113572',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1484113572-project-member',image_user_id='521e273869c2472195ea7f956c47cfca',network_allocated='True',owner_project_name='tempest-TestStampPattern-1484113572',owner_user_name='tempest-TestStampPattern-1484113572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:04:49Z,user_data=None,user_id='521e273869c2472195ea7f956c47cfca',uuid=f53c3766-e463-42b1-acd8-f27c3ba2b0ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "address": "fa:16:3e:f8:a4:cd", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa08cc444-8f", "ovs_interfaceid": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Converting VIF {"id": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "address": "fa:16:3e:f8:a4:cd", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa08cc444-8f", "ovs_interfaceid": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a4:cd,bridge_name='br-int',has_traffic_filtering=True,id=a08cc444-8f39-47df-b452-7c1cb4c951ad,network=Network(95c63035-cc80-442a-b660-301acdda2a79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa08cc444-8f') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG os_vif [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a4:cd,bridge_name='br-int',has_traffic_filtering=True,id=a08cc444-8f39-47df-b452-7c1cb4c951ad,network=Network(95c63035-cc80-442a-b660-301acdda2a79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa08cc444-8f') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3dc99f90-e191-55a8-989a-55fb5874057b', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa08cc444-8f, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa08cc444-8f, col_values=(('qos', UUID('d89f8f19-6df2-49fd-b7e2-a16ddf957a91')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa08cc444-8f, col_values=(('external_ids', {'iface-id': 'a08cc444-8f39-47df-b452-7c1cb4c951ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:a4:cd', 'vm-uuid': 'f53c3766-e463-42b1-acd8-f27c3ba2b0ce'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:52 user nova-compute[74039]: INFO os_vif [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:a4:cd,bridge_name='br-int',has_traffic_filtering=True,id=a08cc444-8f39-47df-b452-7c1cb4c951ad,network=Network(95c63035-cc80-442a-b660-301acdda2a79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa08cc444-8f')
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:04:52 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] No VIF found with MAC fa:16:3e:f8:a4:cd, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:04:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:53 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:04:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:04:54 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: eca753ae-f542-431d-bb70-197394e6c566] Instance spawned successfully.
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-ded6c66b-3961-48f0-bfcd-5f8b1c130ce1 req-dc73cb61-645e-45e5-b6c6-ed17b354b536 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received event network-vif-plugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ded6c66b-3961-48f0-bfcd-5f8b1c130ce1 req-dc73cb61-645e-45e5-b6c6-ed17b354b536 service nova] Acquiring lock "eca753ae-f542-431d-bb70-197394e6c566-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ded6c66b-3961-48f0-bfcd-5f8b1c130ce1 req-dc73cb61-645e-45e5-b6c6-ed17b354b536 service nova] Lock "eca753ae-f542-431d-bb70-197394e6c566-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ded6c66b-3961-48f0-bfcd-5f8b1c130ce1 req-dc73cb61-645e-45e5-b6c6-ed17b354b536 service nova] Lock "eca753ae-f542-431d-bb70-197394e6c566-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-ded6c66b-3961-48f0-bfcd-5f8b1c130ce1 req-dc73cb61-645e-45e5-b6c6-ed17b354b536 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] No waiting events found dispatching network-vif-plugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:04:54 user nova-compute[74039]: WARNING nova.compute.manager [req-ded6c66b-3961-48f0-bfcd-5f8b1c130ce1 req-dc73cb61-645e-45e5-b6c6-ed17b354b536 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received unexpected event network-vif-plugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 for instance with vm_state building and task_state spawning.
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:04:54 user nova-compute[74039]: INFO nova.compute.manager [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Took 7.75 seconds to spawn the instance on the hypervisor.
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid 9fe77a96-fcb5-4410-85cc-58d925548e03 {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid c8054dbd-c0ae-45d2-af95-dae7d05f8c69 {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid ebaa4804-32e5-4fff-9562-0587ff7ca4ed {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid 4f5d98e3-c1f6-4617-8847-b975e2c23990 {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid 00e09d93-3077-4770-abfd-b82ece646997 {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid e14ecf11-28b6-421d-875f-0ce9a21999d3 {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid f470b048-6069-425e-b3f9-65d538674321 {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid eca753ae-f542-431d-bb70-197394e6c566 {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid f53c3766-e463-42b1-acd8-f27c3ba2b0ce {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "4f5d98e3-c1f6-4617-8847-b975e2c23990" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "00e09d93-3077-4770-abfd-b82ece646997" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "00e09d93-3077-4770-abfd-b82ece646997" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "e14ecf11-28b6-421d-875f-0ce9a21999d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "f470b048-6069-425e-b3f9-65d538674321" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "f470b048-6069-425e-b3f9-65d538674321" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "eca753ae-f542-431d-bb70-197394e6c566" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "f470b048-6069-425e-b3f9-65d538674321" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "00e09d93-3077-4770-abfd-b82ece646997" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:54 user nova-compute[74039]: INFO nova.compute.manager [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Took 8.87 seconds to build instance.
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-afe13c2f-ce10-41e7-a727-25a9ae3193b7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "eca753ae-f542-431d-bb70-197394e6c566" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.987s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "eca753ae-f542-431d-bb70-197394e6c566" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.148s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:54 user nova-compute[74039]: INFO nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: eca753ae-f542-431d-bb70-197394e6c566] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 20 09:04:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "eca753ae-f542-431d-bb70-197394e6c566" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:56 user nova-compute[74039]: DEBUG nova.compute.manager [req-6cd577ec-2bf6-445b-a81e-7e0bdb40736d req-856edb99-2798-46d9-baed-1fca1e6f489d service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Received event network-vif-plugged-a08cc444-8f39-47df-b452-7c1cb4c951ad {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6cd577ec-2bf6-445b-a81e-7e0bdb40736d req-856edb99-2798-46d9-baed-1fca1e6f489d service nova] Acquiring lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6cd577ec-2bf6-445b-a81e-7e0bdb40736d req-856edb99-2798-46d9-baed-1fca1e6f489d service nova] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6cd577ec-2bf6-445b-a81e-7e0bdb40736d req-856edb99-2798-46d9-baed-1fca1e6f489d service nova] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:56 user nova-compute[74039]: DEBUG nova.compute.manager [req-6cd577ec-2bf6-445b-a81e-7e0bdb40736d req-856edb99-2798-46d9-baed-1fca1e6f489d service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] No waiting events found dispatching network-vif-plugged-a08cc444-8f39-47df-b452-7c1cb4c951ad {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:04:56 user nova-compute[74039]: WARNING nova.compute.manager [req-6cd577ec-2bf6-445b-a81e-7e0bdb40736d req-856edb99-2798-46d9-baed-1fca1e6f489d service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Received unexpected event network-vif-plugged-a08cc444-8f39-47df-b452-7c1cb4c951ad for instance with vm_state building and task_state spawning.
Oct 20 09:04:56 user nova-compute[74039]: DEBUG nova.compute.manager [req-6cd577ec-2bf6-445b-a81e-7e0bdb40736d req-856edb99-2798-46d9-baed-1fca1e6f489d service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Received event network-vif-plugged-a08cc444-8f39-47df-b452-7c1cb4c951ad {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:04:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6cd577ec-2bf6-445b-a81e-7e0bdb40736d req-856edb99-2798-46d9-baed-1fca1e6f489d service nova] Acquiring lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:04:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6cd577ec-2bf6-445b-a81e-7e0bdb40736d req-856edb99-2798-46d9-baed-1fca1e6f489d service nova] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6cd577ec-2bf6-445b-a81e-7e0bdb40736d req-856edb99-2798-46d9-baed-1fca1e6f489d service nova] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:56 user nova-compute[74039]: DEBUG nova.compute.manager [req-6cd577ec-2bf6-445b-a81e-7e0bdb40736d req-856edb99-2798-46d9-baed-1fca1e6f489d service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] No waiting events found dispatching network-vif-plugged-a08cc444-8f39-47df-b452-7c1cb4c951ad {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:04:56 user nova-compute[74039]: WARNING nova.compute.manager [req-6cd577ec-2bf6-445b-a81e-7e0bdb40736d req-856edb99-2798-46d9-baed-1fca1e6f489d service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Received unexpected event network-vif-plugged-a08cc444-8f39-47df-b452-7c1cb4c951ad for instance with vm_state building and task_state spawning.
Oct 20 09:04:56 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:04:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:04:56 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Instance spawned successfully.
Oct 20 09:04:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:04:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:04:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:04:56 user nova-compute[74039]: INFO nova.compute.manager [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Took 7.61 seconds to spawn the instance on the hypervisor.
Oct 20 09:04:56 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:04:56 user nova-compute[74039]: INFO nova.compute.manager [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Took 8.76 seconds to build instance.
Oct 20 09:04:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f600c51a-31cc-40eb-9732-19cf9f7debb7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.869s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.170s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:04:56 user nova-compute[74039]: INFO nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 20 09:04:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:04:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:04:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:05 user nova-compute[74039]: INFO nova.compute.manager [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Terminating instance
Oct 20 09:05:05 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:05:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:05 user nova-compute[74039]: DEBUG nova.compute.manager [req-f38879ec-3333-4ece-bdb1-586ee96cae47 req-7dcdd963-4f15-4945-b7b5-a8a6738886e5 service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Received event network-vif-unplugged-24716055-5932-4507-8742-840afce654a2 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:05:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f38879ec-3333-4ece-bdb1-586ee96cae47 req-7dcdd963-4f15-4945-b7b5-a8a6738886e5 service nova] Acquiring lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f38879ec-3333-4ece-bdb1-586ee96cae47 req-7dcdd963-4f15-4945-b7b5-a8a6738886e5 service nova] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f38879ec-3333-4ece-bdb1-586ee96cae47 req-7dcdd963-4f15-4945-b7b5-a8a6738886e5 service nova] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:05 user nova-compute[74039]: DEBUG nova.compute.manager [req-f38879ec-3333-4ece-bdb1-586ee96cae47 req-7dcdd963-4f15-4945-b7b5-a8a6738886e5 service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] No waiting events found dispatching network-vif-unplugged-24716055-5932-4507-8742-840afce654a2 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:05:05 user nova-compute[74039]: DEBUG nova.compute.manager [req-f38879ec-3333-4ece-bdb1-586ee96cae47 req-7dcdd963-4f15-4945-b7b5-a8a6738886e5 service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Received event network-vif-unplugged-24716055-5932-4507-8742-840afce654a2 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:05:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:06 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Instance destroyed successfully.
Oct 20 09:05:06 user nova-compute[74039]: DEBUG nova.objects.instance [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'resources' on Instance uuid c8054dbd-c0ae-45d2-af95-dae7d05f8c69 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:05:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1005459278',display_name='tempest-ServerRescueNegativeTestJSON-server-1005459278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1005459278',id=2,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:50:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d74bb65080a343afb5cbcea1b5481938',ramdisk_id='',reservation_id='r-xijpimll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1580334620',owner_user_name='tempest-ServerRescueNegativeTestJSON-1580334620-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:50:15Z,user_data=None,user_id='4024fa0ccfda49e0a070b9e6166e37ed',uuid=c8054dbd-c0ae-45d2-af95-dae7d05f8c69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "24716055-5932-4507-8742-840afce654a2", "address": "fa:16:3e:3e:2e:b3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24716055-59", "ovs_interfaceid": "24716055-5932-4507-8742-840afce654a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:05:06 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converting VIF {"id": "24716055-5932-4507-8742-840afce654a2", "address": "fa:16:3e:3e:2e:b3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24716055-59", "ovs_interfaceid": "24716055-5932-4507-8742-840afce654a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:05:06 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:2e:b3,bridge_name='br-int',has_traffic_filtering=True,id=24716055-5932-4507-8742-840afce654a2,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24716055-59') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:05:06 user nova-compute[74039]: DEBUG os_vif [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:2e:b3,bridge_name='br-int',has_traffic_filtering=True,id=24716055-5932-4507-8742-840afce654a2,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24716055-59') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:05:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24716055-59, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:05:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9e1c1a7-68cd-4fd8-a775-89e33fdfdce6) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:05:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:05:06 user nova-compute[74039]: INFO os_vif [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:2e:b3,bridge_name='br-int',has_traffic_filtering=True,id=24716055-5932-4507-8742-840afce654a2,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24716055-59')
Oct 20 09:05:06 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Deleting instance files /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69_del
Oct 20 09:05:06 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Deletion of /opt/stack/data/nova/instances/c8054dbd-c0ae-45d2-af95-dae7d05f8c69_del complete
Oct 20 09:05:06 user nova-compute[74039]: INFO nova.compute.manager [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 20 09:05:06 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:05:06 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:05:06 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:05:06 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:05:06 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Took 0.51 seconds to deallocate network for instance.
Oct 20 09:05:06 user nova-compute[74039]: DEBUG nova.compute.manager [req-ebf3f378-59dc-4666-8ce4-0999c63c8c1b req-635a0fb6-70bd-414f-a9bd-7c052ef4745f service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Received event network-vif-deleted-24716055-5932-4507-8742-840afce654a2 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:05:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:07 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:05:07 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:05:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:07 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Deleted allocations for instance c8054dbd-c0ae-45d2-af95-dae7d05f8c69
Oct 20 09:05:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8f8dade1-6e39-4a13-bdec-5f337173d5c4 tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.055s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-82fcfebd-42a1-488e-bf99-bab64fb06095 req-2736c511-07b9-4bf5-917a-14ff6be7664c service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Received event network-vif-plugged-24716055-5932-4507-8742-840afce654a2 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:05:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-82fcfebd-42a1-488e-bf99-bab64fb06095 req-2736c511-07b9-4bf5-917a-14ff6be7664c service nova] Acquiring lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-82fcfebd-42a1-488e-bf99-bab64fb06095 req-2736c511-07b9-4bf5-917a-14ff6be7664c service nova] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-82fcfebd-42a1-488e-bf99-bab64fb06095 req-2736c511-07b9-4bf5-917a-14ff6be7664c service nova] Lock "c8054dbd-c0ae-45d2-af95-dae7d05f8c69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:07 user nova-compute[74039]: DEBUG nova.compute.manager [req-82fcfebd-42a1-488e-bf99-bab64fb06095 req-2736c511-07b9-4bf5-917a-14ff6be7664c service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] No waiting events found dispatching network-vif-plugged-24716055-5932-4507-8742-840afce654a2 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:05:07 user nova-compute[74039]: WARNING nova.compute.manager [req-82fcfebd-42a1-488e-bf99-bab64fb06095 req-2736c511-07b9-4bf5-917a-14ff6be7664c service nova] [instance: c8054dbd-c0ae-45d2-af95-dae7d05f8c69] Received unexpected event network-vif-plugged-24716055-5932-4507-8742-840afce654a2 for instance with vm_state deleted and task_state None.
Oct 20 09:05:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Acquiring lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:09 user nova-compute[74039]: DEBUG nova.compute.manager [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:05:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:05:09 user nova-compute[74039]: INFO nova.compute.claims [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Claim successful on node user
Oct 20 09:05:09 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:05:09 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:05:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:09 user nova-compute[74039]: DEBUG nova.compute.manager [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:05:10 user nova-compute[74039]: DEBUG nova.compute.manager [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:05:10 user nova-compute[74039]: DEBUG nova.network.neutron [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:05:10 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:05:10 user nova-compute[74039]: DEBUG nova.compute.manager [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:05:10 user nova-compute[74039]: DEBUG nova.policy [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '644af097c95f4a26817492be77c327d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7181660fb3d4a3e995e2ccd85dfe3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:05:10 user nova-compute[74039]: DEBUG nova.compute.manager [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:05:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:05:10 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Creating image(s)
Oct 20 09:05:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "/opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "/opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.207s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.220s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:10 user nova-compute[74039]: DEBUG nova.network.neutron [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Successfully created port: 864c614d-53f7-4160-93bf-17034231048b {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:05:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2/disk 1073741824" returned: 0 in 0.082s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.213s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Cannot resize image /opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Ensure instance console log exists: /opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.network.neutron [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Successfully updated port: 864c614d-53f7-4160-93bf-17034231048b {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Acquiring lock "refresh_cache-f9470b11-57ae-49bb-a6c5-c0d971a767a2" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Acquired lock "refresh_cache-f9470b11-57ae-49bb-a6c5-c0d971a767a2" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.network.neutron [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-c62b369c-c94a-4f14-ae4c-1927163d6a97 req-de7fd641-e533-4a6b-8cf1-66eee2aa6c79 service nova] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Received event network-changed-864c614d-53f7-4160-93bf-17034231048b {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-c62b369c-c94a-4f14-ae4c-1927163d6a97 req-de7fd641-e533-4a6b-8cf1-66eee2aa6c79 service nova] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Refreshing instance network info cache due to event network-changed-864c614d-53f7-4160-93bf-17034231048b. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c62b369c-c94a-4f14-ae4c-1927163d6a97 req-de7fd641-e533-4a6b-8cf1-66eee2aa6c79 service nova] Acquiring lock "refresh_cache-f9470b11-57ae-49bb-a6c5-c0d971a767a2" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.network.neutron [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.network.neutron [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Updating instance_info_cache with network_info: [{"id": "864c614d-53f7-4160-93bf-17034231048b", "address": "fa:16:3e:a1:18:09", "network": {"id": "0d9cc42e-a86c-4a9b-bab9-179e24144ea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-339724642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7181660fb3d4a3e995e2ccd85dfe3c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap864c614d-53", "ovs_interfaceid": "864c614d-53f7-4160-93bf-17034231048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Releasing lock "refresh_cache-f9470b11-57ae-49bb-a6c5-c0d971a767a2" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.compute.manager [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Instance network_info: |[{"id": "864c614d-53f7-4160-93bf-17034231048b", "address": "fa:16:3e:a1:18:09", "network": {"id": "0d9cc42e-a86c-4a9b-bab9-179e24144ea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-339724642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7181660fb3d4a3e995e2ccd85dfe3c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap864c614d-53", "ovs_interfaceid": "864c614d-53f7-4160-93bf-17034231048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c62b369c-c94a-4f14-ae4c-1927163d6a97 req-de7fd641-e533-4a6b-8cf1-66eee2aa6c79 service nova] Acquired lock "refresh_cache-f9470b11-57ae-49bb-a6c5-c0d971a767a2" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.network.neutron [req-c62b369c-c94a-4f14-ae4c-1927163d6a97 req-de7fd641-e533-4a6b-8cf1-66eee2aa6c79 service nova] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Refreshing network info cache for port 864c614d-53f7-4160-93bf-17034231048b {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Start _get_guest_xml network_info=[{"id": "864c614d-53f7-4160-93bf-17034231048b", "address": "fa:16:3e:a1:18:09", "network": {"id": "0d9cc42e-a86c-4a9b-bab9-179e24144ea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-339724642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7181660fb3d4a3e995e2ccd85dfe3c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap864c614d-53", "ovs_interfaceid": "864c614d-53f7-4160-93bf-17034231048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:05:11 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:05:11 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1891544990',display_name='tempest-VolumesActionsTest-instance-1891544990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1891544990',id=30,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7181660fb3d4a3e995e2ccd85dfe3c2',ramdisk_id='',reservation_id='r-3pu0sw0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2122958476',owner_user_name='tempest-VolumesActionsTest-2122958476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:05:10Z,user_data=None,user_id='644af097c95f4a26817492be77c327d9',uuid=f9470b11-57ae-49bb-a6c5-c0d971a767a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "864c614d-53f7-4160-93bf-17034231048b", "address": "fa:16:3e:a1:18:09", "network": {"id": "0d9cc42e-a86c-4a9b-bab9-179e24144ea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-339724642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7181660fb3d4a3e995e2ccd85dfe3c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap864c614d-53", "ovs_interfaceid": "864c614d-53f7-4160-93bf-17034231048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Converting VIF {"id": "864c614d-53f7-4160-93bf-17034231048b", "address": "fa:16:3e:a1:18:09", "network": {"id": "0d9cc42e-a86c-4a9b-bab9-179e24144ea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-339724642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7181660fb3d4a3e995e2ccd85dfe3c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap864c614d-53", "ovs_interfaceid": "864c614d-53f7-4160-93bf-17034231048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:18:09,bridge_name='br-int',has_traffic_filtering=True,id=864c614d-53f7-4160-93bf-17034231048b,network=Network(0d9cc42e-a86c-4a9b-bab9-179e24144ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap864c614d-53') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.objects.instance [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lazy-loading 'pci_devices' on Instance uuid f9470b11-57ae-49bb-a6c5-c0d971a767a2 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:05:11 user nova-compute[74039]:   <uuid>f9470b11-57ae-49bb-a6c5-c0d971a767a2</uuid>
Oct 20 09:05:11 user nova-compute[74039]:   <name>instance-0000001e</name>
Oct 20 09:05:11 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:05:11 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:05:11 user nova-compute[74039]:   <metadata>
Oct 20 09:05:11 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:05:11 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:05:11 user nova-compute[74039]:       <nova:name>tempest-VolumesActionsTest-instance-1891544990</nova:name>
Oct 20 09:05:11 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:05:11</nova:creationTime>
Oct 20 09:05:11 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:05:11 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:05:11 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:05:11 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:05:11 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:05:11 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:05:11 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:05:11 user nova-compute[74039]:       <nova:owner>
Oct 20 09:05:11 user nova-compute[74039]:         <nova:user uuid="644af097c95f4a26817492be77c327d9">tempest-VolumesActionsTest-2122958476-project-member</nova:user>
Oct 20 09:05:11 user nova-compute[74039]:         <nova:project uuid="e7181660fb3d4a3e995e2ccd85dfe3c2">tempest-VolumesActionsTest-2122958476</nova:project>
Oct 20 09:05:11 user nova-compute[74039]:       </nova:owner>
Oct 20 09:05:11 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:05:11 user nova-compute[74039]:       <nova:ports>
Oct 20 09:05:11 user nova-compute[74039]:         <nova:port uuid="864c614d-53f7-4160-93bf-17034231048b">
Oct 20 09:05:11 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 09:05:11 user nova-compute[74039]:         </nova:port>
Oct 20 09:05:11 user nova-compute[74039]:       </nova:ports>
Oct 20 09:05:11 user nova-compute[74039]:     </nova:instance>
Oct 20 09:05:11 user nova-compute[74039]:   </metadata>
Oct 20 09:05:11 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:05:11 user nova-compute[74039]:     <system>
Oct 20 09:05:11 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:05:11 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:05:11 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:05:11 user nova-compute[74039]:       <entry name="serial">f9470b11-57ae-49bb-a6c5-c0d971a767a2</entry>
Oct 20 09:05:11 user nova-compute[74039]:       <entry name="uuid">f9470b11-57ae-49bb-a6c5-c0d971a767a2</entry>
Oct 20 09:05:11 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:05:11 user nova-compute[74039]:     </system>
Oct 20 09:05:11 user nova-compute[74039]:   </sysinfo>
Oct 20 09:05:11 user nova-compute[74039]:   <os>
Oct 20 09:05:11 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:05:11 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:05:11 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:05:11 user nova-compute[74039]:   </os>
Oct 20 09:05:11 user nova-compute[74039]:   <features>
Oct 20 09:05:11 user nova-compute[74039]:     <acpi/>
Oct 20 09:05:11 user nova-compute[74039]:     <apic/>
Oct 20 09:05:11 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:05:11 user nova-compute[74039]:   </features>
Oct 20 09:05:11 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:05:11 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:05:11 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:05:11 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:05:11 user nova-compute[74039]:   </clock>
Oct 20 09:05:11 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:05:11 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:05:11 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:05:11 user nova-compute[74039]:   </cpu>
Oct 20 09:05:11 user nova-compute[74039]:   <devices>
Oct 20 09:05:11 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:05:11 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:05:11 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2/disk"/>
Oct 20 09:05:11 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:05:11 user nova-compute[74039]:     </disk>
Oct 20 09:05:11 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:05:11 user nova-compute[74039]:       <mac address="fa:16:3e:a1:18:09"/>
Oct 20 09:05:11 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:05:11 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:05:11 user nova-compute[74039]:       <target dev="tap864c614d-53"/>
Oct 20 09:05:11 user nova-compute[74039]:     </interface>
Oct 20 09:05:11 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:05:11 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2/console.log" append="off"/>
Oct 20 09:05:11 user nova-compute[74039]:     </serial>
Oct 20 09:05:11 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:05:11 user nova-compute[74039]:     <video>
Oct 20 09:05:11 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:05:11 user nova-compute[74039]:     </video>
Oct 20 09:05:11 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:05:11 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:05:11 user nova-compute[74039]:     </rng>
Oct 20 09:05:11 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:05:11 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:05:11 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:05:11 user nova-compute[74039]:     </memballoon>
Oct 20 09:05:11 user nova-compute[74039]:   </devices>
Oct 20 09:05:11 user nova-compute[74039]: </domain>
Oct 20 09:05:11 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1891544990',display_name='tempest-VolumesActionsTest-instance-1891544990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1891544990',id=30,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7181660fb3d4a3e995e2ccd85dfe3c2',ramdisk_id='',reservation_id='r-3pu0sw0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2122958476',owner_user_name='tempest-VolumesActionsTest-2122958476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:05:10Z,user_data=None,user_id='644af097c95f4a26817492be77c327d9',uuid=f9470b11-57ae-49bb-a6c5-c0d971a767a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "864c614d-53f7-4160-93bf-17034231048b", "address": "fa:16:3e:a1:18:09", "network": {"id": "0d9cc42e-a86c-4a9b-bab9-179e24144ea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-339724642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7181660fb3d4a3e995e2ccd85dfe3c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap864c614d-53", "ovs_interfaceid": "864c614d-53f7-4160-93bf-17034231048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Converting VIF {"id": "864c614d-53f7-4160-93bf-17034231048b", "address": "fa:16:3e:a1:18:09", "network": {"id": "0d9cc42e-a86c-4a9b-bab9-179e24144ea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-339724642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7181660fb3d4a3e995e2ccd85dfe3c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap864c614d-53", "ovs_interfaceid": "864c614d-53f7-4160-93bf-17034231048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:18:09,bridge_name='br-int',has_traffic_filtering=True,id=864c614d-53f7-4160-93bf-17034231048b,network=Network(0d9cc42e-a86c-4a9b-bab9-179e24144ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap864c614d-53') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG os_vif [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:18:09,bridge_name='br-int',has_traffic_filtering=True,id=864c614d-53f7-4160-93bf-17034231048b,network=Network(0d9cc42e-a86c-4a9b-bab9-179e24144ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap864c614d-53') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '325fe844-90bd-50b6-b0cc-3ec050f4fb32', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap864c614d-53, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap864c614d-53, col_values=(('qos', UUID('3f1bfefb-e2d8-471d-b657-7962248bb264')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap864c614d-53, col_values=(('external_ids', {'iface-id': '864c614d-53f7-4160-93bf-17034231048b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:18:09', 'vm-uuid': 'f9470b11-57ae-49bb-a6c5-c0d971a767a2'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:05:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:11 user nova-compute[74039]: INFO os_vif [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:18:09,bridge_name='br-int',has_traffic_filtering=True,id=864c614d-53f7-4160-93bf-17034231048b,network=Network(0d9cc42e-a86c-4a9b-bab9-179e24144ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap864c614d-53')
Oct 20 09:05:12 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:05:12 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] No VIF found with MAC fa:16:3e:a1:18:09, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:05:12 user nova-compute[74039]: DEBUG nova.network.neutron [req-c62b369c-c94a-4f14-ae4c-1927163d6a97 req-de7fd641-e533-4a6b-8cf1-66eee2aa6c79 service nova] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Updated VIF entry in instance network info cache for port 864c614d-53f7-4160-93bf-17034231048b. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:05:12 user nova-compute[74039]: DEBUG nova.network.neutron [req-c62b369c-c94a-4f14-ae4c-1927163d6a97 req-de7fd641-e533-4a6b-8cf1-66eee2aa6c79 service nova] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Updating instance_info_cache with network_info: [{"id": "864c614d-53f7-4160-93bf-17034231048b", "address": "fa:16:3e:a1:18:09", "network": {"id": "0d9cc42e-a86c-4a9b-bab9-179e24144ea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-339724642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7181660fb3d4a3e995e2ccd85dfe3c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap864c614d-53", "ovs_interfaceid": "864c614d-53f7-4160-93bf-17034231048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:05:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c62b369c-c94a-4f14-ae4c-1927163d6a97 req-de7fd641-e533-4a6b-8cf1-66eee2aa6c79 service nova] Releasing lock "refresh_cache-f9470b11-57ae-49bb-a6c5-c0d971a767a2" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:05:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-18b78774-b06f-47be-b4ef-9bcd75540ed2 req-aa5eeeee-57b4-4b39-9e81-b5a8e3f3e93c service nova] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Received event network-vif-plugged-864c614d-53f7-4160-93bf-17034231048b {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:05:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-18b78774-b06f-47be-b4ef-9bcd75540ed2 req-aa5eeeee-57b4-4b39-9e81-b5a8e3f3e93c service nova] Acquiring lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-18b78774-b06f-47be-b4ef-9bcd75540ed2 req-aa5eeeee-57b4-4b39-9e81-b5a8e3f3e93c service nova] Lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-18b78774-b06f-47be-b4ef-9bcd75540ed2 req-aa5eeeee-57b4-4b39-9e81-b5a8e3f3e93c service nova] Lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-18b78774-b06f-47be-b4ef-9bcd75540ed2 req-aa5eeeee-57b4-4b39-9e81-b5a8e3f3e93c service nova] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] No waiting events found dispatching network-vif-plugged-864c614d-53f7-4160-93bf-17034231048b {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:05:13 user nova-compute[74039]: WARNING nova.compute.manager [req-18b78774-b06f-47be-b4ef-9bcd75540ed2 req-aa5eeeee-57b4-4b39-9e81-b5a8e3f3e93c service nova] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Received unexpected event network-vif-plugged-864c614d-53f7-4160-93bf-17034231048b for instance with vm_state building and task_state spawning.
Oct 20 09:05:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:15 user nova-compute[74039]: DEBUG nova.compute.manager [req-997f43b2-2fb1-4fba-aa36-41095225a847 req-0a883619-ff9a-4bce-93db-e50242cbdced service nova] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Received event network-vif-plugged-864c614d-53f7-4160-93bf-17034231048b {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:05:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-997f43b2-2fb1-4fba-aa36-41095225a847 req-0a883619-ff9a-4bce-93db-e50242cbdced service nova] Acquiring lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-997f43b2-2fb1-4fba-aa36-41095225a847 req-0a883619-ff9a-4bce-93db-e50242cbdced service nova] Lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-997f43b2-2fb1-4fba-aa36-41095225a847 req-0a883619-ff9a-4bce-93db-e50242cbdced service nova] Lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:15 user nova-compute[74039]: DEBUG nova.compute.manager [req-997f43b2-2fb1-4fba-aa36-41095225a847 req-0a883619-ff9a-4bce-93db-e50242cbdced service nova] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] No waiting events found dispatching network-vif-plugged-864c614d-53f7-4160-93bf-17034231048b {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:05:15 user nova-compute[74039]: WARNING nova.compute.manager [req-997f43b2-2fb1-4fba-aa36-41095225a847 req-0a883619-ff9a-4bce-93db-e50242cbdced service nova] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Received unexpected event network-vif-plugged-864c614d-53f7-4160-93bf-17034231048b for instance with vm_state building and task_state spawning.
Oct 20 09:05:15 user nova-compute[74039]: DEBUG nova.compute.manager [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:05:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:05:15 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Instance spawned successfully.
Oct 20 09:05:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:05:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:05:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:05:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:05:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:05:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:05:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:05:15 user nova-compute[74039]: INFO nova.compute.manager [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Took 5.65 seconds to spawn the instance on the hypervisor.
Oct 20 09:05:15 user nova-compute[74039]: DEBUG nova.compute.manager [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:05:15 user nova-compute[74039]: INFO nova.compute.manager [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Took 6.52 seconds to build instance.
Oct 20 09:05:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6297821b-8c08-4587-b0ea-cf494729418a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.682s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:19 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:05:19 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:05:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:21 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:05:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:22 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:05:22 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:05:22 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Didn't find any instances for network info cache update. {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 09:05:22 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:05:22 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:05:22 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:05:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:25 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:05:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:05:31 user nova-compute[74039]: INFO nova.compute.claims [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Claim successful on node user
Oct 20 09:05:31 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG nova.network.neutron [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:05:31 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:05:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG nova.policy [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e07a52b4e3b4a65b34f71fb2cca8de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ed96a82048434fb0d79a55838184e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:05:31 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Creating image(s)
Oct 20 09:05:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "/opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "/opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.190s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk 1073741824" returned: 0 in 0.049s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:32 user nova-compute[74039]: DEBUG nova.network.neutron [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Successfully created port: 47e6bac4-ee17-4c84-821f-d92e0ee9aa93 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:05:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "e14ecf11-28b6-421d-875f-0ce9a21999d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:32 user nova-compute[74039]: INFO nova.compute.manager [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Detaching volume ca4bcc71-c61a-49a0-ae06-58300cbc4af5
Oct 20 09:05:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.204s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:32 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:05:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:32 user nova-compute[74039]: INFO nova.virt.block_device [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Attempting to driver detach volume ca4bcc71-c61a-49a0-ae06-58300cbc4af5 from mountpoint /dev/vdb
Oct 20 09:05:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Attempting to detach device vdb from instance e14ecf11-28b6-421d-875f-0ce9a21999d3 from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 09:05:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:05:32 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:05:32 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 09:05:32 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:05:32 user nova-compute[74039]:   <serial>ca4bcc71-c61a-49a0-ae06-58300cbc4af5</serial>
Oct 20 09:05:32 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:05:32 user nova-compute[74039]: </disk>
Oct 20 09:05:32 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:05:32 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Successfully detached device vdb from instance e14ecf11-28b6-421d-875f-0ce9a21999d3 from the persistent domain config.
Oct 20 09:05:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e14ecf11-28b6-421d-875f-0ce9a21999d3 from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 09:05:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:05:32 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:05:32 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 09:05:32 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:05:32 user nova-compute[74039]:   <serial>ca4bcc71-c61a-49a0-ae06-58300cbc4af5</serial>
Oct 20 09:05:32 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:05:32 user nova-compute[74039]: </disk>
Oct 20 09:05:32 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:05:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:32 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Cannot resize image /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:05:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:05:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Ensure instance console log exists: /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:05:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "e14ecf11-28b6-421d-875f-0ce9a21999d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.network.neutron [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Successfully updated port: 47e6bac4-ee17-4c84-821f-d92e0ee9aa93 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquired lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.network.neutron [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e14ecf11-28b6-421d-875f-0ce9a21999d3 {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.compute.manager [req-e126bf04-5fbd-49ad-9260-69b780d97269 req-16e2fb6d-27e9-418b-bb27-bee503306dae service nova] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Received event network-changed-47e6bac4-ee17-4c84-821f-d92e0ee9aa93 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.compute.manager [req-e126bf04-5fbd-49ad-9260-69b780d97269 req-16e2fb6d-27e9-418b-bb27-bee503306dae service nova] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Refreshing instance network info cache due to event network-changed-47e6bac4-ee17-4c84-821f-d92e0ee9aa93. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e126bf04-5fbd-49ad-9260-69b780d97269 req-16e2fb6d-27e9-418b-bb27-bee503306dae service nova] Acquiring lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.network.neutron [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.network.neutron [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Updating instance_info_cache with network_info: [{"id": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "address": "fa:16:3e:d6:ab:b8", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e6bac4-ee", "ovs_interfaceid": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Releasing lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.compute.manager [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Instance network_info: |[{"id": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "address": "fa:16:3e:d6:ab:b8", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e6bac4-ee", "ovs_interfaceid": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e126bf04-5fbd-49ad-9260-69b780d97269 req-16e2fb6d-27e9-418b-bb27-bee503306dae service nova] Acquired lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.network.neutron [req-e126bf04-5fbd-49ad-9260-69b780d97269 req-16e2fb6d-27e9-418b-bb27-bee503306dae service nova] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Refreshing network info cache for port 47e6bac4-ee17-4c84-821f-d92e0ee9aa93 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Start _get_guest_xml network_info=[{"id": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "address": "fa:16:3e:d6:ab:b8", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e6bac4-ee", "ovs_interfaceid": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:05:33 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:05:33 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-58075102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-58075102',id=31,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7ed96a82048434fb0d79a55838184e4',ramdisk_id='',reservation_id='r-b3fgw0jf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:05:32Z,user_data=None,user_id='1e07a52b4e3b4a65b34f71fb2cca8de3',uuid=4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "address": "fa:16:3e:d6:ab:b8", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e6bac4-ee", "ovs_interfaceid": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converting VIF {"id": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "address": "fa:16:3e:d6:ab:b8", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e6bac4-ee", "ovs_interfaceid": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ab:b8,bridge_name='br-int',has_traffic_filtering=True,id=47e6bac4-ee17-4c84-821f-d92e0ee9aa93,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e6bac4-ee') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.objects.instance [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:05:33 user nova-compute[74039]:   <uuid>4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b</uuid>
Oct 20 09:05:33 user nova-compute[74039]:   <name>instance-0000001f</name>
Oct 20 09:05:33 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:05:33 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:05:33 user nova-compute[74039]:   <metadata>
Oct 20 09:05:33 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:05:33 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:05:33 user nova-compute[74039]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-58075102</nova:name>
Oct 20 09:05:33 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:05:33</nova:creationTime>
Oct 20 09:05:33 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:05:33 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:05:33 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:05:33 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:05:33 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:05:33 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:05:33 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:05:33 user nova-compute[74039]:       <nova:owner>
Oct 20 09:05:33 user nova-compute[74039]:         <nova:user uuid="1e07a52b4e3b4a65b34f71fb2cca8de3">tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member</nova:user>
Oct 20 09:05:33 user nova-compute[74039]:         <nova:project uuid="d7ed96a82048434fb0d79a55838184e4">tempest-ServerBootFromVolumeStableRescueTest-1728924155</nova:project>
Oct 20 09:05:33 user nova-compute[74039]:       </nova:owner>
Oct 20 09:05:33 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:05:33 user nova-compute[74039]:       <nova:ports>
Oct 20 09:05:33 user nova-compute[74039]:         <nova:port uuid="47e6bac4-ee17-4c84-821f-d92e0ee9aa93">
Oct 20 09:05:33 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 09:05:33 user nova-compute[74039]:         </nova:port>
Oct 20 09:05:33 user nova-compute[74039]:       </nova:ports>
Oct 20 09:05:33 user nova-compute[74039]:     </nova:instance>
Oct 20 09:05:33 user nova-compute[74039]:   </metadata>
Oct 20 09:05:33 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:05:33 user nova-compute[74039]:     <system>
Oct 20 09:05:33 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:05:33 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:05:33 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:05:33 user nova-compute[74039]:       <entry name="serial">4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b</entry>
Oct 20 09:05:33 user nova-compute[74039]:       <entry name="uuid">4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b</entry>
Oct 20 09:05:33 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:05:33 user nova-compute[74039]:     </system>
Oct 20 09:05:33 user nova-compute[74039]:   </sysinfo>
Oct 20 09:05:33 user nova-compute[74039]:   <os>
Oct 20 09:05:33 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:05:33 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:05:33 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:05:33 user nova-compute[74039]:   </os>
Oct 20 09:05:33 user nova-compute[74039]:   <features>
Oct 20 09:05:33 user nova-compute[74039]:     <acpi/>
Oct 20 09:05:33 user nova-compute[74039]:     <apic/>
Oct 20 09:05:33 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:05:33 user nova-compute[74039]:   </features>
Oct 20 09:05:33 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:05:33 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:05:33 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:05:33 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:05:33 user nova-compute[74039]:   </clock>
Oct 20 09:05:33 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:05:33 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:05:33 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:05:33 user nova-compute[74039]:   </cpu>
Oct 20 09:05:33 user nova-compute[74039]:   <devices>
Oct 20 09:05:33 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:05:33 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:05:33 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk"/>
Oct 20 09:05:33 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:05:33 user nova-compute[74039]:     </disk>
Oct 20 09:05:33 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:05:33 user nova-compute[74039]:       <mac address="fa:16:3e:d6:ab:b8"/>
Oct 20 09:05:33 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:05:33 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:05:33 user nova-compute[74039]:       <target dev="tap47e6bac4-ee"/>
Oct 20 09:05:33 user nova-compute[74039]:     </interface>
Oct 20 09:05:33 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:05:33 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/console.log" append="off"/>
Oct 20 09:05:33 user nova-compute[74039]:     </serial>
Oct 20 09:05:33 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:05:33 user nova-compute[74039]:     <video>
Oct 20 09:05:33 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:05:33 user nova-compute[74039]:     </video>
Oct 20 09:05:33 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:05:33 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:05:33 user nova-compute[74039]:     </rng>
Oct 20 09:05:33 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:05:33 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:05:33 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:05:33 user nova-compute[74039]:     </memballoon>
Oct 20 09:05:33 user nova-compute[74039]:   </devices>
Oct 20 09:05:33 user nova-compute[74039]: </domain>
Oct 20 09:05:33 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-58075102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-58075102',id=31,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7ed96a82048434fb0d79a55838184e4',ramdisk_id='',reservation_id='r-b3fgw0jf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:05:32Z,user_data=None,user_id='1e07a52b4e3b4a65b34f71fb2cca8de3',uuid=4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "address": "fa:16:3e:d6:ab:b8", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e6bac4-ee", "ovs_interfaceid": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converting VIF {"id": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "address": "fa:16:3e:d6:ab:b8", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e6bac4-ee", "ovs_interfaceid": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ab:b8,bridge_name='br-int',has_traffic_filtering=True,id=47e6bac4-ee17-4c84-821f-d92e0ee9aa93,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e6bac4-ee') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG os_vif [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ab:b8,bridge_name='br-int',has_traffic_filtering=True,id=47e6bac4-ee17-4c84-821f-d92e0ee9aa93,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e6bac4-ee') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df4d6f65-1474-56cc-bc0f-84e4a68625d0', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47e6bac4-ee, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47e6bac4-ee, col_values=(('qos', UUID('90c98049-6f67-4d6f-9424-7be98f1851b7')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47e6bac4-ee, col_values=(('external_ids', {'iface-id': '47e6bac4-ee17-4c84-821f-d92e0ee9aa93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:ab:b8', 'vm-uuid': '4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:33 user nova-compute[74039]: INFO os_vif [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ab:b8,bridge_name='br-int',has_traffic_filtering=True,id=47e6bac4-ee17-4c84-821f-d92e0ee9aa93,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e6bac4-ee')
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] No VIF found with MAC fa:16:3e:d6:ab:b8, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.network.neutron [req-e126bf04-5fbd-49ad-9260-69b780d97269 req-16e2fb6d-27e9-418b-bb27-bee503306dae service nova] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Updated VIF entry in instance network info cache for port 47e6bac4-ee17-4c84-821f-d92e0ee9aa93. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG nova.network.neutron [req-e126bf04-5fbd-49ad-9260-69b780d97269 req-16e2fb6d-27e9-418b-bb27-bee503306dae service nova] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Updating instance_info_cache with network_info: [{"id": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "address": "fa:16:3e:d6:ab:b8", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e6bac4-ee", "ovs_interfaceid": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:05:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e126bf04-5fbd-49ad-9260-69b780d97269 req-16e2fb6d-27e9-418b-bb27-bee503306dae service nova] Releasing lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:05:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:35 user nova-compute[74039]: DEBUG nova.compute.manager [req-00e55405-b3e6-4f83-943a-b7cab6d8e9ac req-c02c1133-dede-4fea-9415-9be0252bfe49 service nova] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Received event network-vif-plugged-47e6bac4-ee17-4c84-821f-d92e0ee9aa93 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:05:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-00e55405-b3e6-4f83-943a-b7cab6d8e9ac req-c02c1133-dede-4fea-9415-9be0252bfe49 service nova] Acquiring lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-00e55405-b3e6-4f83-943a-b7cab6d8e9ac req-c02c1133-dede-4fea-9415-9be0252bfe49 service nova] Lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-00e55405-b3e6-4f83-943a-b7cab6d8e9ac req-c02c1133-dede-4fea-9415-9be0252bfe49 service nova] Lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:35 user nova-compute[74039]: DEBUG nova.compute.manager [req-00e55405-b3e6-4f83-943a-b7cab6d8e9ac req-c02c1133-dede-4fea-9415-9be0252bfe49 service nova] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] No waiting events found dispatching network-vif-plugged-47e6bac4-ee17-4c84-821f-d92e0ee9aa93 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:05:35 user nova-compute[74039]: WARNING nova.compute.manager [req-00e55405-b3e6-4f83-943a-b7cab6d8e9ac req-c02c1133-dede-4fea-9415-9be0252bfe49 service nova] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Received unexpected event network-vif-plugged-47e6bac4-ee17-4c84-821f-d92e0ee9aa93 for instance with vm_state building and task_state spawning.
Oct 20 09:05:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG nova.compute.manager [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:05:37 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Instance spawned successfully.
Oct 20 09:05:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:05:37 user nova-compute[74039]: INFO nova.compute.manager [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Took 5.35 seconds to spawn the instance on the hypervisor.
Oct 20 09:05:37 user nova-compute[74039]: DEBUG nova.compute.manager [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:37 user nova-compute[74039]: INFO nova.compute.manager [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Took 6.11 seconds to build instance.
Oct 20 09:05:37 user nova-compute[74039]: DEBUG nova.compute.manager [req-8fb21371-2573-4d48-bea4-d9fb3b23009f req-7741bdcb-68a4-4ee2-80ad-f48ffaac4a43 service nova] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Received event network-vif-plugged-47e6bac4-ee17-4c84-821f-d92e0ee9aa93 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8fb21371-2573-4d48-bea4-d9fb3b23009f req-7741bdcb-68a4-4ee2-80ad-f48ffaac4a43 service nova] Acquiring lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8fb21371-2573-4d48-bea4-d9fb3b23009f req-7741bdcb-68a4-4ee2-80ad-f48ffaac4a43 service nova] Lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8fb21371-2573-4d48-bea4-d9fb3b23009f req-7741bdcb-68a4-4ee2-80ad-f48ffaac4a43 service nova] Lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG nova.compute.manager [req-8fb21371-2573-4d48-bea4-d9fb3b23009f req-7741bdcb-68a4-4ee2-80ad-f48ffaac4a43 service nova] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] No waiting events found dispatching network-vif-plugged-47e6bac4-ee17-4c84-821f-d92e0ee9aa93 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:05:37 user nova-compute[74039]: WARNING nova.compute.manager [req-8fb21371-2573-4d48-bea4-d9fb3b23009f req-7741bdcb-68a4-4ee2-80ad-f48ffaac4a43 service nova] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Received unexpected event network-vif-plugged-47e6bac4-ee17-4c84-821f-d92e0ee9aa93 for instance with vm_state active and task_state None.
Oct 20 09:05:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5d32e0ea-6d79-4655-89a6-a63e24945262 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.215s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:05:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:39 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:05:39 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:05:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7180MB free_disk=25.353271484375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:05:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Applying migration context for instance 00e09d93-3077-4770-abfd-b82ece646997 as it has an incoming, in-progress migration 2b9c803f-f223-4920-ae16-5e8bcf7f1c91. Migration status is finished {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 09:05:39 user nova-compute[74039]: INFO nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Updating resource usage from migration 2b9c803f-f223-4920-ae16-5e8bcf7f1c91
Oct 20 09:05:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 9fe77a96-fcb5-4410-85cc-58d925548e03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:05:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:05:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4f5d98e3-c1f6-4617-8847-b975e2c23990 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:05:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance e14ecf11-28b6-421d-875f-0ce9a21999d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:05:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance ebaa4804-32e5-4fff-9562-0587ff7ca4ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:05:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Migration 2b9c803f-f223-4920-ae16-5e8bcf7f1c91 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 09:05:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 00e09d93-3077-4770-abfd-b82ece646997 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:05:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance f470b048-6069-425e-b3f9-65d538674321 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:05:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance eca753ae-f542-431d-bb70-197394e6c566 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:05:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance f53c3766-e463-42b1-acd8-f27c3ba2b0ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:05:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance f9470b11-57ae-49bb-a6c5-c0d971a767a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:05:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:05:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:05:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:05:40 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing inventories for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 09:05:40 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Updating ProviderTree inventory for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 09:05:40 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Updating inventory in ProviderTree for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 09:05:40 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing aggregate associations for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb, aggregates: None {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 09:05:40 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing trait associations for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 09:05:40 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:05:40 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:05:40 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:05:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.812s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:53 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e14ecf11-28b6-421d-875f-0ce9a21999d3 is timed out.
Oct 20 09:05:53 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Successfully detached device vdb from instance e14ecf11-28b6-421d-875f-0ce9a21999d3 from the live domain config.
Oct 20 09:05:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVNjlEom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:05:53 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:05:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0b38f7-b4e3-4847-80fd-f79b58c5dd8b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:05:53 user nova-compute[74039]: No targets found.
Oct 20 09:05:53 user nova-compute[74039]: iSNS:
Oct 20 09:05:53 user nova-compute[74039]: No targets found.
Oct 20 09:05:53 user nova-compute[74039]: STATIC:
Oct 20 09:05:53 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1
Oct 20 09:05:53 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:05:53 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:05:53 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84
Oct 20 09:05:53 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:05:53 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:05:53 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5
Oct 20 09:05:53 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:05:53 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:05:53 user nova-compute[74039]: FIRMWARE:
Oct 20 09:05:53 user nova-compute[74039]: No targets found.
Oct 20 09:05:53 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:05:53 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:05:53 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[be75a9af-63c0-4b98-aa58-c5791d97cd34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d58c914-08c5-4e78-ba21-64cc9074419c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:05:53 user nova-compute[74039]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 (non-flash)
Oct 20 09:05:53 user nova-compute[74039]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:05:53 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:05:53 user nova-compute[74039]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 (non-flash)
Oct 20 09:05:53 user nova-compute[74039]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:05:53 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae84841a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5'): ({'sdb'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Removing single pathed devices sdb {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfae6e9-e35d-413c-a0b0-891895c9c307]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d9af48-c329-4956-bcc5-edc63333a50b]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Flushing IO for device /dev/sdb {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcd2948-7207-4bf3-8b31-aac64433830a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e9bd22-6403-49e5-b711-0366a5c5840d]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a160ca0-c470-4573-b8c0-8a4fa7aa72ca]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48e1b70-0849-4db3-8e59-34cad12a7b75]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5, portal: 172.16.0.220,3260]
Oct 20 09:05:53 user nova-compute[74039]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5, portal: 172.16.0.220,3260] successful.
Oct 20 09:05:53 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed11175f-d355-4ab4-ac94-b0f04808bf32]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] <== disconnect_volume: return (313ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:54 user nova-compute[74039]: DEBUG nova.objects.instance [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lazy-loading 'flavor' on Instance uuid e14ecf11-28b6-421d-875f-0ce9a21999d3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:05:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e3c32b44-66eb-410b-80e5-12c8986b96ef tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.058s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.788s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "e14ecf11-28b6-421d-875f-0ce9a21999d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:54 user nova-compute[74039]: INFO nova.compute.manager [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Terminating instance
Oct 20 09:05:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:05:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-037d379f-c682-4583-b029-d0fbfdab0c8f req-4eb1bf6b-802d-4fb3-b492-cf7c88abef4f service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Received event network-vif-unplugged-e70313a0-8859-4514-b8e8-ec4355e6bd40 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:05:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-037d379f-c682-4583-b029-d0fbfdab0c8f req-4eb1bf6b-802d-4fb3-b492-cf7c88abef4f service nova] Acquiring lock "e14ecf11-28b6-421d-875f-0ce9a21999d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-037d379f-c682-4583-b029-d0fbfdab0c8f req-4eb1bf6b-802d-4fb3-b492-cf7c88abef4f service nova] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-037d379f-c682-4583-b029-d0fbfdab0c8f req-4eb1bf6b-802d-4fb3-b492-cf7c88abef4f service nova] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-037d379f-c682-4583-b029-d0fbfdab0c8f req-4eb1bf6b-802d-4fb3-b492-cf7c88abef4f service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] No waiting events found dispatching network-vif-unplugged-e70313a0-8859-4514-b8e8-ec4355e6bd40 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:05:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-037d379f-c682-4583-b029-d0fbfdab0c8f req-4eb1bf6b-802d-4fb3-b492-cf7c88abef4f service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Received event network-vif-unplugged-e70313a0-8859-4514-b8e8-ec4355e6bd40 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:05:55 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Instance destroyed successfully.
Oct 20 09:05:55 user nova-compute[74039]: DEBUG nova.objects.instance [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lazy-loading 'resources' on Instance uuid e14ecf11-28b6-421d-875f-0ce9a21999d3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1041271003',display_name='tempest-VolumesSnapshotTestJSON-instance-1041271003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1041271003',id=24,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOnEnCoxHMnNpmXJE8iVnHkBMZG06kmzcaVveYLEb2o/YqsiI4cHKfYN2+mwATUaFgAzQG8s/U0vr19SivpKjYHMH2ynafbAxroMjEwKSA1Xs+KWNoS2yN+eUNV8pwPDg==',key_name='tempest-keypair-1877119492',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:01:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40be8c8bc79f4ce2a4857d36ddfe0667',ramdisk_id='',reservation_id='r-vdo3ftgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1434807460',owner_user_name='tempest-VolumesSnapshotTestJSON-1434807460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:01:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3196ef9f3da4311bb896432fbf55ed2',uuid=e14ecf11-28b6-421d-875f-0ce9a21999d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "address": "fa:16:3e:4c:10:22", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70313a0-88", "ovs_interfaceid": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Converting VIF {"id": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "address": "fa:16:3e:4c:10:22", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70313a0-88", "ovs_interfaceid": "e70313a0-8859-4514-b8e8-ec4355e6bd40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:10:22,bridge_name='br-int',has_traffic_filtering=True,id=e70313a0-8859-4514-b8e8-ec4355e6bd40,network=Network(c8baa945-5d9a-4bf8-830d-ab75cf318cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70313a0-88') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG os_vif [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:10:22,bridge_name='br-int',has_traffic_filtering=True,id=e70313a0-8859-4514-b8e8-ec4355e6bd40,network=Network(c8baa945-5d9a-4bf8-830d-ab75cf318cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70313a0-88') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape70313a0-88, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9932013-45a4-4bf4-9c03-3ec8041bb647) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:55 user nova-compute[74039]: INFO os_vif [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:10:22,bridge_name='br-int',has_traffic_filtering=True,id=e70313a0-8859-4514-b8e8-ec4355e6bd40,network=Network(c8baa945-5d9a-4bf8-830d-ab75cf318cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70313a0-88')
Oct 20 09:05:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVNjlEom', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:05:55 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:05:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b263ec29-15ca-43c8-8689-432ed74fe58c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:05:55 user nova-compute[74039]: No targets found.
Oct 20 09:05:55 user nova-compute[74039]: iSNS:
Oct 20 09:05:55 user nova-compute[74039]: No targets found.
Oct 20 09:05:55 user nova-compute[74039]: STATIC:
Oct 20 09:05:55 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1
Oct 20 09:05:55 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:05:55 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:05:55 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84
Oct 20 09:05:55 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:05:55 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:05:55 user nova-compute[74039]: FIRMWARE:
Oct 20 09:05:55 user nova-compute[74039]: No targets found.
Oct 20 09:05:55 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:05:55 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:05:55 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca4bcc71-c61a-49a0-ae06-58300cbc4af5', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abd7e3b-0af4-41a3-82c3-259b3dae6a01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ff2c97-4891-492d-85f4-7b652cd39228]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:05:55 user nova-compute[74039]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:05:55 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:05:55 user nova-compute[74039]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:05:55 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae7c146ef0>, {}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Disconnecting from: [] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] <== disconnect_volume: return (73ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:05:55 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Deleting instance files /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3_del
Oct 20 09:05:55 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Deletion of /opt/stack/data/nova/instances/e14ecf11-28b6-421d-875f-0ce9a21999d3_del complete
Oct 20 09:05:55 user nova-compute[74039]: INFO nova.compute.manager [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 20 09:05:55 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:55 user nova-compute[74039]: INFO nova.compute.manager [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Terminating instance
Oct 20 09:05:55 user nova-compute[74039]: DEBUG nova.compute.manager [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:05:56 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Took 0.94 seconds to deallocate network for instance.
Oct 20 09:05:56 user nova-compute[74039]: WARNING nova.volume.cinder [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Attachment 4ce4eaab-5b46-4087-8328-7c2ab5819af3 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4ce4eaab-5b46-4087-8328-7c2ab5819af3. (HTTP 404) (Request-ID: req-9abb871e-1457-4a4f-8aec-ae21caad3e37)
Oct 20 09:05:56 user nova-compute[74039]: INFO nova.compute.manager [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Took 0.03 seconds to detach 1 volumes for instance.
Oct 20 09:05:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG nova.compute.manager [req-d96e0d5d-17b7-420d-a238-0763df11bda9 req-45186670-3363-4806-a103-44f68a7d4d70 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received event network-vif-unplugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d96e0d5d-17b7-420d-a238-0763df11bda9 req-45186670-3363-4806-a103-44f68a7d4d70 service nova] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d96e0d5d-17b7-420d-a238-0763df11bda9 req-45186670-3363-4806-a103-44f68a7d4d70 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d96e0d5d-17b7-420d-a238-0763df11bda9 req-45186670-3363-4806-a103-44f68a7d4d70 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG nova.compute.manager [req-d96e0d5d-17b7-420d-a238-0763df11bda9 req-45186670-3363-4806-a103-44f68a7d4d70 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] No waiting events found dispatching network-vif-unplugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG nova.compute.manager [req-d96e0d5d-17b7-420d-a238-0763df11bda9 req-45186670-3363-4806-a103-44f68a7d4d70 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received event network-vif-unplugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:05:56 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Instance destroyed successfully.
Oct 20 09:05:56 user nova-compute[74039]: DEBUG nova.objects.instance [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lazy-loading 'resources' on Instance uuid 9fe77a96-fcb5-4410-85cc-58d925548e03 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:48:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1613714497',display_name='tempest-ServerRescueNegativeTestJSON-server-1613714497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1613714497',id=1,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:53:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d74bb65080a343afb5cbcea1b5481938',ramdisk_id='',reservation_id='r-a20rs244',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1580334620',owner_user_name='tempest-ServerRescueNegativeTestJSON-1580334620-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:55:02Z,user_data=None,user_id='4024fa0ccfda49e0a070b9e6166e37ed',uuid=9fe77a96-fcb5-4410-85cc-58d925548e03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "address": "fa:16:3e:63:75:a3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9fe7711-d5", "ovs_interfaceid": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converting VIF {"id": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "address": "fa:16:3e:63:75:a3", "network": {"id": "d18bb3c8-d3e3-4bde-8424-0bedce340de5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1951078754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d74bb65080a343afb5cbcea1b5481938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9fe7711-d5", "ovs_interfaceid": "e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:75:a3,bridge_name='br-int',has_traffic_filtering=True,id=e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9fe7711-d5') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG os_vif [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:75:a3,bridge_name='br-int',has_traffic_filtering=True,id=e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9fe7711-d5') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9fe7711-d5, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6588a3c-00e5-4ee9-a16d-fc067c31e27b) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:56 user nova-compute[74039]: INFO os_vif [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:75:a3,bridge_name='br-int',has_traffic_filtering=True,id=e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7,network=Network(d18bb3c8-d3e3-4bde-8424-0bedce340de5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9fe7711-d5')
Oct 20 09:05:56 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Deleting instance files /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03_del
Oct 20 09:05:56 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Deletion of /opt/stack/data/nova/instances/9fe77a96-fcb5-4410-85cc-58d925548e03_del complete
Oct 20 09:05:56 user nova-compute[74039]: DEBUG nova.compute.manager [req-eef9639e-d51f-4af1-9ad4-da6ae9854f19 req-03389fe9-1af1-4bbb-9c3a-768e8c3f024d service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Received event network-vif-plugged-e70313a0-8859-4514-b8e8-ec4355e6bd40 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eef9639e-d51f-4af1-9ad4-da6ae9854f19 req-03389fe9-1af1-4bbb-9c3a-768e8c3f024d service nova] Acquiring lock "e14ecf11-28b6-421d-875f-0ce9a21999d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eef9639e-d51f-4af1-9ad4-da6ae9854f19 req-03389fe9-1af1-4bbb-9c3a-768e8c3f024d service nova] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eef9639e-d51f-4af1-9ad4-da6ae9854f19 req-03389fe9-1af1-4bbb-9c3a-768e8c3f024d service nova] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG nova.compute.manager [req-eef9639e-d51f-4af1-9ad4-da6ae9854f19 req-03389fe9-1af1-4bbb-9c3a-768e8c3f024d service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] No waiting events found dispatching network-vif-plugged-e70313a0-8859-4514-b8e8-ec4355e6bd40 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:05:56 user nova-compute[74039]: WARNING nova.compute.manager [req-eef9639e-d51f-4af1-9ad4-da6ae9854f19 req-03389fe9-1af1-4bbb-9c3a-768e8c3f024d service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Received unexpected event network-vif-plugged-e70313a0-8859-4514-b8e8-ec4355e6bd40 for instance with vm_state deleted and task_state None.
Oct 20 09:05:56 user nova-compute[74039]: DEBUG nova.compute.manager [req-eef9639e-d51f-4af1-9ad4-da6ae9854f19 req-03389fe9-1af1-4bbb-9c3a-768e8c3f024d service nova] [instance: e14ecf11-28b6-421d-875f-0ce9a21999d3] Received event network-vif-deleted-e70313a0-8859-4514-b8e8-ec4355e6bd40 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:05:56 user nova-compute[74039]: INFO nova.compute.manager [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 20 09:05:56 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:05:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:56 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Deleted allocations for instance e14ecf11-28b6-421d-875f-0ce9a21999d3
Oct 20 09:05:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2d8824b5-32dd-4fd0-8ca4-3fb873559488 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "e14ecf11-28b6-421d-875f-0ce9a21999d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.549s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:57 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:05:57 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Took 0.57 seconds to deallocate network for instance.
Oct 20 09:05:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:57 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:05:57 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:05:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:57 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Deleted allocations for instance 9fe77a96-fcb5-4410-85cc-58d925548e03
Oct 20 09:05:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-511e35eb-6567-49af-a584-796c473f4b9d tempest-ServerRescueNegativeTestJSON-1580334620 tempest-ServerRescueNegativeTestJSON-1580334620-project-member] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.090s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:58 user nova-compute[74039]: DEBUG nova.compute.manager [req-5f4e4811-690f-4869-8a2f-0945e9c6748e req-57f2f4f0-3673-44fa-98fc-1f2158267462 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:05:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5f4e4811-690f-4869-8a2f-0945e9c6748e req-57f2f4f0-3673-44fa-98fc-1f2158267462 service nova] Acquiring lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:05:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5f4e4811-690f-4869-8a2f-0945e9c6748e req-57f2f4f0-3673-44fa-98fc-1f2158267462 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:05:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5f4e4811-690f-4869-8a2f-0945e9c6748e req-57f2f4f0-3673-44fa-98fc-1f2158267462 service nova] Lock "9fe77a96-fcb5-4410-85cc-58d925548e03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:05:58 user nova-compute[74039]: DEBUG nova.compute.manager [req-5f4e4811-690f-4869-8a2f-0945e9c6748e req-57f2f4f0-3673-44fa-98fc-1f2158267462 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] No waiting events found dispatching network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:05:58 user nova-compute[74039]: WARNING nova.compute.manager [req-5f4e4811-690f-4869-8a2f-0945e9c6748e req-57f2f4f0-3673-44fa-98fc-1f2158267462 service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received unexpected event network-vif-plugged-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 for instance with vm_state deleted and task_state None.
Oct 20 09:05:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:05:58 user nova-compute[74039]: DEBUG nova.compute.manager [req-bc3404ec-e2ef-482e-bae7-5a96f48738fb req-446d36c5-6743-4a9e-9865-14d388ccc3ea service nova] [instance: 9fe77a96-fcb5-4410-85cc-58d925548e03] Received event network-vif-deleted-e9fe7711-d5b0-4a7b-bb4e-15acb1b9a7b7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:06:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:02 user nova-compute[74039]: INFO nova.compute.manager [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Terminating instance
Oct 20 09:06:02 user nova-compute[74039]: DEBUG nova.compute.manager [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-09408037-0bc4-4b51-aab8-472746480d32 req-cc912f4c-75ab-4112-8f30-eb27b848f0e1 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received event network-vif-unplugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-09408037-0bc4-4b51-aab8-472746480d32 req-cc912f4c-75ab-4112-8f30-eb27b848f0e1 service nova] Acquiring lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-09408037-0bc4-4b51-aab8-472746480d32 req-cc912f4c-75ab-4112-8f30-eb27b848f0e1 service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-09408037-0bc4-4b51-aab8-472746480d32 req-cc912f4c-75ab-4112-8f30-eb27b848f0e1 service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-09408037-0bc4-4b51-aab8-472746480d32 req-cc912f4c-75ab-4112-8f30-eb27b848f0e1 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] No waiting events found dispatching network-vif-unplugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-09408037-0bc4-4b51-aab8-472746480d32 req-cc912f4c-75ab-4112-8f30-eb27b848f0e1 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received event network-vif-unplugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:06:02 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Instance destroyed successfully.
Oct 20 09:06:02 user nova-compute[74039]: DEBUG nova.objects.instance [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lazy-loading 'resources' on Instance uuid ebaa4804-32e5-4fff-9562-0587ff7ca4ed {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-981664831',display_name='tempest-ServerActionsTestOtherB-server-981664831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-981664831',id=14,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLks5fH3OqnFIJYbiqhEyJYFZHff7b4Ae9JDwAsMmBzcCMiYxaXPw5gTAg3NjSBwdB4e4WBubdaiWR0mkFHpfIFMVWW5rKzlKquVWH/exNlZL5M7mfGJM5jL4+NyXysGbg==',key_name='tempest-keypair-748521120',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:03:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da44286b6f5b45fe9ccbd881754a9b3c',ramdisk_id='',reservation_id='r-2fnz9nzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1010421968',owner_user_name='tempest-ServerActionsTestOtherB-1010421968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:03:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='994701e77d9740f4a7a18390f9438996',uuid=ebaa4804-32e5-4fff-9562-0587ff7ca4ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Converting VIF {"id": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "address": "fa:16:3e:0d:87:c4", "network": {"id": "34168694-012f-4891-aad3-59bf840766d0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1516684708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44286b6f5b45fe9ccbd881754a9b3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7d9d83f-15", "ovs_interfaceid": "e7d9d83f-1522-47f7-ac4c-7dd56facfea7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG os_vif [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7d9d83f-15, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef06564e-fe43-4d1b-841e-8d7fac5c9b42) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:06:03 user nova-compute[74039]: INFO os_vif [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=e7d9d83f-1522-47f7-ac4c-7dd56facfea7,network=Network(34168694-012f-4891-aad3-59bf840766d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7d9d83f-15')
Oct 20 09:06:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZFEAJfq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:06:03 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:06:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bd5aad-e32b-46ea-abc3-d77cdb6184ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:06:03 user nova-compute[74039]: No targets found.
Oct 20 09:06:03 user nova-compute[74039]: iSNS:
Oct 20 09:06:03 user nova-compute[74039]: No targets found.
Oct 20 09:06:03 user nova-compute[74039]: STATIC:
Oct 20 09:06:03 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1
Oct 20 09:06:03 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:06:03 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:06:03 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84
Oct 20 09:06:03 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:06:03 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:06:03 user nova-compute[74039]: FIRMWARE:
Oct 20 09:06:03 user nova-compute[74039]: No targets found.
Oct 20 09:06:03 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:06:03 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:06:03 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be0bab5-db8d-46ba-b9d9-afb660ff7014]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae96f0fa-6e8f-4375-96bd-687094779775]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:06:03 user nova-compute[74039]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:06:03 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 (non-flash)
Oct 20 09:06:03 user nova-compute[74039]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:06:03 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae8456e440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84'): ({'sde'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Removing single pathed devices sde {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a250c4-df71-45a7-a371-36940f4794cb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5986f421-574a-49d8-a7af-052eac84001a]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Flushing IO for device /dev/sde {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a991a41-e797-42c5-944d-752220e5ac2f]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c85c93-3bc5-4562-b0aa-3a311dc2cf1c]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] SCSI volumes sde have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3fc325-deeb-4193-8fc9-32646be44bd1]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae4c3fb-e6cd-415a-8d2f-28cba09aa38b]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260]
Oct 20 09:06:03 user nova-compute[74039]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84, portal: 172.16.0.220,3260] successful.
Oct 20 09:06:03 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fddcdc2d-8bc1-4ba3-90c0-5607af95bc84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[af873f75-2a94-476e-b62f-c5421879f496]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] <== disconnect_volume: return (305ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:06:03 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Deleting instance files /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed_del
Oct 20 09:06:03 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Deletion of /opt/stack/data/nova/instances/ebaa4804-32e5-4fff-9562-0587ff7ca4ed_del complete
Oct 20 09:06:03 user nova-compute[74039]: INFO nova.compute.manager [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 20 09:06:03 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:06:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:04 user nova-compute[74039]: DEBUG nova.compute.manager [req-b4f87769-4d58-4fd6-bd7f-5c4b9b2af7f8 req-f5b39638-340a-4134-aaaa-83f340987ff8 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received event network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:06:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b4f87769-4d58-4fd6-bd7f-5c4b9b2af7f8 req-f5b39638-340a-4134-aaaa-83f340987ff8 service nova] Acquiring lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b4f87769-4d58-4fd6-bd7f-5c4b9b2af7f8 req-f5b39638-340a-4134-aaaa-83f340987ff8 service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b4f87769-4d58-4fd6-bd7f-5c4b9b2af7f8 req-f5b39638-340a-4134-aaaa-83f340987ff8 service nova] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:04 user nova-compute[74039]: DEBUG nova.compute.manager [req-b4f87769-4d58-4fd6-bd7f-5c4b9b2af7f8 req-f5b39638-340a-4134-aaaa-83f340987ff8 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] No waiting events found dispatching network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:06:04 user nova-compute[74039]: WARNING nova.compute.manager [req-b4f87769-4d58-4fd6-bd7f-5c4b9b2af7f8 req-f5b39638-340a-4134-aaaa-83f340987ff8 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received unexpected event network-vif-plugged-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 for instance with vm_state active and task_state deleting.
Oct 20 09:06:04 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:06:04 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Took 1.31 seconds to deallocate network for instance.
Oct 20 09:06:04 user nova-compute[74039]: DEBUG nova.compute.manager [req-7a17d4d7-59a2-4d92-93eb-15b757641606 req-f3c02a98-4f9d-4af2-aacf-e8aa7472a461 service nova] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Received event network-vif-deleted-e7d9d83f-1522-47f7-ac4c-7dd56facfea7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:06:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d0f3cbd2-450d-46a3-a169-1c000904196e tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "00e09d93-3077-4770-abfd-b82ece646997" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d0f3cbd2-450d-46a3-a169-1c000904196e tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "00e09d93-3077-4770-abfd-b82ece646997" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:05 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d0f3cbd2-450d-46a3-a169-1c000904196e tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Going to confirm migration 2 {{(pid=74039) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 20 09:06:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:05 user nova-compute[74039]: INFO nova.compute.manager [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] [instance: ebaa4804-32e5-4fff-9562-0587ff7ca4ed] Took 0.83 seconds to detach 1 volumes for instance.
Oct 20 09:06:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d0f3cbd2-450d-46a3-a169-1c000904196e tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:06:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d0f3cbd2-450d-46a3-a169-1c000904196e tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquired lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:06:05 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d0f3cbd2-450d-46a3-a169-1c000904196e tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:06:05 user nova-compute[74039]: DEBUG nova.objects.instance [None req-d0f3cbd2-450d-46a3-a169-1c000904196e tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lazy-loading 'info_cache' on Instance uuid 00e09d93-3077-4770-abfd-b82ece646997 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:06:05 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:06:05 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:06:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:05 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Deleted allocations for instance ebaa4804-32e5-4fff-9562-0587ff7ca4ed
Oct 20 09:06:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-23de0806-ebde-4b0b-93ec-c60908a7b6ff tempest-ServerActionsTestOtherB-1010421968 tempest-ServerActionsTestOtherB-1010421968-project-member] Lock "ebaa4804-32e5-4fff-9562-0587ff7ca4ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.810s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:06 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d0f3cbd2-450d-46a3-a169-1c000904196e tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Updating instance_info_cache with network_info: [{"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:06:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d0f3cbd2-450d-46a3-a169-1c000904196e tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Releasing lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:06:06 user nova-compute[74039]: DEBUG nova.objects.instance [None req-d0f3cbd2-450d-46a3-a169-1c000904196e tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lazy-loading 'migration_context' on Instance uuid 00e09d93-3077-4770-abfd-b82ece646997 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:06:06 user nova-compute[74039]: DEBUG nova.objects.base [None req-d0f3cbd2-450d-46a3-a169-1c000904196e tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Object Instance<00e09d93-3077-4770-abfd-b82ece646997> lazy-loaded attributes: info_cache,migration_context {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:06:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d0f3cbd2-450d-46a3-a169-1c000904196e tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d0f3cbd2-450d-46a3-a169-1c000904196e tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:06 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-d0f3cbd2-450d-46a3-a169-1c000904196e tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:06:06 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-d0f3cbd2-450d-46a3-a169-1c000904196e tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:06:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d0f3cbd2-450d-46a3-a169-1c000904196e tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.454s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:06 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-d0f3cbd2-450d-46a3-a169-1c000904196e tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Deleted allocation for migration 2b9c803f-f223-4920-ae16-5e8bcf7f1c91
Oct 20 09:06:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d0f3cbd2-450d-46a3-a169-1c000904196e tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "00e09d93-3077-4770-abfd-b82ece646997" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.400s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Acquiring lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:12 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:06:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:12 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:06:12 user nova-compute[74039]: INFO nova.compute.claims [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Claim successful on node user
Oct 20 09:06:12 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:06:12 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:06:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:12 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:06:12 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:06:12 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:06:12 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:06:12 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:06:12 user nova-compute[74039]: DEBUG nova.policy [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e48d8af744fc47b682bacfd9015a6870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7cf35e8d8cb41f98f3de737ff544a74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:06:13 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Creating image(s)
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Acquiring lock "/opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Lock "/opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Lock "/opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.192s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Successfully created port: f786f476-35e0-47de-b484-f8cb3e051827 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.191s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4/disk 1073741824" returned: 0 in 0.053s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Cannot resize image /opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Ensure instance console log exists: /opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Successfully updated port: f786f476-35e0-47de-b484-f8cb3e051827 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Acquiring lock "refresh_cache-a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Acquired lock "refresh_cache-a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-60f08cbd-9086-4b52-a7ce-f03e162bf0ee req-cd32b3de-ab54-42e1-8ad9-04bcf6d9dd2b service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Received event network-changed-f786f476-35e0-47de-b484-f8cb3e051827 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-60f08cbd-9086-4b52-a7ce-f03e162bf0ee req-cd32b3de-ab54-42e1-8ad9-04bcf6d9dd2b service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Refreshing instance network info cache due to event network-changed-f786f476-35e0-47de-b484-f8cb3e051827. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:06:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-60f08cbd-9086-4b52-a7ce-f03e162bf0ee req-cd32b3de-ab54-42e1-8ad9-04bcf6d9dd2b service nova] Acquiring lock "refresh_cache-a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Updating instance_info_cache with network_info: [{"id": "f786f476-35e0-47de-b484-f8cb3e051827", "address": "fa:16:3e:08:4f:03", "network": {"id": "0b8f3326-2b1d-4695-aa87-f83e69019ecd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2001819388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7cf35e8d8cb41f98f3de737ff544a74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf786f476-35", "ovs_interfaceid": "f786f476-35e0-47de-b484-f8cb3e051827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Releasing lock "refresh_cache-a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Instance network_info: |[{"id": "f786f476-35e0-47de-b484-f8cb3e051827", "address": "fa:16:3e:08:4f:03", "network": {"id": "0b8f3326-2b1d-4695-aa87-f83e69019ecd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2001819388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7cf35e8d8cb41f98f3de737ff544a74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf786f476-35", "ovs_interfaceid": "f786f476-35e0-47de-b484-f8cb3e051827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-60f08cbd-9086-4b52-a7ce-f03e162bf0ee req-cd32b3de-ab54-42e1-8ad9-04bcf6d9dd2b service nova] Acquired lock "refresh_cache-a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.network.neutron [req-60f08cbd-9086-4b52-a7ce-f03e162bf0ee req-cd32b3de-ab54-42e1-8ad9-04bcf6d9dd2b service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Refreshing network info cache for port f786f476-35e0-47de-b484-f8cb3e051827 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Start _get_guest_xml network_info=[{"id": "f786f476-35e0-47de-b484-f8cb3e051827", "address": "fa:16:3e:08:4f:03", "network": {"id": "0b8f3326-2b1d-4695-aa87-f83e69019ecd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2001819388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7cf35e8d8cb41f98f3de737ff544a74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf786f476-35", "ovs_interfaceid": "f786f476-35e0-47de-b484-f8cb3e051827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:06:14 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:06:14 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1228966317',display_name='tempest-VolumesActionsTest-instance-1228966317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1228966317',id=32,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7cf35e8d8cb41f98f3de737ff544a74',ramdisk_id='',reservation_id='r-pahuo5h9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-228152859',owner_user_name='tempest-VolumesActionsTest-228152859-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:06:13Z,user_data=None,user_id='e48d8af744fc47b682bacfd9015a6870',uuid=a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f786f476-35e0-47de-b484-f8cb3e051827", "address": "fa:16:3e:08:4f:03", "network": {"id": "0b8f3326-2b1d-4695-aa87-f83e69019ecd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2001819388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7cf35e8d8cb41f98f3de737ff544a74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf786f476-35", "ovs_interfaceid": "f786f476-35e0-47de-b484-f8cb3e051827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Converting VIF {"id": "f786f476-35e0-47de-b484-f8cb3e051827", "address": "fa:16:3e:08:4f:03", "network": {"id": "0b8f3326-2b1d-4695-aa87-f83e69019ecd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2001819388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7cf35e8d8cb41f98f3de737ff544a74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf786f476-35", "ovs_interfaceid": "f786f476-35e0-47de-b484-f8cb3e051827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:4f:03,bridge_name='br-int',has_traffic_filtering=True,id=f786f476-35e0-47de-b484-f8cb3e051827,network=Network(0b8f3326-2b1d-4695-aa87-f83e69019ecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf786f476-35') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.objects.instance [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Lazy-loading 'pci_devices' on Instance uuid a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:06:14 user nova-compute[74039]:   <uuid>a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4</uuid>
Oct 20 09:06:14 user nova-compute[74039]:   <name>instance-00000020</name>
Oct 20 09:06:14 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:06:14 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:06:14 user nova-compute[74039]:   <metadata>
Oct 20 09:06:14 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:06:14 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:06:14 user nova-compute[74039]:       <nova:name>tempest-VolumesActionsTest-instance-1228966317</nova:name>
Oct 20 09:06:14 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:06:14</nova:creationTime>
Oct 20 09:06:14 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:06:14 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:06:14 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:06:14 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:06:14 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:06:14 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:06:14 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:06:14 user nova-compute[74039]:       <nova:owner>
Oct 20 09:06:14 user nova-compute[74039]:         <nova:user uuid="e48d8af744fc47b682bacfd9015a6870">tempest-VolumesActionsTest-228152859-project-member</nova:user>
Oct 20 09:06:14 user nova-compute[74039]:         <nova:project uuid="e7cf35e8d8cb41f98f3de737ff544a74">tempest-VolumesActionsTest-228152859</nova:project>
Oct 20 09:06:14 user nova-compute[74039]:       </nova:owner>
Oct 20 09:06:14 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:06:14 user nova-compute[74039]:       <nova:ports>
Oct 20 09:06:14 user nova-compute[74039]:         <nova:port uuid="f786f476-35e0-47de-b484-f8cb3e051827">
Oct 20 09:06:14 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 09:06:14 user nova-compute[74039]:         </nova:port>
Oct 20 09:06:14 user nova-compute[74039]:       </nova:ports>
Oct 20 09:06:14 user nova-compute[74039]:     </nova:instance>
Oct 20 09:06:14 user nova-compute[74039]:   </metadata>
Oct 20 09:06:14 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:06:14 user nova-compute[74039]:     <system>
Oct 20 09:06:14 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:06:14 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:06:14 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:06:14 user nova-compute[74039]:       <entry name="serial">a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4</entry>
Oct 20 09:06:14 user nova-compute[74039]:       <entry name="uuid">a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4</entry>
Oct 20 09:06:14 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:06:14 user nova-compute[74039]:     </system>
Oct 20 09:06:14 user nova-compute[74039]:   </sysinfo>
Oct 20 09:06:14 user nova-compute[74039]:   <os>
Oct 20 09:06:14 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:06:14 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:06:14 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:06:14 user nova-compute[74039]:   </os>
Oct 20 09:06:14 user nova-compute[74039]:   <features>
Oct 20 09:06:14 user nova-compute[74039]:     <acpi/>
Oct 20 09:06:14 user nova-compute[74039]:     <apic/>
Oct 20 09:06:14 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:06:14 user nova-compute[74039]:   </features>
Oct 20 09:06:14 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:06:14 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:06:14 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:06:14 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:06:14 user nova-compute[74039]:   </clock>
Oct 20 09:06:14 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:06:14 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:06:14 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:06:14 user nova-compute[74039]:   </cpu>
Oct 20 09:06:14 user nova-compute[74039]:   <devices>
Oct 20 09:06:14 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:06:14 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:06:14 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4/disk"/>
Oct 20 09:06:14 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:06:14 user nova-compute[74039]:     </disk>
Oct 20 09:06:14 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:06:14 user nova-compute[74039]:       <mac address="fa:16:3e:08:4f:03"/>
Oct 20 09:06:14 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:06:14 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:06:14 user nova-compute[74039]:       <target dev="tapf786f476-35"/>
Oct 20 09:06:14 user nova-compute[74039]:     </interface>
Oct 20 09:06:14 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:06:14 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4/console.log" append="off"/>
Oct 20 09:06:14 user nova-compute[74039]:     </serial>
Oct 20 09:06:14 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:06:14 user nova-compute[74039]:     <video>
Oct 20 09:06:14 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:06:14 user nova-compute[74039]:     </video>
Oct 20 09:06:14 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:06:14 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:06:14 user nova-compute[74039]:     </rng>
Oct 20 09:06:14 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:06:14 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:06:14 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:06:14 user nova-compute[74039]:     </memballoon>
Oct 20 09:06:14 user nova-compute[74039]:   </devices>
Oct 20 09:06:14 user nova-compute[74039]: </domain>
Oct 20 09:06:14 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1228966317',display_name='tempest-VolumesActionsTest-instance-1228966317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1228966317',id=32,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7cf35e8d8cb41f98f3de737ff544a74',ramdisk_id='',reservation_id='r-pahuo5h9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-228152859',owner_user_name='tempest-VolumesActionsTest-228152859-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:06:13Z,user_data=None,user_id='e48d8af744fc47b682bacfd9015a6870',uuid=a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f786f476-35e0-47de-b484-f8cb3e051827", "address": "fa:16:3e:08:4f:03", "network": {"id": "0b8f3326-2b1d-4695-aa87-f83e69019ecd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2001819388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7cf35e8d8cb41f98f3de737ff544a74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf786f476-35", "ovs_interfaceid": "f786f476-35e0-47de-b484-f8cb3e051827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Converting VIF {"id": "f786f476-35e0-47de-b484-f8cb3e051827", "address": "fa:16:3e:08:4f:03", "network": {"id": "0b8f3326-2b1d-4695-aa87-f83e69019ecd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2001819388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7cf35e8d8cb41f98f3de737ff544a74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf786f476-35", "ovs_interfaceid": "f786f476-35e0-47de-b484-f8cb3e051827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:4f:03,bridge_name='br-int',has_traffic_filtering=True,id=f786f476-35e0-47de-b484-f8cb3e051827,network=Network(0b8f3326-2b1d-4695-aa87-f83e69019ecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf786f476-35') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG os_vif [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:4f:03,bridge_name='br-int',has_traffic_filtering=True,id=f786f476-35e0-47de-b484-f8cb3e051827,network=Network(0b8f3326-2b1d-4695-aa87-f83e69019ecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf786f476-35') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'edad9812-fbc0-5c5d-8587-7cf33fa354a6', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf786f476-35, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf786f476-35, col_values=(('qos', UUID('1ded56c8-7a3a-4c0a-b3a0-e23cdfee65c6')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf786f476-35, col_values=(('external_ids', {'iface-id': 'f786f476-35e0-47de-b484-f8cb3e051827', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:4f:03', 'vm-uuid': 'a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:14 user nova-compute[74039]: INFO os_vif [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:4f:03,bridge_name='br-int',has_traffic_filtering=True,id=f786f476-35e0-47de-b484-f8cb3e051827,network=Network(0b8f3326-2b1d-4695-aa87-f83e69019ecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf786f476-35')
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] No VIF found with MAC fa:16:3e:08:4f:03, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.compute.manager [req-2117521e-85e4-4f47-98d1-b727bc69ec05 req-272a225b-d350-4263-b2ee-162ec7ac8f99 service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Received event network-changed-fe70147e-8713-4dd0-8d30-16aca37e8433 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.compute.manager [req-2117521e-85e4-4f47-98d1-b727bc69ec05 req-272a225b-d350-4263-b2ee-162ec7ac8f99 service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Refreshing instance network info cache due to event network-changed-fe70147e-8713-4dd0-8d30-16aca37e8433. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2117521e-85e4-4f47-98d1-b727bc69ec05 req-272a225b-d350-4263-b2ee-162ec7ac8f99 service nova] Acquiring lock "refresh_cache-f470b048-6069-425e-b3f9-65d538674321" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2117521e-85e4-4f47-98d1-b727bc69ec05 req-272a225b-d350-4263-b2ee-162ec7ac8f99 service nova] Acquired lock "refresh_cache-f470b048-6069-425e-b3f9-65d538674321" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.network.neutron [req-2117521e-85e4-4f47-98d1-b727bc69ec05 req-272a225b-d350-4263-b2ee-162ec7ac8f99 service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Refreshing network info cache for port fe70147e-8713-4dd0-8d30-16aca37e8433 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.network.neutron [req-60f08cbd-9086-4b52-a7ce-f03e162bf0ee req-cd32b3de-ab54-42e1-8ad9-04bcf6d9dd2b service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Updated VIF entry in instance network info cache for port f786f476-35e0-47de-b484-f8cb3e051827. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.network.neutron [req-60f08cbd-9086-4b52-a7ce-f03e162bf0ee req-cd32b3de-ab54-42e1-8ad9-04bcf6d9dd2b service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Updating instance_info_cache with network_info: [{"id": "f786f476-35e0-47de-b484-f8cb3e051827", "address": "fa:16:3e:08:4f:03", "network": {"id": "0b8f3326-2b1d-4695-aa87-f83e69019ecd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2001819388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7cf35e8d8cb41f98f3de737ff544a74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf786f476-35", "ovs_interfaceid": "f786f476-35e0-47de-b484-f8cb3e051827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-60f08cbd-9086-4b52-a7ce-f03e162bf0ee req-cd32b3de-ab54-42e1-8ad9-04bcf6d9dd2b service nova] Releasing lock "refresh_cache-a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.network.neutron [req-2117521e-85e4-4f47-98d1-b727bc69ec05 req-272a225b-d350-4263-b2ee-162ec7ac8f99 service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Updated VIF entry in instance network info cache for port fe70147e-8713-4dd0-8d30-16aca37e8433. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG nova.network.neutron [req-2117521e-85e4-4f47-98d1-b727bc69ec05 req-272a225b-d350-4263-b2ee-162ec7ac8f99 service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Updating instance_info_cache with network_info: [{"id": "fe70147e-8713-4dd0-8d30-16aca37e8433", "address": "fa:16:3e:b0:e1:65", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe70147e-87", "ovs_interfaceid": "fe70147e-8713-4dd0-8d30-16aca37e8433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:06:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2117521e-85e4-4f47-98d1-b727bc69ec05 req-272a225b-d350-4263-b2ee-162ec7ac8f99 service nova] Releasing lock "refresh_cache-f470b048-6069-425e-b3f9-65d538674321" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:06:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:16 user nova-compute[74039]: DEBUG nova.compute.manager [req-7e6d1bd2-e7e2-427d-94b4-d9b6eec2999c req-517626f4-7758-42e8-87d4-253fdc2e303a service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Received event network-vif-plugged-f786f476-35e0-47de-b484-f8cb3e051827 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:06:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7e6d1bd2-e7e2-427d-94b4-d9b6eec2999c req-517626f4-7758-42e8-87d4-253fdc2e303a service nova] Acquiring lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7e6d1bd2-e7e2-427d-94b4-d9b6eec2999c req-517626f4-7758-42e8-87d4-253fdc2e303a service nova] Lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7e6d1bd2-e7e2-427d-94b4-d9b6eec2999c req-517626f4-7758-42e8-87d4-253fdc2e303a service nova] Lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:16 user nova-compute[74039]: DEBUG nova.compute.manager [req-7e6d1bd2-e7e2-427d-94b4-d9b6eec2999c req-517626f4-7758-42e8-87d4-253fdc2e303a service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] No waiting events found dispatching network-vif-plugged-f786f476-35e0-47de-b484-f8cb3e051827 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:06:16 user nova-compute[74039]: WARNING nova.compute.manager [req-7e6d1bd2-e7e2-427d-94b4-d9b6eec2999c req-517626f4-7758-42e8-87d4-253fdc2e303a service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Received unexpected event network-vif-plugged-f786f476-35e0-47de-b484-f8cb3e051827 for instance with vm_state building and task_state spawning.
Oct 20 09:06:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:17 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:06:17 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:06:18 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Instance spawned successfully.
Oct 20 09:06:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:06:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:06:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:06:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:06:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:06:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:06:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:06:18 user nova-compute[74039]: INFO nova.compute.manager [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Took 5.11 seconds to spawn the instance on the hypervisor.
Oct 20 09:06:18 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:06:18 user nova-compute[74039]: DEBUG nova.compute.manager [req-73808fcd-4be9-4d5c-b097-0b52aefcf2b6 req-504961ba-a025-4b14-b161-26680ac885e7 service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Received event network-vif-plugged-f786f476-35e0-47de-b484-f8cb3e051827 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:06:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-73808fcd-4be9-4d5c-b097-0b52aefcf2b6 req-504961ba-a025-4b14-b161-26680ac885e7 service nova] Acquiring lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-73808fcd-4be9-4d5c-b097-0b52aefcf2b6 req-504961ba-a025-4b14-b161-26680ac885e7 service nova] Lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-73808fcd-4be9-4d5c-b097-0b52aefcf2b6 req-504961ba-a025-4b14-b161-26680ac885e7 service nova] Lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:18 user nova-compute[74039]: DEBUG nova.compute.manager [req-73808fcd-4be9-4d5c-b097-0b52aefcf2b6 req-504961ba-a025-4b14-b161-26680ac885e7 service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] No waiting events found dispatching network-vif-plugged-f786f476-35e0-47de-b484-f8cb3e051827 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:06:18 user nova-compute[74039]: WARNING nova.compute.manager [req-73808fcd-4be9-4d5c-b097-0b52aefcf2b6 req-504961ba-a025-4b14-b161-26680ac885e7 service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Received unexpected event network-vif-plugged-f786f476-35e0-47de-b484-f8cb3e051827 for instance with vm_state building and task_state spawning.
Oct 20 09:06:18 user nova-compute[74039]: INFO nova.compute.manager [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Took 5.91 seconds to build instance.
Oct 20 09:06:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ee5a5664-ee4f-48c4-876a-8d58b507e370 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.012s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "f470b048-6069-425e-b3f9-65d538674321" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "f470b048-6069-425e-b3f9-65d538674321" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:20 user nova-compute[74039]: DEBUG nova.objects.instance [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lazy-loading 'flavor' on Instance uuid f470b048-6069-425e-b3f9-65d538674321 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:06:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "f470b048-6069-425e-b3f9-65d538674321" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "f470b048-6069-425e-b3f9-65d538674321" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "f470b048-6069-425e-b3f9-65d538674321" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:21 user nova-compute[74039]: INFO nova.compute.manager [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Attaching volume ea23f218-2aa1-4ff3-b775-a681c2706581 to /dev/vdb
Oct 20 09:06:21 user nova-compute[74039]: DEBUG os_brick.utils [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb74a0f-1a9f-44fc-b5ea-684dc7281cf9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafa95e5-cf73-4ca3-8904-f6c310ee910e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[211dc8ca-1b48-44a6-b701-18351fb4ab9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcb3fe2-f381-49cb-8291-708bb8a675c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:06:21 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:06:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[af503c83-d096-4993-910a-35d9921c0f69]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG os_brick.utils [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:06:21 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Updating existing volume attachment record: 3ca9ce22-8ecd-4a76-8521-42f4b0d5353b {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:06:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:26 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:06:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:06:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Rebuilding the list of instances to heal {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 09:06:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:06:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:06:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:06:26 user nova-compute[74039]: DEBUG nova.objects.instance [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lazy-loading 'info_cache' on Instance uuid 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:06:27 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Updating instance_info_cache with network_info: [{"id": "708d272c-3434-4525-bcbd-3ee50e71eb47", "address": "fa:16:3e:3f:80:75", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708d272c-34", "ovs_interfaceid": "708d272c-3434-4525-bcbd-3ee50e71eb47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:06:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-336eb423-89bd-4e51-a2ca-efdc6ded0bf3" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:06:27 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:06:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:06:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:06:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:06:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:06:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:06:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:06:27 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:06:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:30 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:06:33 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:06:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:35 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:06:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:35 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:06:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:06:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:39 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:06:39 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7383MB free_disk=25.376941680908203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.compute.manager [req-0a7512d2-7711-4386-9b25-457a3808a513 req-0948c9a6-5edc-4bff-ad4a-1cc2b130083a service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Received event network-changed-a08cc444-8f39-47df-b452-7c1cb4c951ad {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.compute.manager [req-0a7512d2-7711-4386-9b25-457a3808a513 req-0948c9a6-5edc-4bff-ad4a-1cc2b130083a service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Refreshing instance network info cache due to event network-changed-a08cc444-8f39-47df-b452-7c1cb4c951ad. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0a7512d2-7711-4386-9b25-457a3808a513 req-0948c9a6-5edc-4bff-ad4a-1cc2b130083a service nova] Acquiring lock "refresh_cache-f53c3766-e463-42b1-acd8-f27c3ba2b0ce" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0a7512d2-7711-4386-9b25-457a3808a513 req-0948c9a6-5edc-4bff-ad4a-1cc2b130083a service nova] Acquired lock "refresh_cache-f53c3766-e463-42b1-acd8-f27c3ba2b0ce" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.network.neutron [req-0a7512d2-7711-4386-9b25-457a3808a513 req-0948c9a6-5edc-4bff-ad4a-1cc2b130083a service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Refreshing network info cache for port a08cc444-8f39-47df-b452-7c1cb4c951ad {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4f5d98e3-c1f6-4617-8847-b975e2c23990 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 00e09d93-3077-4770-abfd-b82ece646997 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance f470b048-6069-425e-b3f9-65d538674321 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance eca753ae-f542-431d-bb70-197394e6c566 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance f53c3766-e463-42b1-acd8-f27c3ba2b0ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance f9470b11-57ae-49bb-a6c5-c0d971a767a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.network.neutron [req-0a7512d2-7711-4386-9b25-457a3808a513 req-0948c9a6-5edc-4bff-ad4a-1cc2b130083a service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Updated VIF entry in instance network info cache for port a08cc444-8f39-47df-b452-7c1cb4c951ad. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.network.neutron [req-0a7512d2-7711-4386-9b25-457a3808a513 req-0948c9a6-5edc-4bff-ad4a-1cc2b130083a service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Updating instance_info_cache with network_info: [{"id": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "address": "fa:16:3e:f8:a4:cd", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa08cc444-8f", "ovs_interfaceid": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0a7512d2-7711-4386-9b25-457a3808a513 req-0948c9a6-5edc-4bff-ad4a-1cc2b130083a service nova] Releasing lock "refresh_cache-f53c3766-e463-42b1-acd8-f27c3ba2b0ce" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG nova.objects.instance [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lazy-loading 'flavor' on Instance uuid f53c3766-e463-42b1-acd8-f27c3ba2b0ce {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:06:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:40 user nova-compute[74039]: INFO nova.compute.manager [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Attaching volume 413350b4-1790-46f2-a735-ceb9a4f32163 to /dev/vdb
Oct 20 09:06:40 user nova-compute[74039]: DEBUG os_brick.utils [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[231b7784-c83f-4556-99f3-133dcd9c2876]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c98bac-c0d0-45ea-b55d-715e0a9911d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[486dbefa-8b04-480a-ab90-2a9547e9a58c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7491899a-caa2-4313-a354-011c8f118ba5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:06:40 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:06:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d0878c-87ef-4744-bc86-ca55b88f5410]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG os_brick.utils [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:06:40 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Updating existing volume attachment record: 521e5286-6e07-4214-895f-84ec039a7ed0 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "eca753ae-f542-431d-bb70-197394e6c566" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "eca753ae-f542-431d-bb70-197394e6c566" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG nova.objects.instance [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lazy-loading 'flavor' on Instance uuid eca753ae-f542-431d-bb70-197394e6c566 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "eca753ae-f542-431d-bb70-197394e6c566" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "eca753ae-f542-431d-bb70-197394e6c566" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "eca753ae-f542-431d-bb70-197394e6c566" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:42 user nova-compute[74039]: INFO nova.compute.manager [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Attaching volume 2d1323e8-966f-4604-8f89-6816b404bd0f to /dev/vdb
Oct 20 09:06:42 user nova-compute[74039]: DEBUG os_brick.utils [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1908c29-d211-4ee3-9da6-1b59f2fe3faa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3b4dca-c052-49ac-b2ba-f598a960339a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c6ea1c-ae10-4b59-8fdc-db21f35c5dbc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f52b56-47f0-4964-84e2-aa30e40c8be9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:06:42 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:06:42 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9abff5-d096-4720-8077-669931119133]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG os_brick.utils [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:06:42 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Updating existing volume attachment record: 8768066c-29ed-4741-abdb-dcd6bb03da10 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:06:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XAYQTjWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:06:46 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:06:46 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:06:46 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2202e241-10df-4f11-b0ae-18c920591ad0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:06:46 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd9b037-a2fe-4919-ae9a-db1f2d48a1c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581] added
Oct 20 09:06:46 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0e2cf0-6393-4c80-b54b-8de31f1147e1]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b246471a-f72d-45db-8a9f-c913d81030db]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XAYQTjWK {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XAYQTjWK" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[130626d5-40b9-47a6-a2cc-0096f32eedb3]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XAYQTjWK'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0051fb72-992d-4c30-b640-5a737043771a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd5852b-8daa-4728-93fb-ad5ddafb80e9]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:06:46 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:06:46 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[29309fcf-e8f1-4f4e-be5b-af20fb7c1af7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581, portal: 172.16.0.220,3260]
Oct 20 09:06:46 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581, portal: 172.16.0.220,3260] successful.
Oct 20 09:06:46 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[119c1217-43d7-4e76-838c-c07a6755b7cc]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2662c190-d032-4a1f-a89d-0c96bf9f3c9f]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:06:46 user nova-compute[74039]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 (non-flash)
Oct 20 09:06:46 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:06:46 user nova-compute[74039]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 (non-flash)
Oct 20 09:06:46 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcf514b-3052-4aed-9115-34b8014beb9f]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:46 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: None {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:06:47 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:06:47 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XAYQTjWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:06:47 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:06:47 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23237616139343133', 'path': '/dev/sdb'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:06:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237616139343133', 'path': '/dev/sdb'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:06:47 user nova-compute[74039]: DEBUG nova.objects.instance [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lazy-loading 'flavor' on Instance uuid f470b048-6069-425e-b3f9-65d538674321 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:06:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 09:06:47 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:06:47 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 09:06:47 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:06:47 user nova-compute[74039]:   <serial>ea23f218-2aa1-4ff3-b775-a681c2706581</serial>
Oct 20 09:06:47 user nova-compute[74039]: </disk>
Oct 20 09:06:47 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 09:06:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:06:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:06:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] No VIF found with MAC fa:16:3e:b0:e1:65, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:06:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-1a6e2f1f-5cf8-4eee-83ff-e55863f53259 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "f470b048-6069-425e-b3f9-65d538674321" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.214s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "f470b048-6069-425e-b3f9-65d538674321" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "f470b048-6069-425e-b3f9-65d538674321" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:49 user nova-compute[74039]: INFO nova.compute.manager [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Detaching volume ea23f218-2aa1-4ff3-b775-a681c2706581
Oct 20 09:06:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:49 user nova-compute[74039]: INFO nova.virt.block_device [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Attempting to driver detach volume ea23f218-2aa1-4ff3-b775-a681c2706581 from mountpoint /dev/vdb
Oct 20 09:06:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Attempting to detach device vdb from instance f470b048-6069-425e-b3f9-65d538674321 from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 09:06:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:06:49 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:06:49 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 09:06:49 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:06:49 user nova-compute[74039]:   <serial>ea23f218-2aa1-4ff3-b775-a681c2706581</serial>
Oct 20 09:06:49 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:06:49 user nova-compute[74039]: </disk>
Oct 20 09:06:49 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:06:49 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Successfully detached device vdb from instance f470b048-6069-425e-b3f9-65d538674321 from the persistent domain config.
Oct 20 09:06:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f470b048-6069-425e-b3f9-65d538674321 from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 09:06:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:06:49 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:06:49 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 09:06:49 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:06:49 user nova-compute[74039]:   <serial>ea23f218-2aa1-4ff3-b775-a681c2706581</serial>
Oct 20 09:06:49 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:06:49 user nova-compute[74039]: </disk>
Oct 20 09:06:49 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:06:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f470b048-6069-425e-b3f9-65d538674321 {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 09:06:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTmMNhPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:06:58 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:06:58 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:06:58 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a442867-46d4-410c-ba34-4706f9f91c28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:06:58 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd68796-c568-4478-8dd9-a72f794fcd8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163] added
Oct 20 09:06:58 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc32b42-ec82-49c6-b21f-2b98e5845025]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b293c180-b082-489f-91ba-40e4b97b0e67]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTmMNhPy {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTmMNhPy" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3fcc7c-54f0-4760-b746-d53aff54fa80]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qTmMNhPy'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcb56b1-92e0-41e7-8971-ca98ca41b7ce]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1e60b9-f509-444c-8da2-786158169490]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:06:58 user nova-compute[74039]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 (non-flash)
Oct 20 09:06:58 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:06:58 user nova-compute[74039]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 (non-flash)
Oct 20 09:06:58 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d251016e-54b8-42fb-845d-95abd089aba1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163, portal: 172.16.0.220,3260]
Oct 20 09:06:58 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163, portal: 172.16.0.220,3260] successful.
Oct 20 09:06:58 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3b7dae-670e-4695-befb-3411ecf96f95]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ac0125-b68a-4742-b809-b8e81689f2d5]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:06:58 user nova-compute[74039]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 (non-flash)
Oct 20 09:06:58 user nova-compute[74039]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 (non-flash)
Oct 20 09:06:58 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:06:58 user nova-compute[74039]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 (non-flash)
Oct 20 09:06:58 user nova-compute[74039]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 (non-flash)
Oct 20 09:06:58 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabb8f61-2532-4426-8b8e-01c519c9688c]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: None {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:06:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:06:59 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:06:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTmMNhPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:06:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:06:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23537376661383736', 'path': '/dev/sdc'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:06:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537376661383736', 'path': '/dev/sdc'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:06:59 user nova-compute[74039]: DEBUG nova.objects.instance [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lazy-loading 'flavor' on Instance uuid f53c3766-e463-42b1-acd8-f27c3ba2b0ce {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:06:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 09:06:59 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:06:59 user nova-compute[74039]:   <source dev="/dev/sdc"/>
Oct 20 09:06:59 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:06:59 user nova-compute[74039]:   <serial>413350b4-1790-46f2-a735-ceb9a4f32163</serial>
Oct 20 09:06:59 user nova-compute[74039]: </disk>
Oct 20 09:06:59 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 09:06:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Acquiring lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Acquiring lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:06:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:06:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:06:59 user nova-compute[74039]: INFO nova.compute.manager [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Terminating instance
Oct 20 09:06:59 user nova-compute[74039]: DEBUG nova.compute.manager [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] No VIF found with MAC fa:16:3e:f8:a4:cd, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-688d4eb2-a954-40fe-9132-05ba173e44ae req-b8a7ba96-89a0-4fea-a89f-d2419b4e44a3 service nova] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Received event network-vif-unplugged-864c614d-53f7-4160-93bf-17034231048b {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-688d4eb2-a954-40fe-9132-05ba173e44ae req-b8a7ba96-89a0-4fea-a89f-d2419b4e44a3 service nova] Acquiring lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-688d4eb2-a954-40fe-9132-05ba173e44ae req-b8a7ba96-89a0-4fea-a89f-d2419b4e44a3 service nova] Lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-688d4eb2-a954-40fe-9132-05ba173e44ae req-b8a7ba96-89a0-4fea-a89f-d2419b4e44a3 service nova] Lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-688d4eb2-a954-40fe-9132-05ba173e44ae req-b8a7ba96-89a0-4fea-a89f-d2419b4e44a3 service nova] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] No waiting events found dispatching network-vif-unplugged-864c614d-53f7-4160-93bf-17034231048b {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-688d4eb2-a954-40fe-9132-05ba173e44ae req-b8a7ba96-89a0-4fea-a89f-d2419b4e44a3 service nova] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Received event network-vif-unplugged-864c614d-53f7-4160-93bf-17034231048b for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-17a56bd2-2b11-4209-bb37-f9f2b3b85b92 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.270s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpwjWhiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:07:00 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:07:00 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:07:00 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a95e471-2438-40ec-8686-ce85b714b21d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:07:00 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1a0ec1-505f-4a93-a059-bba561d11680]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f] added
Oct 20 09:07:00 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[78217513-5855-4286-bf17-57087b1bbaa1]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cf912c-7fb1-4840-a84e-cdb9be1acafc]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LpwjWhiP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:00 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Instance destroyed successfully.
Oct 20 09:07:00 user nova-compute[74039]: DEBUG nova.objects.instance [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lazy-loading 'resources' on Instance uuid f9470b11-57ae-49bb-a6c5-c0d971a767a2 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LpwjWhiP" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1891544990',display_name='tempest-VolumesActionsTest-instance-1891544990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1891544990',id=30,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7181660fb3d4a3e995e2ccd85dfe3c2',ramdisk_id='',reservation_id='r-3pu0sw0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2122958476',owner_user_name='tempest-VolumesActionsTest-2122958476-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:05:16Z,user_data=None,user_id='644af097c95f4a26817492be77c327d9',uuid=f9470b11-57ae-49bb-a6c5-c0d971a767a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "864c614d-53f7-4160-93bf-17034231048b", "address": "fa:16:3e:a1:18:09", "network": {"id": "0d9cc42e-a86c-4a9b-bab9-179e24144ea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-339724642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7181660fb3d4a3e995e2ccd85dfe3c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap864c614d-53", "ovs_interfaceid": "864c614d-53f7-4160-93bf-17034231048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Converting VIF {"id": "864c614d-53f7-4160-93bf-17034231048b", "address": "fa:16:3e:a1:18:09", "network": {"id": "0d9cc42e-a86c-4a9b-bab9-179e24144ea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-339724642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7181660fb3d4a3e995e2ccd85dfe3c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap864c614d-53", "ovs_interfaceid": "864c614d-53f7-4160-93bf-17034231048b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:18:09,bridge_name='br-int',has_traffic_filtering=True,id=864c614d-53f7-4160-93bf-17034231048b,network=Network(0d9cc42e-a86c-4a9b-bab9-179e24144ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap864c614d-53') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_vif [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:18:09,bridge_name='br-int',has_traffic_filtering=True,id=864c614d-53f7-4160-93bf-17034231048b,network=Network(0d9cc42e-a86c-4a9b-bab9-179e24144ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap864c614d-53') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca9edd5-313d-44d9-a037-ce08101559c8]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LpwjWhiP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap864c614d-53, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f1bfefb-e2d8-471d-b657-7962248bb264) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:07:00 user nova-compute[74039]: INFO os_vif [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:18:09,bridge_name='br-int',has_traffic_filtering=True,id=864c614d-53f7-4160-93bf-17034231048b,network=Network(0d9cc42e-a86c-4a9b-bab9-179e24144ea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap864c614d-53')
Oct 20 09:07:00 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Deleting instance files /opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2_del
Oct 20 09:07:00 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Deletion of /opt/stack/data/nova/instances/f9470b11-57ae-49bb-a6c5-c0d971a767a2_del complete
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a045d6c-8bf6-4561-94fa-a7c718a85320]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f84f3c-602c-4750-8ca7-faa95c8644f8]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:07:00 user nova-compute[74039]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 (non-flash)
Oct 20 09:07:00 user nova-compute[74039]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 (non-flash)
Oct 20 09:07:00 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:07:00 user nova-compute[74039]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 (non-flash)
Oct 20 09:07:00 user nova-compute[74039]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 (non-flash)
Oct 20 09:07:00 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:00 user nova-compute[74039]: INFO nova.compute.manager [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c834409-f20b-47f5-8190-6b5db2ac781f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f, portal: 172.16.0.220,3260]
Oct 20 09:07:00 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f, portal: 172.16.0.220,3260] successful.
Oct 20 09:07:00 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[406c5c61-2e36-4199-b42e-380c631e0dfc]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc22650-2b64-4224-9990-09b7ab82dcce]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:07:00 user nova-compute[74039]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 (non-flash)
Oct 20 09:07:00 user nova-compute[74039]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 (non-flash)
Oct 20 09:07:00 user nova-compute[74039]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)
Oct 20 09:07:00 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:07:00 user nova-compute[74039]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 (non-flash)
Oct 20 09:07:00 user nova-compute[74039]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 (non-flash)
Oct 20 09:07:00 user nova-compute[74039]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)
Oct 20 09:07:00 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c94ef07-2e48-4026-9677-9a9571d07bde]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:00 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:07:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpwjWhiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:07:01 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:07:01 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Took 0.50 seconds to deallocate network for instance.
Oct 20 09:07:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:01 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:07:01 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:07:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:01 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Deleted allocations for instance f9470b11-57ae-49bb-a6c5-c0d971a767a2
Oct 20 09:07:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:01 user nova-compute[74039]: INFO nova.compute.manager [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Detaching volume 413350b4-1790-46f2-a735-ceb9a4f32163
Oct 20 09:07:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2e7f04e2-61f3-40d3-a900-254ab6e3893a tempest-VolumesActionsTest-2122958476 tempest-VolumesActionsTest-2122958476-project-member] Lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.965s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:01 user nova-compute[74039]: INFO nova.virt.block_device [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Attempting to driver detach volume 413350b4-1790-46f2-a735-ceb9a4f32163 from mountpoint /dev/vdb
Oct 20 09:07:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:07:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23137653936646433', 'path': '/dev/sde'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:07:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137653936646433', 'path': '/dev/sde'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:07:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Attempting to detach device vdb from instance f53c3766-e463-42b1-acd8-f27c3ba2b0ce from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 09:07:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:07:02 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:07:02 user nova-compute[74039]:   <source dev="/dev/sdc"/>
Oct 20 09:07:02 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:07:02 user nova-compute[74039]:   <serial>413350b4-1790-46f2-a735-ceb9a4f32163</serial>
Oct 20 09:07:02 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:07:02 user nova-compute[74039]: </disk>
Oct 20 09:07:02 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:07:02 user nova-compute[74039]: DEBUG nova.objects.instance [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lazy-loading 'flavor' on Instance uuid eca753ae-f542-431d-bb70-197394e6c566 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:07:02 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Successfully detached device vdb from instance f53c3766-e463-42b1-acd8-f27c3ba2b0ce from the persistent domain config.
Oct 20 09:07:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f53c3766-e463-42b1-acd8-f27c3ba2b0ce from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 09:07:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:07:02 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:07:02 user nova-compute[74039]:   <source dev="/dev/sdc"/>
Oct 20 09:07:02 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:07:02 user nova-compute[74039]:   <serial>413350b4-1790-46f2-a735-ceb9a4f32163</serial>
Oct 20 09:07:02 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:07:02 user nova-compute[74039]: </disk>
Oct 20 09:07:02 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:07:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 09:07:02 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:07:02 user nova-compute[74039]:   <source dev="/dev/sde"/>
Oct 20 09:07:02 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:07:02 user nova-compute[74039]:   <serial>2d1323e8-966f-4604-8f89-6816b404bd0f</serial>
Oct 20 09:07:02 user nova-compute[74039]: </disk>
Oct 20 09:07:02 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 09:07:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:07:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:07:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] No VIF found with MAC fa:16:3e:40:f2:06, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:07:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-44d71ecf-7698-46aa-85cd-341249bb2df6 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "eca753ae-f542-431d-bb70-197394e6c566" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.373s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-25fbeb22-4b49-48c8-9321-1e81d38cf53e req-22694458-862f-4e42-a5b1-e1aab586b31e service nova] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Received event network-vif-plugged-864c614d-53f7-4160-93bf-17034231048b {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:07:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-25fbeb22-4b49-48c8-9321-1e81d38cf53e req-22694458-862f-4e42-a5b1-e1aab586b31e service nova] Acquiring lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-25fbeb22-4b49-48c8-9321-1e81d38cf53e req-22694458-862f-4e42-a5b1-e1aab586b31e service nova] Lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-25fbeb22-4b49-48c8-9321-1e81d38cf53e req-22694458-862f-4e42-a5b1-e1aab586b31e service nova] Lock "f9470b11-57ae-49bb-a6c5-c0d971a767a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-25fbeb22-4b49-48c8-9321-1e81d38cf53e req-22694458-862f-4e42-a5b1-e1aab586b31e service nova] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] No waiting events found dispatching network-vif-plugged-864c614d-53f7-4160-93bf-17034231048b {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:07:02 user nova-compute[74039]: WARNING nova.compute.manager [req-25fbeb22-4b49-48c8-9321-1e81d38cf53e req-22694458-862f-4e42-a5b1-e1aab586b31e service nova] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Received unexpected event network-vif-plugged-864c614d-53f7-4160-93bf-17034231048b for instance with vm_state deleted and task_state None.
Oct 20 09:07:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-25fbeb22-4b49-48c8-9321-1e81d38cf53e req-22694458-862f-4e42-a5b1-e1aab586b31e service nova] [instance: f9470b11-57ae-49bb-a6c5-c0d971a767a2] Received event network-vif-deleted-864c614d-53f7-4160-93bf-17034231048b {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:07:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f53c3766-e463-42b1-acd8-f27c3ba2b0ce {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 09:07:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:05 user nova-compute[74039]: DEBUG nova.compute.manager [req-b0756e1b-9244-4d31-bf6b-8e504a369b00 req-b2660c81-faed-4f1c-adcf-0394785cc20c service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received event network-changed-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:07:05 user nova-compute[74039]: DEBUG nova.compute.manager [req-b0756e1b-9244-4d31-bf6b-8e504a369b00 req-b2660c81-faed-4f1c-adcf-0394785cc20c service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Refreshing instance network info cache due to event network-changed-fea0e0ca-2480-435a-b0de-0381ebf787e7. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:07:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b0756e1b-9244-4d31-bf6b-8e504a369b00 req-b2660c81-faed-4f1c-adcf-0394785cc20c service nova] Acquiring lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:07:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b0756e1b-9244-4d31-bf6b-8e504a369b00 req-b2660c81-faed-4f1c-adcf-0394785cc20c service nova] Acquired lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:07:05 user nova-compute[74039]: DEBUG nova.network.neutron [req-b0756e1b-9244-4d31-bf6b-8e504a369b00 req-b2660c81-faed-4f1c-adcf-0394785cc20c service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Refreshing network info cache for port fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:07:06 user nova-compute[74039]: DEBUG nova.network.neutron [req-b0756e1b-9244-4d31-bf6b-8e504a369b00 req-b2660c81-faed-4f1c-adcf-0394785cc20c service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Updated VIF entry in instance network info cache for port fea0e0ca-2480-435a-b0de-0381ebf787e7. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:07:06 user nova-compute[74039]: DEBUG nova.network.neutron [req-b0756e1b-9244-4d31-bf6b-8e504a369b00 req-b2660c81-faed-4f1c-adcf-0394785cc20c service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Updating instance_info_cache with network_info: [{"id": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "address": "fa:16:3e:40:f2:06", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea0e0ca-24", "ovs_interfaceid": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:07:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b0756e1b-9244-4d31-bf6b-8e504a369b00 req-b2660c81-faed-4f1c-adcf-0394785cc20c service nova] Releasing lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:07:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-b94eb95d-7869-4563-aa5e-c958303df49e req-a20ead07-1f82-409e-81e1-6ce922f8a70f service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received event network-changed-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:07:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-b94eb95d-7869-4563-aa5e-c958303df49e req-a20ead07-1f82-409e-81e1-6ce922f8a70f service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Refreshing instance network info cache due to event network-changed-fea0e0ca-2480-435a-b0de-0381ebf787e7. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:07:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b94eb95d-7869-4563-aa5e-c958303df49e req-a20ead07-1f82-409e-81e1-6ce922f8a70f service nova] Acquiring lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:07:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b94eb95d-7869-4563-aa5e-c958303df49e req-a20ead07-1f82-409e-81e1-6ce922f8a70f service nova] Acquired lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:07:08 user nova-compute[74039]: DEBUG nova.network.neutron [req-b94eb95d-7869-4563-aa5e-c958303df49e req-a20ead07-1f82-409e-81e1-6ce922f8a70f service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Refreshing network info cache for port fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:07:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:08 user nova-compute[74039]: DEBUG nova.network.neutron [req-b94eb95d-7869-4563-aa5e-c958303df49e req-a20ead07-1f82-409e-81e1-6ce922f8a70f service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Updated VIF entry in instance network info cache for port fea0e0ca-2480-435a-b0de-0381ebf787e7. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:07:08 user nova-compute[74039]: DEBUG nova.network.neutron [req-b94eb95d-7869-4563-aa5e-c958303df49e req-a20ead07-1f82-409e-81e1-6ce922f8a70f service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Updating instance_info_cache with network_info: [{"id": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "address": "fa:16:3e:40:f2:06", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea0e0ca-24", "ovs_interfaceid": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:07:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b94eb95d-7869-4563-aa5e-c958303df49e req-a20ead07-1f82-409e-81e1-6ce922f8a70f service nova] Releasing lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-86670a2f-3961-4e40-ae1f-5198d2306ec7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "eca753ae-f542-431d-bb70-197394e6c566" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-86670a2f-3961-4e40-ae1f-5198d2306ec7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "eca753ae-f542-431d-bb70-197394e6c566" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:09 user nova-compute[74039]: INFO nova.compute.manager [None req-86670a2f-3961-4e40-ae1f-5198d2306ec7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Rebooting instance
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-86670a2f-3961-4e40-ae1f-5198d2306ec7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-86670a2f-3961-4e40-ae1f-5198d2306ec7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquired lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG nova.network.neutron [None req-86670a2f-3961-4e40-ae1f-5198d2306ec7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG nova.network.neutron [None req-86670a2f-3961-4e40-ae1f-5198d2306ec7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Updating instance_info_cache with network_info: [{"id": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "address": "fa:16:3e:40:f2:06", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea0e0ca-24", "ovs_interfaceid": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-86670a2f-3961-4e40-ae1f-5198d2306ec7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Releasing lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG nova.compute.manager [None req-86670a2f-3961-4e40-ae1f-5198d2306ec7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:07:09 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f470b048-6069-425e-b3f9-65d538674321 is timed out.
Oct 20 09:07:09 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Successfully detached device vdb from instance f470b048-6069-425e-b3f9-65d538674321 from the live domain config.
Oct 20 09:07:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XAYQTjWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:07:09 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:07:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ee5fad-aec9-4425-8fe7-83b1b074f233]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:07:09 user nova-compute[74039]: No targets found.
Oct 20 09:07:09 user nova-compute[74039]: iSNS:
Oct 20 09:07:09 user nova-compute[74039]: No targets found.
Oct 20 09:07:09 user nova-compute[74039]: STATIC:
Oct 20 09:07:09 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f
Oct 20 09:07:09 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:07:09 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:07:09 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1
Oct 20 09:07:09 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:07:09 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:07:09 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581
Oct 20 09:07:09 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:07:09 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:07:09 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163
Oct 20 09:07:09 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:07:09 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:07:09 user nova-compute[74039]: FIRMWARE:
Oct 20 09:07:09 user nova-compute[74039]: No targets found.
Oct 20 09:07:09 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:07:09 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:07:09 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e171cc5d-995e-4acc-83a8-e068feb52676]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[25293e17-6fbc-4c1b-9b18-d1d05866e8ef]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:07:09 user nova-compute[74039]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 (non-flash)
Oct 20 09:07:09 user nova-compute[74039]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 (non-flash)
Oct 20 09:07:09 user nova-compute[74039]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)
Oct 20 09:07:09 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:07:09 user nova-compute[74039]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 (non-flash)
Oct 20 09:07:09 user nova-compute[74039]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 (non-flash)
Oct 20 09:07:09 user nova-compute[74039]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)
Oct 20 09:07:09 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae841e2680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581'): ({'sdb'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Removing single pathed devices sdb {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f5d50e-6b7e-4671-b5be-ae394b6a1d8d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6889704-36fb-424f-80f6-e49d17b8dd7b]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Flushing IO for device /dev/sdb {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1722bf-fd9c-4563-95e3-de7b13cb5e43]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:09 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3740a812-e949-429c-b007-1e95de5b7652]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:10 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:07:10 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:07:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:07:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5198277e-890a-4860-854b-d8171cb532a8]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[af67a7d2-e77e-425e-9e9f-43e7348a1f4e]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581, portal: 172.16.0.220,3260]
Oct 20 09:07:10 user nova-compute[74039]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581, portal: 172.16.0.220,3260] successful.
Oct 20 09:07:10 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea23f218-2aa1-4ff3-b775-a681c2706581 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0747eaf6-5baf-49cc-b7ee-9a2f9800ecf9]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:07:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] <== disconnect_volume: return (323ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:07:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:07:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:10 user nova-compute[74039]: DEBUG nova.objects.instance [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lazy-loading 'flavor' on Instance uuid f470b048-6069-425e-b3f9-65d538674321 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:07:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f43eb0fe-3ad3-4f05-a242-ffad2af3225b tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "f470b048-6069-425e-b3f9-65d538674321" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.815s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:12 user nova-compute[74039]: DEBUG nova.compute.manager [req-7dfbf4b5-e185-4de3-abcd-ebd5e09feda4 req-105bcb12-2b2f-4c4c-a365-1a3d2410a972 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received event network-vif-unplugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:07:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7dfbf4b5-e185-4de3-abcd-ebd5e09feda4 req-105bcb12-2b2f-4c4c-a365-1a3d2410a972 service nova] Acquiring lock "eca753ae-f542-431d-bb70-197394e6c566-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7dfbf4b5-e185-4de3-abcd-ebd5e09feda4 req-105bcb12-2b2f-4c4c-a365-1a3d2410a972 service nova] Lock "eca753ae-f542-431d-bb70-197394e6c566-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7dfbf4b5-e185-4de3-abcd-ebd5e09feda4 req-105bcb12-2b2f-4c4c-a365-1a3d2410a972 service nova] Lock "eca753ae-f542-431d-bb70-197394e6c566-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:12 user nova-compute[74039]: DEBUG nova.compute.manager [req-7dfbf4b5-e185-4de3-abcd-ebd5e09feda4 req-105bcb12-2b2f-4c4c-a365-1a3d2410a972 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] No waiting events found dispatching network-vif-unplugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:07:12 user nova-compute[74039]: WARNING nova.compute.manager [req-7dfbf4b5-e185-4de3-abcd-ebd5e09feda4 req-105bcb12-2b2f-4c4c-a365-1a3d2410a972 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received unexpected event network-vif-unplugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 for instance with vm_state active and task_state reboot_started.
Oct 20 09:07:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:12 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-86670a2f-3961-4e40-ae1f-5198d2306ec7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Instance shutdown successfully.
Oct 20 09:07:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:14 user nova-compute[74039]: DEBUG nova.compute.manager [req-31a90572-6727-46df-84a3-a0544be71201 req-80d6e470-24b9-42f4-be8d-d94c73dc3d01 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received event network-vif-plugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:07:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-31a90572-6727-46df-84a3-a0544be71201 req-80d6e470-24b9-42f4-be8d-d94c73dc3d01 service nova] Acquiring lock "eca753ae-f542-431d-bb70-197394e6c566-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-31a90572-6727-46df-84a3-a0544be71201 req-80d6e470-24b9-42f4-be8d-d94c73dc3d01 service nova] Lock "eca753ae-f542-431d-bb70-197394e6c566-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-31a90572-6727-46df-84a3-a0544be71201 req-80d6e470-24b9-42f4-be8d-d94c73dc3d01 service nova] Lock "eca753ae-f542-431d-bb70-197394e6c566-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:14 user nova-compute[74039]: DEBUG nova.compute.manager [req-31a90572-6727-46df-84a3-a0544be71201 req-80d6e470-24b9-42f4-be8d-d94c73dc3d01 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] No waiting events found dispatching network-vif-plugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:07:14 user nova-compute[74039]: WARNING nova.compute.manager [req-31a90572-6727-46df-84a3-a0544be71201 req-80d6e470-24b9-42f4-be8d-d94c73dc3d01 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received unexpected event network-vif-plugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 for instance with vm_state active and task_state reboot_started.
Oct 20 09:07:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:16 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: eca753ae-f542-431d-bb70-197394e6c566] Instance running successfully.
Oct 20 09:07:16 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-86670a2f-3961-4e40-ae1f-5198d2306ec7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Instance soft rebooted successfully.
Oct 20 09:07:16 user nova-compute[74039]: DEBUG nova.compute.manager [None req-86670a2f-3961-4e40-ae1f-5198d2306ec7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:07:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-86670a2f-3961-4e40-ae1f-5198d2306ec7 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "eca753ae-f542-431d-bb70-197394e6c566" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.439s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:16 user nova-compute[74039]: DEBUG nova.compute.manager [req-42b03e59-491f-4c76-83db-321cae7e5abe req-3895bd6a-f0f7-4b05-8a70-8d7defe8e098 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received event network-vif-plugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:07:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-42b03e59-491f-4c76-83db-321cae7e5abe req-3895bd6a-f0f7-4b05-8a70-8d7defe8e098 service nova] Acquiring lock "eca753ae-f542-431d-bb70-197394e6c566-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-42b03e59-491f-4c76-83db-321cae7e5abe req-3895bd6a-f0f7-4b05-8a70-8d7defe8e098 service nova] Lock "eca753ae-f542-431d-bb70-197394e6c566-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-42b03e59-491f-4c76-83db-321cae7e5abe req-3895bd6a-f0f7-4b05-8a70-8d7defe8e098 service nova] Lock "eca753ae-f542-431d-bb70-197394e6c566-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:16 user nova-compute[74039]: DEBUG nova.compute.manager [req-42b03e59-491f-4c76-83db-321cae7e5abe req-3895bd6a-f0f7-4b05-8a70-8d7defe8e098 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] No waiting events found dispatching network-vif-plugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:07:16 user nova-compute[74039]: WARNING nova.compute.manager [req-42b03e59-491f-4c76-83db-321cae7e5abe req-3895bd6a-f0f7-4b05-8a70-8d7defe8e098 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received unexpected event network-vif-plugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 for instance with vm_state active and task_state None.
Oct 20 09:07:16 user nova-compute[74039]: DEBUG nova.compute.manager [req-42b03e59-491f-4c76-83db-321cae7e5abe req-3895bd6a-f0f7-4b05-8a70-8d7defe8e098 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received event network-vif-plugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:07:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-42b03e59-491f-4c76-83db-321cae7e5abe req-3895bd6a-f0f7-4b05-8a70-8d7defe8e098 service nova] Acquiring lock "eca753ae-f542-431d-bb70-197394e6c566-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-42b03e59-491f-4c76-83db-321cae7e5abe req-3895bd6a-f0f7-4b05-8a70-8d7defe8e098 service nova] Lock "eca753ae-f542-431d-bb70-197394e6c566-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-42b03e59-491f-4c76-83db-321cae7e5abe req-3895bd6a-f0f7-4b05-8a70-8d7defe8e098 service nova] Lock "eca753ae-f542-431d-bb70-197394e6c566-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:16 user nova-compute[74039]: DEBUG nova.compute.manager [req-42b03e59-491f-4c76-83db-321cae7e5abe req-3895bd6a-f0f7-4b05-8a70-8d7defe8e098 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] No waiting events found dispatching network-vif-plugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:07:16 user nova-compute[74039]: WARNING nova.compute.manager [req-42b03e59-491f-4c76-83db-321cae7e5abe req-3895bd6a-f0f7-4b05-8a70-8d7defe8e098 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received unexpected event network-vif-plugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 for instance with vm_state active and task_state None.
Oct 20 09:07:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:22 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f53c3766-e463-42b1-acd8-f27c3ba2b0ce is timed out.
Oct 20 09:07:22 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Successfully detached device vdb from instance f53c3766-e463-42b1-acd8-f27c3ba2b0ce from the live domain config.
Oct 20 09:07:22 user nova-compute[74039]: DEBUG nova.compute.manager [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTmMNhPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:07:22 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:07:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bbb272-d8a3-4d17-abf3-074800ec2f8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:07:22 user nova-compute[74039]: No targets found.
Oct 20 09:07:22 user nova-compute[74039]: iSNS:
Oct 20 09:07:22 user nova-compute[74039]: No targets found.
Oct 20 09:07:22 user nova-compute[74039]: STATIC:
Oct 20 09:07:22 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f
Oct 20 09:07:22 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:07:22 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:07:22 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1
Oct 20 09:07:22 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:07:22 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:07:22 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163
Oct 20 09:07:22 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:07:22 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:07:22 user nova-compute[74039]: FIRMWARE:
Oct 20 09:07:22 user nova-compute[74039]: No targets found.
Oct 20 09:07:22 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:07:22 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:07:22 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91d73b0-d763-424e-bab1-a47ee7309b31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[960af428-9274-401c-af63-a203718d0402]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:07:22 user nova-compute[74039]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 (non-flash)
Oct 20 09:07:22 user nova-compute[74039]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)
Oct 20 09:07:22 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:07:22 user nova-compute[74039]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 (non-flash)
Oct 20 09:07:22 user nova-compute[74039]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)
Oct 20 09:07:22 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae84116dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163'): ({'sdc'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Removing single pathed devices sdc {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:07:22 user nova-compute[74039]: INFO nova.compute.manager [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] instance snapshotting
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[85478986-431a-478c-80dd-61dca056ece6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43f5db6-d0b8-4da4-852c-7e776b3107ec]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Flushing IO for device /dev/sdc {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6808b084-6fbe-4f2b-ba2c-c956a405626a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:22 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Beginning live snapshot process
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffb9cbd-e767-48cf-8b79-1386287976a6]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5ba2cb-34f7-4be0-99c3-238f9ac54e86]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f126e8-8429-49dd-9f57-8d856e3d4a8f]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163, portal: 172.16.0.220,3260]
Oct 20 09:07:23 user nova-compute[74039]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163, portal: 172.16.0.220,3260] successful.
Oct 20 09:07:23 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:413350b4-1790-46f2-a735-ceb9a4f32163 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7befd7-ac01-46bf-9093-1fcf247ec8b5]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] <== disconnect_volume: return (360ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json -f qcow2 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json -f qcow2" returned: 0 in 0.240s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json -f qcow2 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json -f qcow2" returned: 0 in 0.250s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.203s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp15ni6qiq/933bfacadf454d799424a4384db6f536.delta 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:07:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp15ni6qiq/933bfacadf454d799424a4384db6f536.delta 1073741824" returned: 0 in 0.060s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:23 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 09:07:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-4f5d98e3-c1f6-4617-8847-b975e2c23990" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:07:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-4f5d98e3-c1f6-4617-8847-b975e2c23990" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:07:24 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:07:24 user nova-compute[74039]: DEBUG nova.objects.instance [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lazy-loading 'flavor' on Instance uuid f53c3766-e463-42b1-acd8-f27c3ba2b0ce {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:07:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4db49448-a513-4d7a-938d-22eb941bc7e7 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.421s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:24 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Updating instance_info_cache with network_info: [{"id": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "address": "fa:16:3e:00:9a:92", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558d1748-92", "ovs_interfaceid": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:07:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-4f5d98e3-c1f6-4617-8847-b975e2c23990" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:07:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:07:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:07:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:07:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:07:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:07:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 09:07:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:07:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 09:07:25 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 09:07:25 user nova-compute[74039]: DEBUG nova.privsep.utils [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74039) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 09:07:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp15ni6qiq/933bfacadf454d799424a4384db6f536.delta /opt/stack/data/nova/instances/snapshots/tmp15ni6qiq/933bfacadf454d799424a4384db6f536 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:25 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:07:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp15ni6qiq/933bfacadf454d799424a4384db6f536.delta /opt/stack/data/nova/instances/snapshots/tmp15ni6qiq/933bfacadf454d799424a4384db6f536" returned: 0 in 0.683s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:25 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Snapshot extracted, beginning image upload
Oct 20 09:07:26 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:07:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:28 user nova-compute[74039]: DEBUG nova.compute.manager [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:07:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:07:28 user nova-compute[74039]: INFO nova.compute.claims [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Claim successful on node user
Oct 20 09:07:28 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:07:28 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:07:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:28 user nova-compute[74039]: DEBUG nova.compute.manager [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:07:28 user nova-compute[74039]: DEBUG nova.compute.manager [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:07:28 user nova-compute[74039]: DEBUG nova.network.neutron [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:07:28 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:07:28 user nova-compute[74039]: DEBUG nova.compute.manager [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:07:29 user nova-compute[74039]: DEBUG nova.policy [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3196ef9f3da4311bb896432fbf55ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40be8c8bc79f4ce2a4857d36ddfe0667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:07:29 user nova-compute[74039]: DEBUG nova.compute.manager [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:07:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:07:29 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Creating image(s)
Oct 20 09:07:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "/opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "/opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:29 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Snapshot image upload complete
Oct 20 09:07:29 user nova-compute[74039]: INFO nova.compute.manager [None req-3087fd57-4a8a-46de-a88e-37ba3ca3f3b2 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Took 6.53 seconds to snapshot the instance on the hypervisor.
Oct 20 09:07:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.235s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.210s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk 1073741824" returned: 0 in 0.056s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.221s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:29 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:07:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:29 user nova-compute[74039]: DEBUG nova.network.neutron [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Successfully created port: ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:07:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:30 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Cannot resize image /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:07:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:07:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Ensure instance console log exists: /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:07:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:30 user nova-compute[74039]: DEBUG nova.network.neutron [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Successfully updated port: ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:07:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "refresh_cache-eb7a44c0-2405-4ff2-b6db-8ace80f44377" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:07:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquired lock "refresh_cache-eb7a44c0-2405-4ff2-b6db-8ace80f44377" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:07:30 user nova-compute[74039]: DEBUG nova.network.neutron [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:07:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-be1e69cb-1417-474c-bd60-2b930d9da6f2 req-30faaeb1-30da-43f9-b4b1-38f0276db23c service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Received event network-changed-ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:07:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-be1e69cb-1417-474c-bd60-2b930d9da6f2 req-30faaeb1-30da-43f9-b4b1-38f0276db23c service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Refreshing instance network info cache due to event network-changed-ceda34ef-339f-4423-adf1-5d39a1412398. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:07:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-be1e69cb-1417-474c-bd60-2b930d9da6f2 req-30faaeb1-30da-43f9-b4b1-38f0276db23c service nova] Acquiring lock "refresh_cache-eb7a44c0-2405-4ff2-b6db-8ace80f44377" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:07:30 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:07:30 user nova-compute[74039]: DEBUG nova.network.neutron [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:07:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.network.neutron [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Updating instance_info_cache with network_info: [{"id": "ceda34ef-339f-4423-adf1-5d39a1412398", "address": "fa:16:3e:b3:28:4d", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda34ef-33", "ovs_interfaceid": "ceda34ef-339f-4423-adf1-5d39a1412398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Releasing lock "refresh_cache-eb7a44c0-2405-4ff2-b6db-8ace80f44377" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Instance network_info: |[{"id": "ceda34ef-339f-4423-adf1-5d39a1412398", "address": "fa:16:3e:b3:28:4d", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda34ef-33", "ovs_interfaceid": "ceda34ef-339f-4423-adf1-5d39a1412398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-be1e69cb-1417-474c-bd60-2b930d9da6f2 req-30faaeb1-30da-43f9-b4b1-38f0276db23c service nova] Acquired lock "refresh_cache-eb7a44c0-2405-4ff2-b6db-8ace80f44377" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.network.neutron [req-be1e69cb-1417-474c-bd60-2b930d9da6f2 req-30faaeb1-30da-43f9-b4b1-38f0276db23c service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Refreshing network info cache for port ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Start _get_guest_xml network_info=[{"id": "ceda34ef-339f-4423-adf1-5d39a1412398", "address": "fa:16:3e:b3:28:4d", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda34ef-33", "ovs_interfaceid": "ceda34ef-339f-4423-adf1-5d39a1412398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:07:31 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:07:31 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:07:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1991621703',display_name='tempest-VolumesSnapshotTestJSON-instance-1991621703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1991621703',id=33,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0BF/RoZxkuMFifRjaNAJBAnrKpqAfbD5ssDv2H7hjCDA3q1O140TB4gk/R4ytJzNMe2/rRACTMTjGdVy11QJE3oktYZ/sGb/SVQS1jgojkS0EVoR3pxlNL+K1utALxLA==',key_name='tempest-keypair-1852617440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40be8c8bc79f4ce2a4857d36ddfe0667',ramdisk_id='',reservation_id='r-2phad53y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1434807460',owner_user_name='tempest-VolumesSnapshotTestJSON-1434807460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:07:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3196ef9f3da4311bb896432fbf55ed2',uuid=eb7a44c0-2405-4ff2-b6db-8ace80f44377,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ceda34ef-339f-4423-adf1-5d39a1412398", "address": "fa:16:3e:b3:28:4d", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda34ef-33", "ovs_interfaceid": "ceda34ef-339f-4423-adf1-5d39a1412398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Converting VIF {"id": "ceda34ef-339f-4423-adf1-5d39a1412398", "address": "fa:16:3e:b3:28:4d", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda34ef-33", "ovs_interfaceid": "ceda34ef-339f-4423-adf1-5d39a1412398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:28:4d,bridge_name='br-int',has_traffic_filtering=True,id=ceda34ef-339f-4423-adf1-5d39a1412398,network=Network(c8baa945-5d9a-4bf8-830d-ab75cf318cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceda34ef-33') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.objects.instance [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lazy-loading 'pci_devices' on Instance uuid eb7a44c0-2405-4ff2-b6db-8ace80f44377 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:07:31 user nova-compute[74039]:   <uuid>eb7a44c0-2405-4ff2-b6db-8ace80f44377</uuid>
Oct 20 09:07:31 user nova-compute[74039]:   <name>instance-00000021</name>
Oct 20 09:07:31 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:07:31 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:07:31 user nova-compute[74039]:   <metadata>
Oct 20 09:07:31 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:07:31 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:07:31 user nova-compute[74039]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1991621703</nova:name>
Oct 20 09:07:31 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:07:31</nova:creationTime>
Oct 20 09:07:31 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:07:31 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:07:31 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:07:31 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:07:31 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:07:31 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:07:31 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:07:31 user nova-compute[74039]:       <nova:owner>
Oct 20 09:07:31 user nova-compute[74039]:         <nova:user uuid="d3196ef9f3da4311bb896432fbf55ed2">tempest-VolumesSnapshotTestJSON-1434807460-project-member</nova:user>
Oct 20 09:07:31 user nova-compute[74039]:         <nova:project uuid="40be8c8bc79f4ce2a4857d36ddfe0667">tempest-VolumesSnapshotTestJSON-1434807460</nova:project>
Oct 20 09:07:31 user nova-compute[74039]:       </nova:owner>
Oct 20 09:07:31 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:07:31 user nova-compute[74039]:       <nova:ports>
Oct 20 09:07:31 user nova-compute[74039]:         <nova:port uuid="ceda34ef-339f-4423-adf1-5d39a1412398">
Oct 20 09:07:31 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 09:07:31 user nova-compute[74039]:         </nova:port>
Oct 20 09:07:31 user nova-compute[74039]:       </nova:ports>
Oct 20 09:07:31 user nova-compute[74039]:     </nova:instance>
Oct 20 09:07:31 user nova-compute[74039]:   </metadata>
Oct 20 09:07:31 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:07:31 user nova-compute[74039]:     <system>
Oct 20 09:07:31 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:07:31 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:07:31 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:07:31 user nova-compute[74039]:       <entry name="serial">eb7a44c0-2405-4ff2-b6db-8ace80f44377</entry>
Oct 20 09:07:31 user nova-compute[74039]:       <entry name="uuid">eb7a44c0-2405-4ff2-b6db-8ace80f44377</entry>
Oct 20 09:07:31 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:07:31 user nova-compute[74039]:     </system>
Oct 20 09:07:31 user nova-compute[74039]:   </sysinfo>
Oct 20 09:07:31 user nova-compute[74039]:   <os>
Oct 20 09:07:31 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:07:31 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:07:31 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:07:31 user nova-compute[74039]:   </os>
Oct 20 09:07:31 user nova-compute[74039]:   <features>
Oct 20 09:07:31 user nova-compute[74039]:     <acpi/>
Oct 20 09:07:31 user nova-compute[74039]:     <apic/>
Oct 20 09:07:31 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:07:31 user nova-compute[74039]:   </features>
Oct 20 09:07:31 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:07:31 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:07:31 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:07:31 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:07:31 user nova-compute[74039]:   </clock>
Oct 20 09:07:31 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:07:31 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:07:31 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:07:31 user nova-compute[74039]:   </cpu>
Oct 20 09:07:31 user nova-compute[74039]:   <devices>
Oct 20 09:07:31 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:07:31 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:07:31 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk"/>
Oct 20 09:07:31 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:07:31 user nova-compute[74039]:     </disk>
Oct 20 09:07:31 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:07:31 user nova-compute[74039]:       <mac address="fa:16:3e:b3:28:4d"/>
Oct 20 09:07:31 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:07:31 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:07:31 user nova-compute[74039]:       <target dev="tapceda34ef-33"/>
Oct 20 09:07:31 user nova-compute[74039]:     </interface>
Oct 20 09:07:31 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:07:31 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/console.log" append="off"/>
Oct 20 09:07:31 user nova-compute[74039]:     </serial>
Oct 20 09:07:31 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:07:31 user nova-compute[74039]:     <video>
Oct 20 09:07:31 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:07:31 user nova-compute[74039]:     </video>
Oct 20 09:07:31 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:07:31 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:07:31 user nova-compute[74039]:     </rng>
Oct 20 09:07:31 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:07:31 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:07:31 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:07:31 user nova-compute[74039]:     </memballoon>
Oct 20 09:07:31 user nova-compute[74039]:   </devices>
Oct 20 09:07:31 user nova-compute[74039]: </domain>
Oct 20 09:07:31 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:07:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1991621703',display_name='tempest-VolumesSnapshotTestJSON-instance-1991621703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1991621703',id=33,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0BF/RoZxkuMFifRjaNAJBAnrKpqAfbD5ssDv2H7hjCDA3q1O140TB4gk/R4ytJzNMe2/rRACTMTjGdVy11QJE3oktYZ/sGb/SVQS1jgojkS0EVoR3pxlNL+K1utALxLA==',key_name='tempest-keypair-1852617440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40be8c8bc79f4ce2a4857d36ddfe0667',ramdisk_id='',reservation_id='r-2phad53y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1434807460',owner_user_name='tempest-VolumesSnapshotTestJSON-1434807460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:07:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3196ef9f3da4311bb896432fbf55ed2',uuid=eb7a44c0-2405-4ff2-b6db-8ace80f44377,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ceda34ef-339f-4423-adf1-5d39a1412398", "address": "fa:16:3e:b3:28:4d", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda34ef-33", "ovs_interfaceid": "ceda34ef-339f-4423-adf1-5d39a1412398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Converting VIF {"id": "ceda34ef-339f-4423-adf1-5d39a1412398", "address": "fa:16:3e:b3:28:4d", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda34ef-33", "ovs_interfaceid": "ceda34ef-339f-4423-adf1-5d39a1412398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:28:4d,bridge_name='br-int',has_traffic_filtering=True,id=ceda34ef-339f-4423-adf1-5d39a1412398,network=Network(c8baa945-5d9a-4bf8-830d-ab75cf318cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceda34ef-33') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG os_vif [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:28:4d,bridge_name='br-int',has_traffic_filtering=True,id=ceda34ef-339f-4423-adf1-5d39a1412398,network=Network(c8baa945-5d9a-4bf8-830d-ab75cf318cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceda34ef-33') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74ef9499-7abc-5c80-93a2-eabaae184551', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapceda34ef-33, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapceda34ef-33, col_values=(('qos', UUID('97ac4705-16ce-4d9b-971c-e17e2fadbc57')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapceda34ef-33, col_values=(('external_ids', {'iface-id': 'ceda34ef-339f-4423-adf1-5d39a1412398', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:28:4d', 'vm-uuid': 'eb7a44c0-2405-4ff2-b6db-8ace80f44377'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:31 user nova-compute[74039]: INFO os_vif [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:28:4d,bridge_name='br-int',has_traffic_filtering=True,id=ceda34ef-339f-4423-adf1-5d39a1412398,network=Network(c8baa945-5d9a-4bf8-830d-ab75cf318cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceda34ef-33')
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] No VIF found with MAC fa:16:3e:b3:28:4d, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.network.neutron [req-be1e69cb-1417-474c-bd60-2b930d9da6f2 req-30faaeb1-30da-43f9-b4b1-38f0276db23c service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Updated VIF entry in instance network info cache for port ceda34ef-339f-4423-adf1-5d39a1412398. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG nova.network.neutron [req-be1e69cb-1417-474c-bd60-2b930d9da6f2 req-30faaeb1-30da-43f9-b4b1-38f0276db23c service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Updating instance_info_cache with network_info: [{"id": "ceda34ef-339f-4423-adf1-5d39a1412398", "address": "fa:16:3e:b3:28:4d", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda34ef-33", "ovs_interfaceid": "ceda34ef-339f-4423-adf1-5d39a1412398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:07:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-be1e69cb-1417-474c-bd60-2b930d9da6f2 req-30faaeb1-30da-43f9-b4b1-38f0276db23c service nova] Releasing lock "refresh_cache-eb7a44c0-2405-4ff2-b6db-8ace80f44377" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:07:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:32 user nova-compute[74039]: DEBUG nova.compute.manager [req-39b546bb-7e9a-4c1a-b809-a82cf32c85b5 req-c0a38870-96d7-4842-aa13-dbf7be86ff7b service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Received event network-vif-plugged-ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:07:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-39b546bb-7e9a-4c1a-b809-a82cf32c85b5 req-c0a38870-96d7-4842-aa13-dbf7be86ff7b service nova] Acquiring lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-39b546bb-7e9a-4c1a-b809-a82cf32c85b5 req-c0a38870-96d7-4842-aa13-dbf7be86ff7b service nova] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-39b546bb-7e9a-4c1a-b809-a82cf32c85b5 req-c0a38870-96d7-4842-aa13-dbf7be86ff7b service nova] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:32 user nova-compute[74039]: DEBUG nova.compute.manager [req-39b546bb-7e9a-4c1a-b809-a82cf32c85b5 req-c0a38870-96d7-4842-aa13-dbf7be86ff7b service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] No waiting events found dispatching network-vif-plugged-ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:07:32 user nova-compute[74039]: WARNING nova.compute.manager [req-39b546bb-7e9a-4c1a-b809-a82cf32c85b5 req-c0a38870-96d7-4842-aa13-dbf7be86ff7b service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Received unexpected event network-vif-plugged-ceda34ef-339f-4423-adf1-5d39a1412398 for instance with vm_state building and task_state spawning.
Oct 20 09:07:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:35 user nova-compute[74039]: DEBUG nova.compute.manager [req-ba976f4c-75c4-4228-b23f-1bf81a21920e req-13d9a935-1cda-46a6-9661-e8dc9b4c1bff service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Received event network-vif-plugged-ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:07:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ba976f4c-75c4-4228-b23f-1bf81a21920e req-13d9a935-1cda-46a6-9661-e8dc9b4c1bff service nova] Acquiring lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ba976f4c-75c4-4228-b23f-1bf81a21920e req-13d9a935-1cda-46a6-9661-e8dc9b4c1bff service nova] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ba976f4c-75c4-4228-b23f-1bf81a21920e req-13d9a935-1cda-46a6-9661-e8dc9b4c1bff service nova] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:35 user nova-compute[74039]: DEBUG nova.compute.manager [req-ba976f4c-75c4-4228-b23f-1bf81a21920e req-13d9a935-1cda-46a6-9661-e8dc9b4c1bff service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] No waiting events found dispatching network-vif-plugged-ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:07:35 user nova-compute[74039]: WARNING nova.compute.manager [req-ba976f4c-75c4-4228-b23f-1bf81a21920e req-13d9a935-1cda-46a6-9661-e8dc9b4c1bff service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Received unexpected event network-vif-plugged-ceda34ef-339f-4423-adf1-5d39a1412398 for instance with vm_state building and task_state spawning.
Oct 20 09:07:35 user nova-compute[74039]: DEBUG nova.compute.manager [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:07:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:07:35 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Instance spawned successfully.
Oct 20 09:07:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:07:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:07:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:07:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:07:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:07:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:07:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:07:35 user nova-compute[74039]: INFO nova.compute.manager [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Took 6.34 seconds to spawn the instance on the hypervisor.
Oct 20 09:07:35 user nova-compute[74039]: DEBUG nova.compute.manager [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:07:35 user nova-compute[74039]: INFO nova.compute.manager [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Took 7.22 seconds to build instance.
Oct 20 09:07:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c8d7d704-a1aa-4ccd-9dd2-48864b6a2de7 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.368s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Acquiring lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:07:36 user nova-compute[74039]: INFO nova.compute.claims [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Claim successful on node user
Oct 20 09:07:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:07:36 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:07:36 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG nova.policy [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bddf822c42cf4c1397db396e176462ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13d04ae90a4fb8ac51e288fe5ab140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:07:36 user nova-compute[74039]: INFO nova.virt.block_device [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Booting with volume 058aa9e3-d0b9-4712-a8c2-90300ae1d031 at /dev/vda
Oct 20 09:07:36 user nova-compute[74039]: DEBUG os_brick.utils [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0876ea53-33cd-484b-bd03-03ddfd711a38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[882b675c-69dd-439e-92b0-8306ad254afc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7bf86e-67a5-481f-b67c-bf8a4d5eb8a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3177c6-5132-4a7e-87b7-66b7dbe7d12f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:07:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:07:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:07:37 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:07:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[191f678f-8300-47a0-afd8-195beef402a2]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:07:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:07:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:07:37 user nova-compute[74039]: DEBUG os_brick.utils [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:07:37 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Updating existing volume attachment record: 6f1cf6a6-ec69-4ecc-87f1-0f8c9d50a7b8 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:07:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:37 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Successfully created port: 0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:07:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Successfully updated port: 0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Acquiring lock "refresh_cache-d7d1582f-4a3b-4d1b-9454-eb70debf8b07" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Acquired lock "refresh_cache-d7d1582f-4a3b-4d1b-9454-eb70debf8b07" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG nova.compute.manager [req-7f63ef71-7a5d-4c0b-b2b2-e389a446c5f9 req-889e488e-2dca-4407-a524-e7734917c0fa service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Received event network-changed-0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG nova.compute.manager [req-7f63ef71-7a5d-4c0b-b2b2-e389a446c5f9 req-889e488e-2dca-4407-a524-e7734917c0fa service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Refreshing instance network info cache due to event network-changed-0f6af989-65a9-4d64-ade0-b547815b31af. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7f63ef71-7a5d-4c0b-b2b2-e389a446c5f9 req-889e488e-2dca-4407-a524-e7734917c0fa service nova] Acquiring lock "refresh_cache-d7d1582f-4a3b-4d1b-9454-eb70debf8b07" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Updating instance_info_cache with network_info: [{"id": "0f6af989-65a9-4d64-ade0-b547815b31af", "address": "fa:16:3e:72:58:d1", "network": {"id": "d25b876b-0740-492c-96d6-04dfdd2e722e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1105647057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc13d04ae90a4fb8ac51e288fe5ab140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6af989-65", "ovs_interfaceid": "0f6af989-65a9-4d64-ade0-b547815b31af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Releasing lock "refresh_cache-d7d1582f-4a3b-4d1b-9454-eb70debf8b07" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Instance network_info: |[{"id": "0f6af989-65a9-4d64-ade0-b547815b31af", "address": "fa:16:3e:72:58:d1", "network": {"id": "d25b876b-0740-492c-96d6-04dfdd2e722e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1105647057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc13d04ae90a4fb8ac51e288fe5ab140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6af989-65", "ovs_interfaceid": "0f6af989-65a9-4d64-ade0-b547815b31af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7f63ef71-7a5d-4c0b-b2b2-e389a446c5f9 req-889e488e-2dca-4407-a524-e7734917c0fa service nova] Acquired lock "refresh_cache-d7d1582f-4a3b-4d1b-9454-eb70debf8b07" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG nova.network.neutron [req-7f63ef71-7a5d-4c0b-b2b2-e389a446c5f9 req-889e488e-2dca-4407-a524-e7734917c0fa service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Refreshing network info cache for port 0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:39 user nova-compute[74039]: DEBUG nova.network.neutron [req-7f63ef71-7a5d-4c0b-b2b2-e389a446c5f9 req-889e488e-2dca-4407-a524-e7734917c0fa service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Updated VIF entry in instance network info cache for port 0f6af989-65a9-4d64-ade0-b547815b31af. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:07:39 user nova-compute[74039]: DEBUG nova.network.neutron [req-7f63ef71-7a5d-4c0b-b2b2-e389a446c5f9 req-889e488e-2dca-4407-a524-e7734917c0fa service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Updating instance_info_cache with network_info: [{"id": "0f6af989-65a9-4d64-ade0-b547815b31af", "address": "fa:16:3e:72:58:d1", "network": {"id": "d25b876b-0740-492c-96d6-04dfdd2e722e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1105647057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc13d04ae90a4fb8ac51e288fe5ab140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6af989-65", "ovs_interfaceid": "0f6af989-65a9-4d64-ade0-b547815b31af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:07:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7f63ef71-7a5d-4c0b-b2b2-e389a446c5f9 req-889e488e-2dca-4407-a524-e7734917c0fa service nova] Releasing lock "refresh_cache-d7d1582f-4a3b-4d1b-9454-eb70debf8b07" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:07:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:39 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:07:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "f470b048-6069-425e-b3f9-65d538674321" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "f470b048-6069-425e-b3f9-65d538674321" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "f470b048-6069-425e-b3f9-65d538674321-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "f470b048-6069-425e-b3f9-65d538674321-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "f470b048-6069-425e-b3f9-65d538674321-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:39 user nova-compute[74039]: INFO nova.compute.manager [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Terminating instance
Oct 20 09:07:39 user nova-compute[74039]: DEBUG nova.compute.manager [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:07:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG nova.compute.manager [req-8deaaf34-f306-4e22-9930-c62851a8cae2 req-a5e5edf9-c09c-428d-851a-80b02b284c68 service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Received event network-vif-unplugged-fe70147e-8713-4dd0-8d30-16aca37e8433 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8deaaf34-f306-4e22-9930-c62851a8cae2 req-a5e5edf9-c09c-428d-851a-80b02b284c68 service nova] Acquiring lock "f470b048-6069-425e-b3f9-65d538674321-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8deaaf34-f306-4e22-9930-c62851a8cae2 req-a5e5edf9-c09c-428d-851a-80b02b284c68 service nova] Lock "f470b048-6069-425e-b3f9-65d538674321-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8deaaf34-f306-4e22-9930-c62851a8cae2 req-a5e5edf9-c09c-428d-851a-80b02b284c68 service nova] Lock "f470b048-6069-425e-b3f9-65d538674321-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG nova.compute.manager [req-8deaaf34-f306-4e22-9930-c62851a8cae2 req-a5e5edf9-c09c-428d-851a-80b02b284c68 service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] No waiting events found dispatching network-vif-unplugged-fe70147e-8713-4dd0-8d30-16aca37e8433 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG nova.compute.manager [req-8deaaf34-f306-4e22-9930-c62851a8cae2 req-a5e5edf9-c09c-428d-851a-80b02b284c68 service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Received event network-vif-unplugged-fe70147e-8713-4dd0-8d30-16aca37e8433 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:40 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: f470b048-6069-425e-b3f9-65d538674321] Instance destroyed successfully.
Oct 20 09:07:40 user nova-compute[74039]: DEBUG nova.objects.instance [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lazy-loading 'resources' on Instance uuid f470b048-6069-425e-b3f9-65d538674321 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1661466613',display_name='tempest-AttachVolumeNegativeTest-server-1661466613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1661466613',id=27,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLc96UAm+lpzBqu0WjmmwSlT9z4wDjfPJP4twE3G9tgGiAvfl5e1qV7SQzKSp+CRld3sQEmV1fPHHIAuWi6XwfDWX/s2mstm3RlsnMuiR1+BbtAgln8aTGSH5uDtzVEcGg==',key_name='tempest-keypair-676320587',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:04:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='143bda69e4714560b4b2286adaefb4c5',ramdisk_id='',reservation_id='r-4covyjmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-639731200',owner_user_name='tempest-AttachVolumeNegativeTest-639731200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:04:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6faf5f2e03204805a06ac9f83b9a61bb',uuid=f470b048-6069-425e-b3f9-65d538674321,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe70147e-8713-4dd0-8d30-16aca37e8433", "address": "fa:16:3e:b0:e1:65", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe70147e-87", "ovs_interfaceid": "fe70147e-8713-4dd0-8d30-16aca37e8433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converting VIF {"id": "fe70147e-8713-4dd0-8d30-16aca37e8433", "address": "fa:16:3e:b0:e1:65", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe70147e-87", "ovs_interfaceid": "fe70147e-8713-4dd0-8d30-16aca37e8433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:e1:65,bridge_name='br-int',has_traffic_filtering=True,id=fe70147e-8713-4dd0-8d30-16aca37e8433,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe70147e-87') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG os_vif [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:e1:65,bridge_name='br-int',has_traffic_filtering=True,id=fe70147e-8713-4dd0-8d30-16aca37e8433,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe70147e-87') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe70147e-87, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b9c0428-dfc5-4987-9f07-99acf565f20c) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:40 user nova-compute[74039]: INFO os_vif [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:e1:65,bridge_name='br-int',has_traffic_filtering=True,id=fe70147e-8713-4dd0-8d30-16aca37e8433,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe70147e-87')
Oct 20 09:07:40 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Deleting instance files /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321_del
Oct 20 09:07:40 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Deletion of /opt/stack/data/nova/instances/f470b048-6069-425e-b3f9-65d538674321_del complete
Oct 20 09:07:40 user nova-compute[74039]: INFO nova.compute.manager [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: f470b048-6069-425e-b3f9-65d538674321] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 20 09:07:40 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: f470b048-6069-425e-b3f9-65d538674321] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: f470b048-6069-425e-b3f9-65d538674321] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:07:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:41 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:07:41 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:07:41 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7547MB free_disk=25.323368072509766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:07:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:41 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:07:41 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4f5d98e3-c1f6-4617-8847-b975e2c23990 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:07:41 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 00e09d93-3077-4770-abfd-b82ece646997 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:07:41 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance f470b048-6069-425e-b3f9-65d538674321 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:07:41 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance eca753ae-f542-431d-bb70-197394e6c566 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:07:41 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance f53c3766-e463-42b1-acd8-f27c3ba2b0ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:07:41 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:07:41 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:07:41 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance eb7a44c0-2405-4ff2-b6db-8ace80f44377 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:07:41 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance d7d1582f-4a3b-4d1b-9454-eb70debf8b07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:07:41 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:07:41 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:07:41 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:07:41 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:07:41 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:07:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:42 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: f470b048-6069-425e-b3f9-65d538674321] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:07:42 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: f470b048-6069-425e-b3f9-65d538674321] Took 1.44 seconds to deallocate network for instance.
Oct 20 09:07:42 user nova-compute[74039]: DEBUG nova.compute.manager [req-a330ea43-146b-413e-902a-3ccbc70d8ad5 req-1bcbffde-e291-4ade-9348-94402fb2d5cd service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Received event network-vif-plugged-fe70147e-8713-4dd0-8d30-16aca37e8433 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:07:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a330ea43-146b-413e-902a-3ccbc70d8ad5 req-1bcbffde-e291-4ade-9348-94402fb2d5cd service nova] Acquiring lock "f470b048-6069-425e-b3f9-65d538674321-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a330ea43-146b-413e-902a-3ccbc70d8ad5 req-1bcbffde-e291-4ade-9348-94402fb2d5cd service nova] Lock "f470b048-6069-425e-b3f9-65d538674321-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a330ea43-146b-413e-902a-3ccbc70d8ad5 req-1bcbffde-e291-4ade-9348-94402fb2d5cd service nova] Lock "f470b048-6069-425e-b3f9-65d538674321-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:42 user nova-compute[74039]: DEBUG nova.compute.manager [req-a330ea43-146b-413e-902a-3ccbc70d8ad5 req-1bcbffde-e291-4ade-9348-94402fb2d5cd service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] No waiting events found dispatching network-vif-plugged-fe70147e-8713-4dd0-8d30-16aca37e8433 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:07:42 user nova-compute[74039]: WARNING nova.compute.manager [req-a330ea43-146b-413e-902a-3ccbc70d8ad5 req-1bcbffde-e291-4ade-9348-94402fb2d5cd service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Received unexpected event network-vif-plugged-fe70147e-8713-4dd0-8d30-16aca37e8433 for instance with vm_state active and task_state deleting.
Oct 20 09:07:42 user nova-compute[74039]: DEBUG nova.compute.manager [req-bac73da5-c9c2-4b2f-98c4-b33b5b2f9bae req-a2a3d044-f2fb-4d6e-8f2d-30d0dfe988d3 service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Received event network-vif-deleted-fe70147e-8713-4dd0-8d30-16aca37e8433 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:07:42 user nova-compute[74039]: INFO nova.compute.manager [req-bac73da5-c9c2-4b2f-98c4-b33b5b2f9bae req-a2a3d044-f2fb-4d6e-8f2d-30d0dfe988d3 service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Neutron deleted interface fe70147e-8713-4dd0-8d30-16aca37e8433; detaching it from the instance and deleting it from the info cache
Oct 20 09:07:42 user nova-compute[74039]: DEBUG nova.network.neutron [req-bac73da5-c9c2-4b2f-98c4-b33b5b2f9bae req-a2a3d044-f2fb-4d6e-8f2d-30d0dfe988d3 service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:07:42 user nova-compute[74039]: DEBUG nova.compute.manager [req-bac73da5-c9c2-4b2f-98c4-b33b5b2f9bae req-a2a3d044-f2fb-4d6e-8f2d-30d0dfe988d3 service nova] [instance: f470b048-6069-425e-b3f9-65d538674321] Detach interface failed, port_id=fe70147e-8713-4dd0-8d30-16aca37e8433, reason: Instance f470b048-6069-425e-b3f9-65d538674321 could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 09:07:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:42 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:07:42 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:07:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:42 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Deleted allocations for instance f470b048-6069-425e-b3f9-65d538674321
Oct 20 09:07:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f662a8e-e788-4fe0-bf82-c925732074ec tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "f470b048-6069-425e-b3f9-65d538674321" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.044s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:52 user nova-compute[74039]: DEBUG nova.compute.manager [req-c0a7ef76-2011-42e4-932c-e6ef4b16efd3 req-293a257a-4d35-491f-a95d-4ce76ae589f4 service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Received event network-changed-a08cc444-8f39-47df-b452-7c1cb4c951ad {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:07:52 user nova-compute[74039]: DEBUG nova.compute.manager [req-c0a7ef76-2011-42e4-932c-e6ef4b16efd3 req-293a257a-4d35-491f-a95d-4ce76ae589f4 service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Refreshing instance network info cache due to event network-changed-a08cc444-8f39-47df-b452-7c1cb4c951ad. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:07:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c0a7ef76-2011-42e4-932c-e6ef4b16efd3 req-293a257a-4d35-491f-a95d-4ce76ae589f4 service nova] Acquiring lock "refresh_cache-f53c3766-e463-42b1-acd8-f27c3ba2b0ce" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:07:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c0a7ef76-2011-42e4-932c-e6ef4b16efd3 req-293a257a-4d35-491f-a95d-4ce76ae589f4 service nova] Acquired lock "refresh_cache-f53c3766-e463-42b1-acd8-f27c3ba2b0ce" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:07:52 user nova-compute[74039]: DEBUG nova.network.neutron [req-c0a7ef76-2011-42e4-932c-e6ef4b16efd3 req-293a257a-4d35-491f-a95d-4ce76ae589f4 service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Refreshing network info cache for port a08cc444-8f39-47df-b452-7c1cb4c951ad {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:07:53 user nova-compute[74039]: DEBUG nova.network.neutron [req-c0a7ef76-2011-42e4-932c-e6ef4b16efd3 req-293a257a-4d35-491f-a95d-4ce76ae589f4 service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Updated VIF entry in instance network info cache for port a08cc444-8f39-47df-b452-7c1cb4c951ad. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:07:53 user nova-compute[74039]: DEBUG nova.network.neutron [req-c0a7ef76-2011-42e4-932c-e6ef4b16efd3 req-293a257a-4d35-491f-a95d-4ce76ae589f4 service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Updating instance_info_cache with network_info: [{"id": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "address": "fa:16:3e:f8:a4:cd", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa08cc444-8f", "ovs_interfaceid": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:07:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c0a7ef76-2011-42e4-932c-e6ef4b16efd3 req-293a257a-4d35-491f-a95d-4ce76ae589f4 service nova] Releasing lock "refresh_cache-f53c3766-e463-42b1-acd8-f27c3ba2b0ce" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:07:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:53 user nova-compute[74039]: INFO nova.compute.manager [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Terminating instance
Oct 20 09:07:53 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:07:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-e8866dc8-4a56-4d65-85d7-0b96f645fd35 req-6793cfb8-e0ba-4da0-ae39-1e657e27e34f service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Received event network-vif-unplugged-a08cc444-8f39-47df-b452-7c1cb4c951ad {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:07:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e8866dc8-4a56-4d65-85d7-0b96f645fd35 req-6793cfb8-e0ba-4da0-ae39-1e657e27e34f service nova] Acquiring lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e8866dc8-4a56-4d65-85d7-0b96f645fd35 req-6793cfb8-e0ba-4da0-ae39-1e657e27e34f service nova] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e8866dc8-4a56-4d65-85d7-0b96f645fd35 req-6793cfb8-e0ba-4da0-ae39-1e657e27e34f service nova] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-e8866dc8-4a56-4d65-85d7-0b96f645fd35 req-6793cfb8-e0ba-4da0-ae39-1e657e27e34f service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] No waiting events found dispatching network-vif-unplugged-a08cc444-8f39-47df-b452-7c1cb4c951ad {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:07:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-e8866dc8-4a56-4d65-85d7-0b96f645fd35 req-6793cfb8-e0ba-4da0-ae39-1e657e27e34f service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Received event network-vif-unplugged-a08cc444-8f39-47df-b452-7c1cb4c951ad for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:07:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:53 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Instance destroyed successfully.
Oct 20 09:07:53 user nova-compute[74039]: DEBUG nova.objects.instance [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lazy-loading 'resources' on Instance uuid f53c3766-e463-42b1-acd8-f27c3ba2b0ce {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:07:54 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2041071747',display_name='tempest-TestStampPattern-server-2041071747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2041071747',id=29,image_ref='7912e61c-424f-4eb4-a2b4-857f01f6e43c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCoYAYLQAIK0eZwZlLZsSngPmiUuCavbZvZuAXBNr5s5G9UwpQhAO/A9UrKL/K+8+IO1hH8/ytdfxCHYdYzvPmR2tPylGWVvOVVSYReebeMYYdncFm19RRSUV+eGOaikQ==',key_name='tempest-TestStampPattern-2133476221',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:04:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='976dd013512742419a09db1bcd91c33f',ramdisk_id='',reservation_id='r-churu4p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4f5d98e3-c1f6-4617-8847-b975e2c23990',image_min_disk='1',image_min_ram='0',image_owner_id='976dd013512742419a09db1bcd91c33f',image_owner_project_name='tempest-TestStampPattern-1484113572',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1484113572-project-member',image_user_id='521e273869c2472195ea7f956c47cfca',owner_project_name='tempest-TestStampPattern-1484113572',owner_user_name='tempest-TestStampPattern-1484113572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:04:57Z,user_data=None,user_id='521e273869c2472195ea7f956c47cfca',uuid=f53c3766-e463-42b1-acd8-f27c3ba2b0ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "address": "fa:16:3e:f8:a4:cd", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa08cc444-8f", "ovs_interfaceid": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:07:54 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Converting VIF {"id": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "address": "fa:16:3e:f8:a4:cd", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa08cc444-8f", "ovs_interfaceid": "a08cc444-8f39-47df-b452-7c1cb4c951ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:07:54 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:a4:cd,bridge_name='br-int',has_traffic_filtering=True,id=a08cc444-8f39-47df-b452-7c1cb4c951ad,network=Network(95c63035-cc80-442a-b660-301acdda2a79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa08cc444-8f') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:07:54 user nova-compute[74039]: DEBUG os_vif [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:a4:cd,bridge_name='br-int',has_traffic_filtering=True,id=a08cc444-8f39-47df-b452-7c1cb4c951ad,network=Network(95c63035-cc80-442a-b660-301acdda2a79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa08cc444-8f') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:07:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa08cc444-8f, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:07:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:07:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d89f8f19-6df2-49fd-b7e2-a16ddf957a91) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:07:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:54 user nova-compute[74039]: INFO os_vif [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:a4:cd,bridge_name='br-int',has_traffic_filtering=True,id=a08cc444-8f39-47df-b452-7c1cb4c951ad,network=Network(95c63035-cc80-442a-b660-301acdda2a79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa08cc444-8f')
Oct 20 09:07:54 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Deleting instance files /opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce_del
Oct 20 09:07:54 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Deletion of /opt/stack/data/nova/instances/f53c3766-e463-42b1-acd8-f27c3ba2b0ce_del complete
Oct 20 09:07:54 user nova-compute[74039]: INFO nova.compute.manager [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 20 09:07:54 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:07:54 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:07:54 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:07:54 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:07:54 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Took 0.59 seconds to deallocate network for instance.
Oct 20 09:07:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:55 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Deleted allocations for instance f53c3766-e463-42b1-acd8-f27c3ba2b0ce
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b4e18b11-0a1a-40dd-913e-b89da5e798d3 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.056s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:07:55 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Creating image(s)
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Did not create local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Ensure instance console log exists: /opt/stack/data/nova/instances/d7d1582f-4a3b-4d1b-9454-eb70debf8b07/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Start _get_guest_xml network_info=[{"id": "0f6af989-65a9-4d64-ade0-b547815b31af", "address": "fa:16:3e:72:58:d1", "network": {"id": "d25b876b-0740-492c-96d6-04dfdd2e722e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1105647057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc13d04ae90a4fb8ac51e288fe5ab140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6af989-65", "ovs_interfaceid": "0f6af989-65a9-4d64-ade0-b547815b31af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6f1cf6a6-ec69-4ecc-87f1-0f8c9d50a7b8', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tmUrKhWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd7d1582f-4a3b-4d1b-9454-eb70debf8b07', 'attached_at': '', 'detached_at': '', 'volume_id': '058aa9e3-d0b9-4712-a8c2-90300ae1d031', 'serial': '058aa9e3-d0b9-4712-a8c2-90300ae1d031'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:07:55 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:07:55 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tmUrKhWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:07:55 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:07:55 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:07:55 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[27beb480-a91f-46d0-8708-9a7706ba6ee2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:07:55 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd7bf69-a515-40f3-9b87-4daa62aadd2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031] added
Oct 20 09:07:55 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04ec704-7a88-4e77-b52f-60aea6580ea2]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b02f47b-e1e8-4f13-a6ea-724d8d328ee1]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tmUrKhWs {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tmUrKhWs" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f52bdcc-b619-470e-829c-19ec1eb934ec]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tmUrKhWs'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-e3b39039-e0a8-4cf6-b4c2-720dddce15d4 req-9bf91260-9680-4a99-b4f4-2609998d401e service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Received event network-vif-plugged-a08cc444-8f39-47df-b452-7c1cb4c951ad {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e3b39039-e0a8-4cf6-b4c2-720dddce15d4 req-9bf91260-9680-4a99-b4f4-2609998d401e service nova] Acquiring lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e3b39039-e0a8-4cf6-b4c2-720dddce15d4 req-9bf91260-9680-4a99-b4f4-2609998d401e service nova] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e3b39039-e0a8-4cf6-b4c2-720dddce15d4 req-9bf91260-9680-4a99-b4f4-2609998d401e service nova] Lock "f53c3766-e463-42b1-acd8-f27c3ba2b0ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-e3b39039-e0a8-4cf6-b4c2-720dddce15d4 req-9bf91260-9680-4a99-b4f4-2609998d401e service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] No waiting events found dispatching network-vif-plugged-a08cc444-8f39-47df-b452-7c1cb4c951ad {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:07:55 user nova-compute[74039]: WARNING nova.compute.manager [req-e3b39039-e0a8-4cf6-b4c2-720dddce15d4 req-9bf91260-9680-4a99-b4f4-2609998d401e service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Received unexpected event network-vif-plugged-a08cc444-8f39-47df-b452-7c1cb4c951ad for instance with vm_state deleted and task_state None.
Oct 20 09:07:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-e3b39039-e0a8-4cf6-b4c2-720dddce15d4 req-9bf91260-9680-4a99-b4f4-2609998d401e service nova] [instance: f53c3766-e463-42b1-acd8-f27c3ba2b0ce] Received event network-vif-deleted-a08cc444-8f39-47df-b452-7c1cb4c951ad {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[57718775-0424-450b-80bb-1148db28f47f]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[da313cac-055d-460a-b5de-55433b885daf]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:07:55 user nova-compute[74039]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)
Oct 20 09:07:55 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:07:55 user nova-compute[74039]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)
Oct 20 09:07:55 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaae2c3-3534-43fa-8984-240fb0a99c2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031, portal: 172.16.0.220,3260]
Oct 20 09:07:55 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031, portal: 172.16.0.220,3260] successful.
Oct 20 09:07:55 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.075s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa73ca7-d850-4d46-b47a-faf67a377638]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e3a22b-c2a7-434f-b4b8-242ceb6d7726]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:07:55 user nova-compute[74039]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)
Oct 20 09:07:55 user nova-compute[74039]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:07:55 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:07:55 user nova-compute[74039]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)
Oct 20 09:07:55 user nova-compute[74039]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:07:55 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c66b147-4fe1-473c-97c1-494624d437fa]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:07:55 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tmUrKhWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:07:56 user nova-compute[74039]: INFO nova.compute.manager [None req-16658eaf-aae0-431b-bacf-019dfbb1d229 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Get console output
Oct 20 09:07:56 user nova-compute[74039]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 20 09:07:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23739313661663164', 'path': '/dev/sdb'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739313661663164', 'path': '/dev/sdb'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:07:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1317353536',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1317353536',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2Qep7+ioVz4ToaltQb5B8e50cjc5EV3uc44CZSLG3G0pJ+dHSg4fhBqyGwCjA0p2uQ8QVyrcEdJbDBJuM2jMJFlpyM4SxXsL+MsZ1gKCrGcMvERPd26mEQnXws/T8dvA==',key_name='tempest-keypair-1840380994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc13d04ae90a4fb8ac51e288fe5ab140',ramdisk_id='',reservation_id='r-3osji2pv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1308908868',owner_user_name='tempest-ServerActionsV293TestJSON-1308908868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:07:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bddf822c42cf4c1397db396e176462ff',uuid=d7d1582f-4a3b-4d1b-9454-eb70debf8b07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f6af989-65a9-4d64-ade0-b547815b31af", "address": "fa:16:3e:72:58:d1", "network": {"id": "d25b876b-0740-492c-96d6-04dfdd2e722e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1105647057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc13d04ae90a4fb8ac51e288fe5ab140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6af989-65", "ovs_interfaceid": "0f6af989-65a9-4d64-ade0-b547815b31af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Converting VIF {"id": "0f6af989-65a9-4d64-ade0-b547815b31af", "address": "fa:16:3e:72:58:d1", "network": {"id": "d25b876b-0740-492c-96d6-04dfdd2e722e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1105647057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc13d04ae90a4fb8ac51e288fe5ab140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6af989-65", "ovs_interfaceid": "0f6af989-65a9-4d64-ade0-b547815b31af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:58:d1,bridge_name='br-int',has_traffic_filtering=True,id=0f6af989-65a9-4d64-ade0-b547815b31af,network=Network(d25b876b-0740-492c-96d6-04dfdd2e722e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6af989-65') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG nova.objects.instance [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lazy-loading 'pci_devices' on Instance uuid d7d1582f-4a3b-4d1b-9454-eb70debf8b07 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:07:56 user nova-compute[74039]:   <uuid>d7d1582f-4a3b-4d1b-9454-eb70debf8b07</uuid>
Oct 20 09:07:56 user nova-compute[74039]:   <name>instance-00000022</name>
Oct 20 09:07:56 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:07:56 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:07:56 user nova-compute[74039]:   <metadata>
Oct 20 09:07:56 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:07:56 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:07:56 user nova-compute[74039]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1317353536</nova:name>
Oct 20 09:07:56 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:07:55</nova:creationTime>
Oct 20 09:07:56 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:07:56 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:07:56 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:07:56 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:07:56 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:07:56 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:07:56 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:07:56 user nova-compute[74039]:       <nova:owner>
Oct 20 09:07:56 user nova-compute[74039]:         <nova:user uuid="bddf822c42cf4c1397db396e176462ff">tempest-ServerActionsV293TestJSON-1308908868-project-member</nova:user>
Oct 20 09:07:56 user nova-compute[74039]:         <nova:project uuid="bc13d04ae90a4fb8ac51e288fe5ab140">tempest-ServerActionsV293TestJSON-1308908868</nova:project>
Oct 20 09:07:56 user nova-compute[74039]:       </nova:owner>
Oct 20 09:07:56 user nova-compute[74039]:       <nova:ports>
Oct 20 09:07:56 user nova-compute[74039]:         <nova:port uuid="0f6af989-65a9-4d64-ade0-b547815b31af">
Oct 20 09:07:56 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 09:07:56 user nova-compute[74039]:         </nova:port>
Oct 20 09:07:56 user nova-compute[74039]:       </nova:ports>
Oct 20 09:07:56 user nova-compute[74039]:     </nova:instance>
Oct 20 09:07:56 user nova-compute[74039]:   </metadata>
Oct 20 09:07:56 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:07:56 user nova-compute[74039]:     <system>
Oct 20 09:07:56 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:07:56 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:07:56 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:07:56 user nova-compute[74039]:       <entry name="serial">d7d1582f-4a3b-4d1b-9454-eb70debf8b07</entry>
Oct 20 09:07:56 user nova-compute[74039]:       <entry name="uuid">d7d1582f-4a3b-4d1b-9454-eb70debf8b07</entry>
Oct 20 09:07:56 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:07:56 user nova-compute[74039]:     </system>
Oct 20 09:07:56 user nova-compute[74039]:   </sysinfo>
Oct 20 09:07:56 user nova-compute[74039]:   <os>
Oct 20 09:07:56 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:07:56 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:07:56 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:07:56 user nova-compute[74039]:   </os>
Oct 20 09:07:56 user nova-compute[74039]:   <features>
Oct 20 09:07:56 user nova-compute[74039]:     <acpi/>
Oct 20 09:07:56 user nova-compute[74039]:     <apic/>
Oct 20 09:07:56 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:07:56 user nova-compute[74039]:   </features>
Oct 20 09:07:56 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:07:56 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:07:56 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:07:56 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:07:56 user nova-compute[74039]:   </clock>
Oct 20 09:07:56 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:07:56 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:07:56 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:07:56 user nova-compute[74039]:   </cpu>
Oct 20 09:07:56 user nova-compute[74039]:   <devices>
Oct 20 09:07:56 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 09:07:56 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:07:56 user nova-compute[74039]:       <source dev="/dev/sdb"/>
Oct 20 09:07:56 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:07:56 user nova-compute[74039]:       <serial>058aa9e3-d0b9-4712-a8c2-90300ae1d031</serial>
Oct 20 09:07:56 user nova-compute[74039]:     </disk>
Oct 20 09:07:56 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:07:56 user nova-compute[74039]:       <mac address="fa:16:3e:72:58:d1"/>
Oct 20 09:07:56 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:07:56 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:07:56 user nova-compute[74039]:       <target dev="tap0f6af989-65"/>
Oct 20 09:07:56 user nova-compute[74039]:     </interface>
Oct 20 09:07:56 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:07:56 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/d7d1582f-4a3b-4d1b-9454-eb70debf8b07/console.log" append="off"/>
Oct 20 09:07:56 user nova-compute[74039]:     </serial>
Oct 20 09:07:56 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:07:56 user nova-compute[74039]:     <video>
Oct 20 09:07:56 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:07:56 user nova-compute[74039]:     </video>
Oct 20 09:07:56 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:07:56 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:07:56 user nova-compute[74039]:     </rng>
Oct 20 09:07:56 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:07:56 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:07:56 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:07:56 user nova-compute[74039]:     </memballoon>
Oct 20 09:07:56 user nova-compute[74039]:   </devices>
Oct 20 09:07:56 user nova-compute[74039]: </domain>
Oct 20 09:07:56 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:07:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1317353536',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1317353536',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2Qep7+ioVz4ToaltQb5B8e50cjc5EV3uc44CZSLG3G0pJ+dHSg4fhBqyGwCjA0p2uQ8QVyrcEdJbDBJuM2jMJFlpyM4SxXsL+MsZ1gKCrGcMvERPd26mEQnXws/T8dvA==',key_name='tempest-keypair-1840380994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc13d04ae90a4fb8ac51e288fe5ab140',ramdisk_id='',reservation_id='r-3osji2pv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1308908868',owner_user_name='tempest-ServerActionsV293TestJSON-1308908868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:07:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bddf822c42cf4c1397db396e176462ff',uuid=d7d1582f-4a3b-4d1b-9454-eb70debf8b07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f6af989-65a9-4d64-ade0-b547815b31af", "address": "fa:16:3e:72:58:d1", "network": {"id": "d25b876b-0740-492c-96d6-04dfdd2e722e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1105647057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc13d04ae90a4fb8ac51e288fe5ab140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6af989-65", "ovs_interfaceid": "0f6af989-65a9-4d64-ade0-b547815b31af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Converting VIF {"id": "0f6af989-65a9-4d64-ade0-b547815b31af", "address": "fa:16:3e:72:58:d1", "network": {"id": "d25b876b-0740-492c-96d6-04dfdd2e722e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1105647057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc13d04ae90a4fb8ac51e288fe5ab140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6af989-65", "ovs_interfaceid": "0f6af989-65a9-4d64-ade0-b547815b31af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:58:d1,bridge_name='br-int',has_traffic_filtering=True,id=0f6af989-65a9-4d64-ade0-b547815b31af,network=Network(d25b876b-0740-492c-96d6-04dfdd2e722e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6af989-65') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG os_vif [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:58:d1,bridge_name='br-int',has_traffic_filtering=True,id=0f6af989-65a9-4d64-ade0-b547815b31af,network=Network(d25b876b-0740-492c-96d6-04dfdd2e722e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6af989-65') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'beccc864-b591-5780-83bd-de2a52cdc1f0', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f6af989-65, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f6af989-65, col_values=(('qos', UUID('d2e07be5-8b9a-4f54-bad9-0e18e64d4dba')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f6af989-65, col_values=(('external_ids', {'iface-id': '0f6af989-65a9-4d64-ade0-b547815b31af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:58:d1', 'vm-uuid': 'd7d1582f-4a3b-4d1b-9454-eb70debf8b07'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:07:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:56 user nova-compute[74039]: INFO os_vif [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:58:d1,bridge_name='br-int',has_traffic_filtering=True,id=0f6af989-65a9-4d64-ade0-b547815b31af,network=Network(d25b876b-0740-492c-96d6-04dfdd2e722e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6af989-65')
Oct 20 09:07:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:07:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] No VIF found with MAC fa:16:3e:72:58:d1, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:07:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:07:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:00 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:08:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:08:00 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Instance spawned successfully.
Oct 20 09:08:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:08:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:08:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:08:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:08:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:08:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:08:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:08:00 user nova-compute[74039]: INFO nova.compute.manager [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Took 5.14 seconds to spawn the instance on the hypervisor.
Oct 20 09:08:00 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:08:00 user nova-compute[74039]: INFO nova.compute.manager [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Took 24.63 seconds to build instance.
Oct 20 09:08:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ec1aff97-7985-4e82-aeb5-93861571ff9a tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.731s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:04 user nova-compute[74039]: DEBUG nova.compute.manager [req-8228635b-1707-4c1d-81a8-836eacca1232 req-24aa34e2-6d0a-459b-bc21-432beb7c5c4a service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Received event network-vif-plugged-0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:08:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8228635b-1707-4c1d-81a8-836eacca1232 req-24aa34e2-6d0a-459b-bc21-432beb7c5c4a service nova] Acquiring lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8228635b-1707-4c1d-81a8-836eacca1232 req-24aa34e2-6d0a-459b-bc21-432beb7c5c4a service nova] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8228635b-1707-4c1d-81a8-836eacca1232 req-24aa34e2-6d0a-459b-bc21-432beb7c5c4a service nova] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:04 user nova-compute[74039]: DEBUG nova.compute.manager [req-8228635b-1707-4c1d-81a8-836eacca1232 req-24aa34e2-6d0a-459b-bc21-432beb7c5c4a service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] No waiting events found dispatching network-vif-plugged-0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:08:04 user nova-compute[74039]: WARNING nova.compute.manager [req-8228635b-1707-4c1d-81a8-836eacca1232 req-24aa34e2-6d0a-459b-bc21-432beb7c5c4a service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Received unexpected event network-vif-plugged-0f6af989-65a9-4d64-ade0-b547815b31af for instance with vm_state active and task_state None.
Oct 20 09:08:06 user nova-compute[74039]: DEBUG nova.compute.manager [req-5f796019-6272-46c0-b1a5-0003f3b9bfe3 req-4e251413-7670-404a-8979-4d49e842bd49 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Received event network-vif-plugged-0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:08:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5f796019-6272-46c0-b1a5-0003f3b9bfe3 req-4e251413-7670-404a-8979-4d49e842bd49 service nova] Acquiring lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5f796019-6272-46c0-b1a5-0003f3b9bfe3 req-4e251413-7670-404a-8979-4d49e842bd49 service nova] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5f796019-6272-46c0-b1a5-0003f3b9bfe3 req-4e251413-7670-404a-8979-4d49e842bd49 service nova] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:06 user nova-compute[74039]: DEBUG nova.compute.manager [req-5f796019-6272-46c0-b1a5-0003f3b9bfe3 req-4e251413-7670-404a-8979-4d49e842bd49 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] No waiting events found dispatching network-vif-plugged-0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:08:06 user nova-compute[74039]: WARNING nova.compute.manager [req-5f796019-6272-46c0-b1a5-0003f3b9bfe3 req-4e251413-7670-404a-8979-4d49e842bd49 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Received unexpected event network-vif-plugged-0f6af989-65a9-4d64-ade0-b547815b31af for instance with vm_state active and task_state None.
Oct 20 09:08:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Acquiring lock "9589267e-e485-4f18-a435-c2623c949937" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "9589267e-e485-4f18-a435-c2623c949937" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:08:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:07 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:08:07 user nova-compute[74039]: INFO nova.compute.claims [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Claim successful on node user
Oct 20 09:08:07 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:08:07 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:08:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:08:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:08:07 user nova-compute[74039]: DEBUG nova.network.neutron [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:08:07 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:08:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:08:08 user nova-compute[74039]: DEBUG nova.policy [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '643e363e890d49f987785acb0e967281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5443955df42049cbaddfaa14af72a30d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:08:08 user nova-compute[74039]: DEBUG nova.compute.manager [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:08:08 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:08:08 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Creating image(s)
Oct 20 09:08:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Acquiring lock "/opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "/opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "/opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.182s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk 1073741824" returned: 0 in 0.142s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.326s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:08 user nova-compute[74039]: DEBUG nova.network.neutron [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Successfully created port: 88781e7b-db18-4d13-81c8-1408a4a40725 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:08:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.233s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:08 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:08:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Cannot resize image /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Ensure instance console log exists: /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.network.neutron [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Successfully updated port: 88781e7b-db18-4d13-81c8-1408a4a40725 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Acquiring lock "refresh_cache-9589267e-e485-4f18-a435-c2623c949937" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Acquired lock "refresh_cache-9589267e-e485-4f18-a435-c2623c949937" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.network.neutron [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-a2dcc34c-e99f-4cfe-977c-da94e1d298fc req-7e880893-a9b9-46ed-a6cf-d79b36cd5981 service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] Received event network-changed-88781e7b-db18-4d13-81c8-1408a4a40725 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-a2dcc34c-e99f-4cfe-977c-da94e1d298fc req-7e880893-a9b9-46ed-a6cf-d79b36cd5981 service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] Refreshing instance network info cache due to event network-changed-88781e7b-db18-4d13-81c8-1408a4a40725. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a2dcc34c-e99f-4cfe-977c-da94e1d298fc req-7e880893-a9b9-46ed-a6cf-d79b36cd5981 service nova] Acquiring lock "refresh_cache-9589267e-e485-4f18-a435-c2623c949937" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.network.neutron [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.network.neutron [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Updating instance_info_cache with network_info: [{"id": "88781e7b-db18-4d13-81c8-1408a4a40725", "address": "fa:16:3e:a9:a8:9e", "network": {"id": "198b9730-8e45-4bb2-92ae-55624d070e9a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808796854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5443955df42049cbaddfaa14af72a30d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88781e7b-db", "ovs_interfaceid": "88781e7b-db18-4d13-81c8-1408a4a40725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Releasing lock "refresh_cache-9589267e-e485-4f18-a435-c2623c949937" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.compute.manager [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Instance network_info: |[{"id": "88781e7b-db18-4d13-81c8-1408a4a40725", "address": "fa:16:3e:a9:a8:9e", "network": {"id": "198b9730-8e45-4bb2-92ae-55624d070e9a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808796854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5443955df42049cbaddfaa14af72a30d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88781e7b-db", "ovs_interfaceid": "88781e7b-db18-4d13-81c8-1408a4a40725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a2dcc34c-e99f-4cfe-977c-da94e1d298fc req-7e880893-a9b9-46ed-a6cf-d79b36cd5981 service nova] Acquired lock "refresh_cache-9589267e-e485-4f18-a435-c2623c949937" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.network.neutron [req-a2dcc34c-e99f-4cfe-977c-da94e1d298fc req-7e880893-a9b9-46ed-a6cf-d79b36cd5981 service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] Refreshing network info cache for port 88781e7b-db18-4d13-81c8-1408a4a40725 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Start _get_guest_xml network_info=[{"id": "88781e7b-db18-4d13-81c8-1408a4a40725", "address": "fa:16:3e:a9:a8:9e", "network": {"id": "198b9730-8e45-4bb2-92ae-55624d070e9a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808796854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5443955df42049cbaddfaa14af72a30d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88781e7b-db", "ovs_interfaceid": "88781e7b-db18-4d13-81c8-1408a4a40725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:08:09 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:08:09 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1529463264',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1529463264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1529463',id=35,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpasCVn46ZR5GXMBUoXjUevMdxxe9+TL961C7evUBpC40kr46yjAaXhndQAqNEjh3bSchzmdZTIsO/usKr2bAkku+UMrf4vkIM6ospy/LfaVdN4ndo2I4tiIopIUzn++A==',key_name='tempest-keypair-1303445713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5443955df42049cbaddfaa14af72a30d',ramdisk_id='',reservation_id='r-fzz4r4fl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1465022385',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='643e363e890d49f987785acb0e967281',uuid=9589267e-e485-4f18-a435-c2623c949937,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88781e7b-db18-4d13-81c8-1408a4a40725", "address": "fa:16:3e:a9:a8:9e", "network": {"id": "198b9730-8e45-4bb2-92ae-55624d070e9a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808796854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5443955df42049cbaddfaa14af72a30d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88781e7b-db", "ovs_interfaceid": "88781e7b-db18-4d13-81c8-1408a4a40725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Converting VIF {"id": "88781e7b-db18-4d13-81c8-1408a4a40725", "address": "fa:16:3e:a9:a8:9e", "network": {"id": "198b9730-8e45-4bb2-92ae-55624d070e9a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808796854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5443955df42049cbaddfaa14af72a30d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88781e7b-db", "ovs_interfaceid": "88781e7b-db18-4d13-81c8-1408a4a40725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:a8:9e,bridge_name='br-int',has_traffic_filtering=True,id=88781e7b-db18-4d13-81c8-1408a4a40725,network=Network(198b9730-8e45-4bb2-92ae-55624d070e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88781e7b-db') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.objects.instance [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lazy-loading 'pci_devices' on Instance uuid 9589267e-e485-4f18-a435-c2623c949937 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:08:09 user nova-compute[74039]:   <uuid>9589267e-e485-4f18-a435-c2623c949937</uuid>
Oct 20 09:08:09 user nova-compute[74039]:   <name>instance-00000023</name>
Oct 20 09:08:09 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:08:09 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:08:09 user nova-compute[74039]:   <metadata>
Oct 20 09:08:09 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:08:09 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:08:09 user nova-compute[74039]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1529463264</nova:name>
Oct 20 09:08:09 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:08:09</nova:creationTime>
Oct 20 09:08:09 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:08:09 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:08:09 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:08:09 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:08:09 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:08:09 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:08:09 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:08:09 user nova-compute[74039]:       <nova:owner>
Oct 20 09:08:09 user nova-compute[74039]:         <nova:user uuid="643e363e890d49f987785acb0e967281">tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member</nova:user>
Oct 20 09:08:09 user nova-compute[74039]:         <nova:project uuid="5443955df42049cbaddfaa14af72a30d">tempest-TestServerVolumeAttachScenarioOldVersion-1465022385</nova:project>
Oct 20 09:08:09 user nova-compute[74039]:       </nova:owner>
Oct 20 09:08:09 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:08:09 user nova-compute[74039]:       <nova:ports>
Oct 20 09:08:09 user nova-compute[74039]:         <nova:port uuid="88781e7b-db18-4d13-81c8-1408a4a40725">
Oct 20 09:08:09 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 09:08:09 user nova-compute[74039]:         </nova:port>
Oct 20 09:08:09 user nova-compute[74039]:       </nova:ports>
Oct 20 09:08:09 user nova-compute[74039]:     </nova:instance>
Oct 20 09:08:09 user nova-compute[74039]:   </metadata>
Oct 20 09:08:09 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:08:09 user nova-compute[74039]:     <system>
Oct 20 09:08:09 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:08:09 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:08:09 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:08:09 user nova-compute[74039]:       <entry name="serial">9589267e-e485-4f18-a435-c2623c949937</entry>
Oct 20 09:08:09 user nova-compute[74039]:       <entry name="uuid">9589267e-e485-4f18-a435-c2623c949937</entry>
Oct 20 09:08:09 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:08:09 user nova-compute[74039]:     </system>
Oct 20 09:08:09 user nova-compute[74039]:   </sysinfo>
Oct 20 09:08:09 user nova-compute[74039]:   <os>
Oct 20 09:08:09 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:08:09 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:08:09 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:08:09 user nova-compute[74039]:   </os>
Oct 20 09:08:09 user nova-compute[74039]:   <features>
Oct 20 09:08:09 user nova-compute[74039]:     <acpi/>
Oct 20 09:08:09 user nova-compute[74039]:     <apic/>
Oct 20 09:08:09 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:08:09 user nova-compute[74039]:   </features>
Oct 20 09:08:09 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:08:09 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:08:09 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:08:09 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:08:09 user nova-compute[74039]:   </clock>
Oct 20 09:08:09 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:08:09 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:08:09 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:08:09 user nova-compute[74039]:   </cpu>
Oct 20 09:08:09 user nova-compute[74039]:   <devices>
Oct 20 09:08:09 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:08:09 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:08:09 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk"/>
Oct 20 09:08:09 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:08:09 user nova-compute[74039]:     </disk>
Oct 20 09:08:09 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:08:09 user nova-compute[74039]:       <mac address="fa:16:3e:a9:a8:9e"/>
Oct 20 09:08:09 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:08:09 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:08:09 user nova-compute[74039]:       <target dev="tap88781e7b-db"/>
Oct 20 09:08:09 user nova-compute[74039]:     </interface>
Oct 20 09:08:09 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:08:09 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/console.log" append="off"/>
Oct 20 09:08:09 user nova-compute[74039]:     </serial>
Oct 20 09:08:09 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:08:09 user nova-compute[74039]:     <video>
Oct 20 09:08:09 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:08:09 user nova-compute[74039]:     </video>
Oct 20 09:08:09 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:08:09 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:08:09 user nova-compute[74039]:     </rng>
Oct 20 09:08:09 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:08:09 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:08:09 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:08:09 user nova-compute[74039]:     </memballoon>
Oct 20 09:08:09 user nova-compute[74039]:   </devices>
Oct 20 09:08:09 user nova-compute[74039]: </domain>
Oct 20 09:08:09 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1529463264',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1529463264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1529463',id=35,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpasCVn46ZR5GXMBUoXjUevMdxxe9+TL961C7evUBpC40kr46yjAaXhndQAqNEjh3bSchzmdZTIsO/usKr2bAkku+UMrf4vkIM6ospy/LfaVdN4ndo2I4tiIopIUzn++A==',key_name='tempest-keypair-1303445713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5443955df42049cbaddfaa14af72a30d',ramdisk_id='',reservation_id='r-fzz4r4fl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1465022385',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='643e363e890d49f987785acb0e967281',uuid=9589267e-e485-4f18-a435-c2623c949937,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88781e7b-db18-4d13-81c8-1408a4a40725", "address": "fa:16:3e:a9:a8:9e", "network": {"id": "198b9730-8e45-4bb2-92ae-55624d070e9a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808796854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5443955df42049cbaddfaa14af72a30d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88781e7b-db", "ovs_interfaceid": "88781e7b-db18-4d13-81c8-1408a4a40725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Converting VIF {"id": "88781e7b-db18-4d13-81c8-1408a4a40725", "address": "fa:16:3e:a9:a8:9e", "network": {"id": "198b9730-8e45-4bb2-92ae-55624d070e9a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808796854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5443955df42049cbaddfaa14af72a30d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88781e7b-db", "ovs_interfaceid": "88781e7b-db18-4d13-81c8-1408a4a40725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:a8:9e,bridge_name='br-int',has_traffic_filtering=True,id=88781e7b-db18-4d13-81c8-1408a4a40725,network=Network(198b9730-8e45-4bb2-92ae-55624d070e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88781e7b-db') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG os_vif [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:a8:9e,bridge_name='br-int',has_traffic_filtering=True,id=88781e7b-db18-4d13-81c8-1408a4a40725,network=Network(198b9730-8e45-4bb2-92ae-55624d070e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88781e7b-db') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d6aad53-b3ab-5321-a97d-1b805dce8aa7', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88781e7b-db, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88781e7b-db, col_values=(('qos', UUID('1106300f-e2b5-4524-9c30-dc7133331abb')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88781e7b-db, col_values=(('external_ids', {'iface-id': '88781e7b-db18-4d13-81c8-1408a4a40725', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:a8:9e', 'vm-uuid': '9589267e-e485-4f18-a435-c2623c949937'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:09 user nova-compute[74039]: INFO os_vif [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:a8:9e,bridge_name='br-int',has_traffic_filtering=True,id=88781e7b-db18-4d13-81c8-1408a4a40725,network=Network(198b9730-8e45-4bb2-92ae-55624d070e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88781e7b-db')
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:08:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] No VIF found with MAC fa:16:3e:a9:a8:9e, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:08:10 user nova-compute[74039]: DEBUG nova.network.neutron [req-a2dcc34c-e99f-4cfe-977c-da94e1d298fc req-7e880893-a9b9-46ed-a6cf-d79b36cd5981 service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] Updated VIF entry in instance network info cache for port 88781e7b-db18-4d13-81c8-1408a4a40725. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:08:10 user nova-compute[74039]: DEBUG nova.network.neutron [req-a2dcc34c-e99f-4cfe-977c-da94e1d298fc req-7e880893-a9b9-46ed-a6cf-d79b36cd5981 service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] Updating instance_info_cache with network_info: [{"id": "88781e7b-db18-4d13-81c8-1408a4a40725", "address": "fa:16:3e:a9:a8:9e", "network": {"id": "198b9730-8e45-4bb2-92ae-55624d070e9a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808796854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5443955df42049cbaddfaa14af72a30d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88781e7b-db", "ovs_interfaceid": "88781e7b-db18-4d13-81c8-1408a4a40725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:08:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a2dcc34c-e99f-4cfe-977c-da94e1d298fc req-7e880893-a9b9-46ed-a6cf-d79b36cd5981 service nova] Releasing lock "refresh_cache-9589267e-e485-4f18-a435-c2623c949937" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:08:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-d9fe3e0b-db34-4237-bac2-a4b8a900baf5 req-ff2064d1-1395-40d3-ad24-ede3ac82f575 service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] Received event network-vif-plugged-88781e7b-db18-4d13-81c8-1408a4a40725 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:08:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d9fe3e0b-db34-4237-bac2-a4b8a900baf5 req-ff2064d1-1395-40d3-ad24-ede3ac82f575 service nova] Acquiring lock "9589267e-e485-4f18-a435-c2623c949937-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d9fe3e0b-db34-4237-bac2-a4b8a900baf5 req-ff2064d1-1395-40d3-ad24-ede3ac82f575 service nova] Lock "9589267e-e485-4f18-a435-c2623c949937-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d9fe3e0b-db34-4237-bac2-a4b8a900baf5 req-ff2064d1-1395-40d3-ad24-ede3ac82f575 service nova] Lock "9589267e-e485-4f18-a435-c2623c949937-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-d9fe3e0b-db34-4237-bac2-a4b8a900baf5 req-ff2064d1-1395-40d3-ad24-ede3ac82f575 service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] No waiting events found dispatching network-vif-plugged-88781e7b-db18-4d13-81c8-1408a4a40725 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:08:11 user nova-compute[74039]: WARNING nova.compute.manager [req-d9fe3e0b-db34-4237-bac2-a4b8a900baf5 req-ff2064d1-1395-40d3-ad24-ede3ac82f575 service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] Received unexpected event network-vif-plugged-88781e7b-db18-4d13-81c8-1408a4a40725 for instance with vm_state building and task_state spawning.
Oct 20 09:08:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:13 user nova-compute[74039]: DEBUG nova.compute.manager [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:08:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:08:13 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 9589267e-e485-4f18-a435-c2623c949937] Instance spawned successfully.
Oct 20 09:08:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:08:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:08:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:08:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:08:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:08:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:08:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:08:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-4e8ff4ac-309b-4262-9f35-bb0cef463055 req-73344180-7563-45b4-ac66-7075563bd3df service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] Received event network-vif-plugged-88781e7b-db18-4d13-81c8-1408a4a40725 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:08:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4e8ff4ac-309b-4262-9f35-bb0cef463055 req-73344180-7563-45b4-ac66-7075563bd3df service nova] Acquiring lock "9589267e-e485-4f18-a435-c2623c949937-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4e8ff4ac-309b-4262-9f35-bb0cef463055 req-73344180-7563-45b4-ac66-7075563bd3df service nova] Lock "9589267e-e485-4f18-a435-c2623c949937-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4e8ff4ac-309b-4262-9f35-bb0cef463055 req-73344180-7563-45b4-ac66-7075563bd3df service nova] Lock "9589267e-e485-4f18-a435-c2623c949937-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-4e8ff4ac-309b-4262-9f35-bb0cef463055 req-73344180-7563-45b4-ac66-7075563bd3df service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] No waiting events found dispatching network-vif-plugged-88781e7b-db18-4d13-81c8-1408a4a40725 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:08:13 user nova-compute[74039]: WARNING nova.compute.manager [req-4e8ff4ac-309b-4262-9f35-bb0cef463055 req-73344180-7563-45b4-ac66-7075563bd3df service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] Received unexpected event network-vif-plugged-88781e7b-db18-4d13-81c8-1408a4a40725 for instance with vm_state building and task_state spawning.
Oct 20 09:08:13 user nova-compute[74039]: INFO nova.compute.manager [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Took 5.42 seconds to spawn the instance on the hypervisor.
Oct 20 09:08:13 user nova-compute[74039]: DEBUG nova.compute.manager [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:08:13 user nova-compute[74039]: INFO nova.compute.manager [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Took 6.15 seconds to build instance.
Oct 20 09:08:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-dfa8a3aa-8529-43ee-bd3e-fcded787ea97 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "9589267e-e485-4f18-a435-c2623c949937" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.247s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Acquiring lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Acquiring lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:22 user nova-compute[74039]: INFO nova.compute.manager [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Terminating instance
Oct 20 09:08:22 user nova-compute[74039]: DEBUG nova.compute.manager [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG nova.compute.manager [req-eec883fe-daf0-4d04-9b4f-0351ff6b0107 req-a8cb4da6-ba05-4d34-bdeb-f221985ec8a4 service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Received event network-vif-unplugged-f786f476-35e0-47de-b484-f8cb3e051827 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eec883fe-daf0-4d04-9b4f-0351ff6b0107 req-a8cb4da6-ba05-4d34-bdeb-f221985ec8a4 service nova] Acquiring lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eec883fe-daf0-4d04-9b4f-0351ff6b0107 req-a8cb4da6-ba05-4d34-bdeb-f221985ec8a4 service nova] Lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eec883fe-daf0-4d04-9b4f-0351ff6b0107 req-a8cb4da6-ba05-4d34-bdeb-f221985ec8a4 service nova] Lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG nova.compute.manager [req-eec883fe-daf0-4d04-9b4f-0351ff6b0107 req-a8cb4da6-ba05-4d34-bdeb-f221985ec8a4 service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] No waiting events found dispatching network-vif-unplugged-f786f476-35e0-47de-b484-f8cb3e051827 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG nova.compute.manager [req-eec883fe-daf0-4d04-9b4f-0351ff6b0107 req-a8cb4da6-ba05-4d34-bdeb-f221985ec8a4 service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Received event network-vif-unplugged-f786f476-35e0-47de-b484-f8cb3e051827 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:08:22 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Instance destroyed successfully.
Oct 20 09:08:22 user nova-compute[74039]: DEBUG nova.objects.instance [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Lazy-loading 'resources' on Instance uuid a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1228966317',display_name='tempest-VolumesActionsTest-instance-1228966317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1228966317',id=32,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:06:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7cf35e8d8cb41f98f3de737ff544a74',ramdisk_id='',reservation_id='r-pahuo5h9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-228152859',owner_user_name='tempest-VolumesActionsTest-228152859-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:06:18Z,user_data=None,user_id='e48d8af744fc47b682bacfd9015a6870',uuid=a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f786f476-35e0-47de-b484-f8cb3e051827", "address": "fa:16:3e:08:4f:03", "network": {"id": "0b8f3326-2b1d-4695-aa87-f83e69019ecd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2001819388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7cf35e8d8cb41f98f3de737ff544a74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf786f476-35", "ovs_interfaceid": "f786f476-35e0-47de-b484-f8cb3e051827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Converting VIF {"id": "f786f476-35e0-47de-b484-f8cb3e051827", "address": "fa:16:3e:08:4f:03", "network": {"id": "0b8f3326-2b1d-4695-aa87-f83e69019ecd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2001819388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7cf35e8d8cb41f98f3de737ff544a74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf786f476-35", "ovs_interfaceid": "f786f476-35e0-47de-b484-f8cb3e051827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:4f:03,bridge_name='br-int',has_traffic_filtering=True,id=f786f476-35e0-47de-b484-f8cb3e051827,network=Network(0b8f3326-2b1d-4695-aa87-f83e69019ecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf786f476-35') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG os_vif [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:4f:03,bridge_name='br-int',has_traffic_filtering=True,id=f786f476-35e0-47de-b484-f8cb3e051827,network=Network(0b8f3326-2b1d-4695-aa87-f83e69019ecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf786f476-35') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf786f476-35, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ded56c8-7a3a-4c0a-b3a0-e23cdfee65c6) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:22 user nova-compute[74039]: INFO os_vif [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:4f:03,bridge_name='br-int',has_traffic_filtering=True,id=f786f476-35e0-47de-b484-f8cb3e051827,network=Network(0b8f3326-2b1d-4695-aa87-f83e69019ecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf786f476-35')
Oct 20 09:08:22 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Deleting instance files /opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4_del
Oct 20 09:08:22 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Deletion of /opt/stack/data/nova/instances/a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4_del complete
Oct 20 09:08:22 user nova-compute[74039]: INFO nova.compute.manager [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Took 0.82 seconds to destroy the instance on the hypervisor.
Oct 20 09:08:22 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:08:22 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:08:23 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:08:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-9ee517c3-5075-4f4f-88c9-45c9e5b69c2f req-8b82e658-4761-41e2-a948-fb324f188cf8 service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Received event network-vif-deleted-f786f476-35e0-47de-b484-f8cb3e051827 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:08:23 user nova-compute[74039]: INFO nova.compute.manager [req-9ee517c3-5075-4f4f-88c9-45c9e5b69c2f req-8b82e658-4761-41e2-a948-fb324f188cf8 service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Neutron deleted interface f786f476-35e0-47de-b484-f8cb3e051827; detaching it from the instance and deleting it from the info cache
Oct 20 09:08:23 user nova-compute[74039]: DEBUG nova.network.neutron [req-9ee517c3-5075-4f4f-88c9-45c9e5b69c2f req-8b82e658-4761-41e2-a948-fb324f188cf8 service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:08:23 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Took 0.93 seconds to deallocate network for instance.
Oct 20 09:08:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-9ee517c3-5075-4f4f-88c9-45c9e5b69c2f req-8b82e658-4761-41e2-a948-fb324f188cf8 service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Detach interface failed, port_id=f786f476-35e0-47de-b484-f8cb3e051827, reason: Instance a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4 could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 09:08:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:24 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:08:24 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:08:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:24 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Deleted allocations for instance a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4
Oct 20 09:08:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cb3aa1a8-7aee-4846-b709-22320e425a21 tempest-VolumesActionsTest-228152859 tempest-VolumesActionsTest-228152859-project-member] Lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.517s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:24 user nova-compute[74039]: DEBUG nova.compute.manager [req-c8bf1e05-e1ae-49c3-aff9-13f14e236906 req-a2fa8357-709c-4b47-9512-36039a5b644f service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Received event network-vif-plugged-f786f476-35e0-47de-b484-f8cb3e051827 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:08:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c8bf1e05-e1ae-49c3-aff9-13f14e236906 req-a2fa8357-709c-4b47-9512-36039a5b644f service nova] Acquiring lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c8bf1e05-e1ae-49c3-aff9-13f14e236906 req-a2fa8357-709c-4b47-9512-36039a5b644f service nova] Lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c8bf1e05-e1ae-49c3-aff9-13f14e236906 req-a2fa8357-709c-4b47-9512-36039a5b644f service nova] Lock "a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:24 user nova-compute[74039]: DEBUG nova.compute.manager [req-c8bf1e05-e1ae-49c3-aff9-13f14e236906 req-a2fa8357-709c-4b47-9512-36039a5b644f service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] No waiting events found dispatching network-vif-plugged-f786f476-35e0-47de-b484-f8cb3e051827 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:08:24 user nova-compute[74039]: WARNING nova.compute.manager [req-c8bf1e05-e1ae-49c3-aff9-13f14e236906 req-a2fa8357-709c-4b47-9512-36039a5b644f service nova] [instance: a00b3d8b-22a6-4e54-8eb4-5ce7981efcb4] Received unexpected event network-vif-plugged-f786f476-35e0-47de-b484-f8cb3e051827 for instance with vm_state deleted and task_state None.
Oct 20 09:08:25 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:08:25 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:08:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:08:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:08:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:08:27 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Updating instance_info_cache with network_info: [{"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:08:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-00e09d93-3077-4770-abfd-b82ece646997" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:08:27 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:08:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:08:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:08:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:08:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:08:27 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:08:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:08:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:08:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:30 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:08:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:08:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:31 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:08:31 user nova-compute[74039]: INFO nova.compute.claims [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Claim successful on node user
Oct 20 09:08:32 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:08:32 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:08:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:32 user nova-compute[74039]: DEBUG nova.compute.manager [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:08:32 user nova-compute[74039]: DEBUG nova.compute.manager [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:08:32 user nova-compute[74039]: DEBUG nova.network.neutron [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:08:32 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:08:32 user nova-compute[74039]: DEBUG nova.compute.manager [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:08:32 user nova-compute[74039]: INFO nova.virt.block_device [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Booting with blank volume at /dev/vda
Oct 20 09:08:32 user nova-compute[74039]: DEBUG nova.policy [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e07a52b4e3b4a65b34f71fb2cca8de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ed96a82048434fb0d79a55838184e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:08:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:33 user nova-compute[74039]: DEBUG nova.network.neutron [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Successfully created port: f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:08:33 user nova-compute[74039]: DEBUG nova.network.neutron [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Successfully updated port: f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:08:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:08:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquired lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:08:33 user nova-compute[74039]: DEBUG nova.network.neutron [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:08:33 user nova-compute[74039]: DEBUG nova.compute.manager [req-db0a4178-8f49-4e37-971e-f877fb66808b req-7432b654-f0b2-4521-b64d-4e3c5ac5c06c service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received event network-changed-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:08:33 user nova-compute[74039]: DEBUG nova.compute.manager [req-db0a4178-8f49-4e37-971e-f877fb66808b req-7432b654-f0b2-4521-b64d-4e3c5ac5c06c service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Refreshing instance network info cache due to event network-changed-f9fc0a1c-ee0c-4540-9221-b93d88aafe99. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:08:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-db0a4178-8f49-4e37-971e-f877fb66808b req-7432b654-f0b2-4521-b64d-4e3c5ac5c06c service nova] Acquiring lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:08:33 user nova-compute[74039]: DEBUG nova.network.neutron [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:08:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:34 user nova-compute[74039]: DEBUG nova.network.neutron [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Updating instance_info_cache with network_info: [{"id": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "address": "fa:16:3e:63:49:5e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc0a1c-ee", "ovs_interfaceid": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:08:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Releasing lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:08:34 user nova-compute[74039]: DEBUG nova.compute.manager [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Instance network_info: |[{"id": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "address": "fa:16:3e:63:49:5e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc0a1c-ee", "ovs_interfaceid": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:08:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-db0a4178-8f49-4e37-971e-f877fb66808b req-7432b654-f0b2-4521-b64d-4e3c5ac5c06c service nova] Acquired lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:08:34 user nova-compute[74039]: DEBUG nova.network.neutron [req-db0a4178-8f49-4e37-971e-f877fb66808b req-7432b654-f0b2-4521-b64d-4e3c5ac5c06c service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Refreshing network info cache for port f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:08:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "a250449f-72d0-4b64-825b-d47e0dff471a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "a250449f-72d0-4b64-825b-d47e0dff471a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:34 user nova-compute[74039]: DEBUG nova.compute.manager [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:08:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:34 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:08:34 user nova-compute[74039]: INFO nova.compute.claims [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Claim successful on node user
Oct 20 09:08:34 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:08:34 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:08:34 user nova-compute[74039]: DEBUG nova.network.neutron [req-db0a4178-8f49-4e37-971e-f877fb66808b req-7432b654-f0b2-4521-b64d-4e3c5ac5c06c service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Updated VIF entry in instance network info cache for port f9fc0a1c-ee0c-4540-9221-b93d88aafe99. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:08:34 user nova-compute[74039]: DEBUG nova.network.neutron [req-db0a4178-8f49-4e37-971e-f877fb66808b req-7432b654-f0b2-4521-b64d-4e3c5ac5c06c service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Updating instance_info_cache with network_info: [{"id": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "address": "fa:16:3e:63:49:5e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc0a1c-ee", "ovs_interfaceid": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:08:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:34 user nova-compute[74039]: DEBUG nova.compute.manager [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:08:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-db0a4178-8f49-4e37-971e-f877fb66808b req-7432b654-f0b2-4521-b64d-4e3c5ac5c06c service nova] Releasing lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:08:34 user nova-compute[74039]: DEBUG nova.compute.manager [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:08:34 user nova-compute[74039]: DEBUG nova.network.neutron [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:08:34 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:08:34 user nova-compute[74039]: DEBUG nova.compute.manager [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:08:34 user nova-compute[74039]: DEBUG nova.policy [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6faf5f2e03204805a06ac9f83b9a61bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '143bda69e4714560b4b2286adaefb4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG nova.compute.manager [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:08:35 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Creating image(s)
Oct 20 09:08:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "/opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "/opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "/opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.192s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.182s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk 1073741824" returned: 0 in 0.046s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG nova.network.neutron [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Successfully created port: d20c0187-4d18-4dd3-8288-b59b1f841a71 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Cannot resize image /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Ensure instance console log exists: /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.network.neutron [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Successfully updated port: d20c0187-4d18-4dd3-8288-b59b1f841a71 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "refresh_cache-a250449f-72d0-4b64-825b-d47e0dff471a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquired lock "refresh_cache-a250449f-72d0-4b64-825b-d47e0dff471a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.network.neutron [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.compute.manager [req-45394ef7-6e4b-46f3-a46a-0d9b197ddb08 req-af749c57-75d4-425f-8f7b-7af7e3a722a6 service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Received event network-changed-d20c0187-4d18-4dd3-8288-b59b1f841a71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.compute.manager [req-45394ef7-6e4b-46f3-a46a-0d9b197ddb08 req-af749c57-75d4-425f-8f7b-7af7e3a722a6 service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Refreshing instance network info cache due to event network-changed-d20c0187-4d18-4dd3-8288-b59b1f841a71. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-45394ef7-6e4b-46f3-a46a-0d9b197ddb08 req-af749c57-75d4-425f-8f7b-7af7e3a722a6 service nova] Acquiring lock "refresh_cache-a250449f-72d0-4b64-825b-d47e0dff471a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.network.neutron [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.network.neutron [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Updating instance_info_cache with network_info: [{"id": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "address": "fa:16:3e:35:39:59", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c0187-4d", "ovs_interfaceid": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Releasing lock "refresh_cache-a250449f-72d0-4b64-825b-d47e0dff471a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.compute.manager [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Instance network_info: |[{"id": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "address": "fa:16:3e:35:39:59", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c0187-4d", "ovs_interfaceid": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-45394ef7-6e4b-46f3-a46a-0d9b197ddb08 req-af749c57-75d4-425f-8f7b-7af7e3a722a6 service nova] Acquired lock "refresh_cache-a250449f-72d0-4b64-825b-d47e0dff471a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.network.neutron [req-45394ef7-6e4b-46f3-a46a-0d9b197ddb08 req-af749c57-75d4-425f-8f7b-7af7e3a722a6 service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Refreshing network info cache for port d20c0187-4d18-4dd3-8288-b59b1f841a71 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Start _get_guest_xml network_info=[{"id": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "address": "fa:16:3e:35:39:59", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c0187-4d", "ovs_interfaceid": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:08:36 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:08:36 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:08:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1880434280',display_name='tempest-AttachVolumeNegativeTest-server-1880434280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1880434280',id=37,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvoutzbOI4PJvBd2S5Wt4TwXsa556j2Br7X7CFuGIvzSFK9NSVbi2ihiZ55sc0eJPx9qY6p841KLwTTTUVNj0qrlQ77W5a0YniA0ypNX3EDtNbn086l8URYFXdo8Bobvg==',key_name='tempest-keypair-618841242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='143bda69e4714560b4b2286adaefb4c5',ramdisk_id='',reservation_id='r-vjoflt5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-639731200',owner_user_name='tempest-AttachVolumeNegativeTest-639731200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:08:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6faf5f2e03204805a06ac9f83b9a61bb',uuid=a250449f-72d0-4b64-825b-d47e0dff471a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "address": "fa:16:3e:35:39:59", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c0187-4d", "ovs_interfaceid": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converting VIF {"id": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "address": "fa:16:3e:35:39:59", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c0187-4d", "ovs_interfaceid": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:39:59,bridge_name='br-int',has_traffic_filtering=True,id=d20c0187-4d18-4dd3-8288-b59b1f841a71,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c0187-4d') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.objects.instance [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lazy-loading 'pci_devices' on Instance uuid a250449f-72d0-4b64-825b-d47e0dff471a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:08:36 user nova-compute[74039]:   <uuid>a250449f-72d0-4b64-825b-d47e0dff471a</uuid>
Oct 20 09:08:36 user nova-compute[74039]:   <name>instance-00000025</name>
Oct 20 09:08:36 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:08:36 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:08:36 user nova-compute[74039]:   <metadata>
Oct 20 09:08:36 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:08:36 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:08:36 user nova-compute[74039]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1880434280</nova:name>
Oct 20 09:08:36 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:08:36</nova:creationTime>
Oct 20 09:08:36 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:08:36 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:08:36 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:08:36 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:08:36 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:08:36 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:08:36 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:08:36 user nova-compute[74039]:       <nova:owner>
Oct 20 09:08:36 user nova-compute[74039]:         <nova:user uuid="6faf5f2e03204805a06ac9f83b9a61bb">tempest-AttachVolumeNegativeTest-639731200-project-member</nova:user>
Oct 20 09:08:36 user nova-compute[74039]:         <nova:project uuid="143bda69e4714560b4b2286adaefb4c5">tempest-AttachVolumeNegativeTest-639731200</nova:project>
Oct 20 09:08:36 user nova-compute[74039]:       </nova:owner>
Oct 20 09:08:36 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:08:36 user nova-compute[74039]:       <nova:ports>
Oct 20 09:08:36 user nova-compute[74039]:         <nova:port uuid="d20c0187-4d18-4dd3-8288-b59b1f841a71">
Oct 20 09:08:36 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 09:08:36 user nova-compute[74039]:         </nova:port>
Oct 20 09:08:36 user nova-compute[74039]:       </nova:ports>
Oct 20 09:08:36 user nova-compute[74039]:     </nova:instance>
Oct 20 09:08:36 user nova-compute[74039]:   </metadata>
Oct 20 09:08:36 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:08:36 user nova-compute[74039]:     <system>
Oct 20 09:08:36 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:08:36 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:08:36 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:08:36 user nova-compute[74039]:       <entry name="serial">a250449f-72d0-4b64-825b-d47e0dff471a</entry>
Oct 20 09:08:36 user nova-compute[74039]:       <entry name="uuid">a250449f-72d0-4b64-825b-d47e0dff471a</entry>
Oct 20 09:08:36 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:08:36 user nova-compute[74039]:     </system>
Oct 20 09:08:36 user nova-compute[74039]:   </sysinfo>
Oct 20 09:08:36 user nova-compute[74039]:   <os>
Oct 20 09:08:36 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:08:36 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:08:36 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:08:36 user nova-compute[74039]:   </os>
Oct 20 09:08:36 user nova-compute[74039]:   <features>
Oct 20 09:08:36 user nova-compute[74039]:     <acpi/>
Oct 20 09:08:36 user nova-compute[74039]:     <apic/>
Oct 20 09:08:36 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:08:36 user nova-compute[74039]:   </features>
Oct 20 09:08:36 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:08:36 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:08:36 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:08:36 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:08:36 user nova-compute[74039]:   </clock>
Oct 20 09:08:36 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:08:36 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:08:36 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:08:36 user nova-compute[74039]:   </cpu>
Oct 20 09:08:36 user nova-compute[74039]:   <devices>
Oct 20 09:08:36 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:08:36 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:08:36 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk"/>
Oct 20 09:08:36 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:08:36 user nova-compute[74039]:     </disk>
Oct 20 09:08:36 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:08:36 user nova-compute[74039]:       <mac address="fa:16:3e:35:39:59"/>
Oct 20 09:08:36 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:08:36 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:08:36 user nova-compute[74039]:       <target dev="tapd20c0187-4d"/>
Oct 20 09:08:36 user nova-compute[74039]:     </interface>
Oct 20 09:08:36 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:08:36 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/console.log" append="off"/>
Oct 20 09:08:36 user nova-compute[74039]:     </serial>
Oct 20 09:08:36 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:08:36 user nova-compute[74039]:     <video>
Oct 20 09:08:36 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:08:36 user nova-compute[74039]:     </video>
Oct 20 09:08:36 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:08:36 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:08:36 user nova-compute[74039]:     </rng>
Oct 20 09:08:36 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:08:36 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:08:36 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:08:36 user nova-compute[74039]:     </memballoon>
Oct 20 09:08:36 user nova-compute[74039]:   </devices>
Oct 20 09:08:36 user nova-compute[74039]: </domain>
Oct 20 09:08:36 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:08:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1880434280',display_name='tempest-AttachVolumeNegativeTest-server-1880434280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1880434280',id=37,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvoutzbOI4PJvBd2S5Wt4TwXsa556j2Br7X7CFuGIvzSFK9NSVbi2ihiZ55sc0eJPx9qY6p841KLwTTTUVNj0qrlQ77W5a0YniA0ypNX3EDtNbn086l8URYFXdo8Bobvg==',key_name='tempest-keypair-618841242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='143bda69e4714560b4b2286adaefb4c5',ramdisk_id='',reservation_id='r-vjoflt5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-639731200',owner_user_name='tempest-AttachVolumeNegativeTest-639731200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:08:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6faf5f2e03204805a06ac9f83b9a61bb',uuid=a250449f-72d0-4b64-825b-d47e0dff471a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "address": "fa:16:3e:35:39:59", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c0187-4d", "ovs_interfaceid": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converting VIF {"id": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "address": "fa:16:3e:35:39:59", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c0187-4d", "ovs_interfaceid": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:39:59,bridge_name='br-int',has_traffic_filtering=True,id=d20c0187-4d18-4dd3-8288-b59b1f841a71,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c0187-4d') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG os_vif [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:39:59,bridge_name='br-int',has_traffic_filtering=True,id=d20c0187-4d18-4dd3-8288-b59b1f841a71,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c0187-4d') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5b49eea-5115-5a09-8f53-85c581a41de4', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd20c0187-4d, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd20c0187-4d, col_values=(('qos', UUID('4c5e33c7-8746-4176-af05-24b4ab11b60f')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd20c0187-4d, col_values=(('external_ids', {'iface-id': 'd20c0187-4d18-4dd3-8288-b59b1f841a71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:39:59', 'vm-uuid': 'a250449f-72d0-4b64-825b-d47e0dff471a'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:36 user nova-compute[74039]: INFO os_vif [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:39:59,bridge_name='br-int',has_traffic_filtering=True,id=d20c0187-4d18-4dd3-8288-b59b1f841a71,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c0187-4d')
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:08:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] No VIF found with MAC fa:16:3e:35:39:59, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:08:37 user nova-compute[74039]: DEBUG nova.network.neutron [req-45394ef7-6e4b-46f3-a46a-0d9b197ddb08 req-af749c57-75d4-425f-8f7b-7af7e3a722a6 service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Updated VIF entry in instance network info cache for port d20c0187-4d18-4dd3-8288-b59b1f841a71. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:08:37 user nova-compute[74039]: DEBUG nova.network.neutron [req-45394ef7-6e4b-46f3-a46a-0d9b197ddb08 req-af749c57-75d4-425f-8f7b-7af7e3a722a6 service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Updating instance_info_cache with network_info: [{"id": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "address": "fa:16:3e:35:39:59", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c0187-4d", "ovs_interfaceid": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:08:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-45394ef7-6e4b-46f3-a46a-0d9b197ddb08 req-af749c57-75d4-425f-8f7b-7af7e3a722a6 service nova] Releasing lock "refresh_cache-a250449f-72d0-4b64-825b-d47e0dff471a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG os_brick.utils [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db5245a-5b85-451e-8087-6e9d07adbaf9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9aa2deb-0a4f-4692-87c1-f48f84c9f966]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.045s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ee6a04-a4c5-44a8-bd12-31c1b45878ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f54934f-bb82-4616-8218-14cad7ee360f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:08:38 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee294738-4275-4140-839a-a50775f81a14]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG os_brick.utils [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Updating existing volume attachment record: b6babed8-870e-4a16-864d-8d8645613993 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG nova.compute.manager [req-eeb2eb6d-57f1-4c19-ab08-8822ee5b5ee7 req-4c43752d-7b2b-4b51-b247-1fd9f9ca5a5b service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Received event network-vif-plugged-d20c0187-4d18-4dd3-8288-b59b1f841a71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eeb2eb6d-57f1-4c19-ab08-8822ee5b5ee7 req-4c43752d-7b2b-4b51-b247-1fd9f9ca5a5b service nova] Acquiring lock "a250449f-72d0-4b64-825b-d47e0dff471a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eeb2eb6d-57f1-4c19-ab08-8822ee5b5ee7 req-4c43752d-7b2b-4b51-b247-1fd9f9ca5a5b service nova] Lock "a250449f-72d0-4b64-825b-d47e0dff471a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eeb2eb6d-57f1-4c19-ab08-8822ee5b5ee7 req-4c43752d-7b2b-4b51-b247-1fd9f9ca5a5b service nova] Lock "a250449f-72d0-4b64-825b-d47e0dff471a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG nova.compute.manager [req-eeb2eb6d-57f1-4c19-ab08-8822ee5b5ee7 req-4c43752d-7b2b-4b51-b247-1fd9f9ca5a5b service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] No waiting events found dispatching network-vif-plugged-d20c0187-4d18-4dd3-8288-b59b1f841a71 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:08:38 user nova-compute[74039]: WARNING nova.compute.manager [req-eeb2eb6d-57f1-4c19-ab08-8822ee5b5ee7 req-4c43752d-7b2b-4b51-b247-1fd9f9ca5a5b service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Received unexpected event network-vif-plugged-d20c0187-4d18-4dd3-8288-b59b1f841a71 for instance with vm_state building and task_state spawning.
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG nova.compute.manager [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:08:40 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Instance spawned successfully.
Oct 20 09:08:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:40 user nova-compute[74039]: INFO nova.compute.manager [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Took 5.41 seconds to spawn the instance on the hypervisor.
Oct 20 09:08:40 user nova-compute[74039]: DEBUG nova.compute.manager [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG nova.compute.manager [req-c680e1e9-cee0-4e40-918d-a8835d792e89 req-5e40fc75-91df-4ba6-8163-42a35b5f7b9a service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Received event network-vif-plugged-d20c0187-4d18-4dd3-8288-b59b1f841a71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c680e1e9-cee0-4e40-918d-a8835d792e89 req-5e40fc75-91df-4ba6-8163-42a35b5f7b9a service nova] Acquiring lock "a250449f-72d0-4b64-825b-d47e0dff471a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c680e1e9-cee0-4e40-918d-a8835d792e89 req-5e40fc75-91df-4ba6-8163-42a35b5f7b9a service nova] Lock "a250449f-72d0-4b64-825b-d47e0dff471a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c680e1e9-cee0-4e40-918d-a8835d792e89 req-5e40fc75-91df-4ba6-8163-42a35b5f7b9a service nova] Lock "a250449f-72d0-4b64-825b-d47e0dff471a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG nova.compute.manager [req-c680e1e9-cee0-4e40-918d-a8835d792e89 req-5e40fc75-91df-4ba6-8163-42a35b5f7b9a service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] No waiting events found dispatching network-vif-plugged-d20c0187-4d18-4dd3-8288-b59b1f841a71 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:08:40 user nova-compute[74039]: WARNING nova.compute.manager [req-c680e1e9-cee0-4e40-918d-a8835d792e89 req-5e40fc75-91df-4ba6-8163-42a35b5f7b9a service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Received unexpected event network-vif-plugged-d20c0187-4d18-4dd3-8288-b59b1f841a71 for instance with vm_state building and task_state spawning.
Oct 20 09:08:40 user nova-compute[74039]: INFO nova.compute.manager [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Took 6.14 seconds to build instance.
Oct 20 09:08:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-77c3d907-5b39-4d85-adb6-de5adb74425c tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "a250449f-72d0-4b64-825b-d47e0dff471a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.243s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:08:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:08:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:08:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:42 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:08:42 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:08:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7445MB free_disk=24.311908721923828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:08:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:08:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4f5d98e3-c1f6-4617-8847-b975e2c23990 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:08:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 00e09d93-3077-4770-abfd-b82ece646997 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:08:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance eca753ae-f542-431d-bb70-197394e6c566 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:08:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:08:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance eb7a44c0-2405-4ff2-b6db-8ace80f44377 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:08:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance d7d1582f-4a3b-4d1b-9454-eb70debf8b07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:08:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 9589267e-e485-4f18-a435-c2623c949937 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:08:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:08:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance a250449f-72d0-4b64-825b-d47e0dff471a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:08:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:08:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:08:42 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:08:42 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:08:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:08:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "00e09d93-3077-4770-abfd-b82ece646997" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "00e09d93-3077-4770-abfd-b82ece646997" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "00e09d93-3077-4770-abfd-b82ece646997-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:57 user nova-compute[74039]: INFO nova.compute.manager [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Terminating instance
Oct 20 09:08:57 user nova-compute[74039]: DEBUG nova.compute.manager [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:08:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:57 user nova-compute[74039]: DEBUG nova.compute.manager [req-bae86aee-914e-4d2e-b3f8-66945956d792 req-fce8d90a-b005-4dd2-a3b7-e7ef92e781af service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received event network-vif-unplugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:08:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bae86aee-914e-4d2e-b3f8-66945956d792 req-fce8d90a-b005-4dd2-a3b7-e7ef92e781af service nova] Acquiring lock "00e09d93-3077-4770-abfd-b82ece646997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bae86aee-914e-4d2e-b3f8-66945956d792 req-fce8d90a-b005-4dd2-a3b7-e7ef92e781af service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bae86aee-914e-4d2e-b3f8-66945956d792 req-fce8d90a-b005-4dd2-a3b7-e7ef92e781af service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:57 user nova-compute[74039]: DEBUG nova.compute.manager [req-bae86aee-914e-4d2e-b3f8-66945956d792 req-fce8d90a-b005-4dd2-a3b7-e7ef92e781af service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] No waiting events found dispatching network-vif-unplugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:08:57 user nova-compute[74039]: DEBUG nova.compute.manager [req-bae86aee-914e-4d2e-b3f8-66945956d792 req-fce8d90a-b005-4dd2-a3b7-e7ef92e781af service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received event network-vif-unplugged-d5f62963-3776-4468-b582-f2d31bf6a2be for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:08:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:58 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Instance destroyed successfully.
Oct 20 09:08:58 user nova-compute[74039]: DEBUG nova.objects.instance [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lazy-loading 'resources' on Instance uuid 00e09d93-3077-4770-abfd-b82ece646997 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-456868217',display_name='tempest-ServerActionsTestOtherA-server-456868217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-456868217',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyyJ62onAPVNIcWwPgu8Qk09h8heuIgT4K5VQCSSgQo1m6HsMw9upnfKrs0KtZmErwiBvOSQvzot9EsqbPyLMmcaHuqRr6HWOREqecRp8rh7oJxELHXOR3Is97nl7PEUA==',key_name='tempest-keypair-612179765',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:04:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88a58985dce3491d8e45e6e468e0e549',ramdisk_id='',reservation_id='r-ed0qaebc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1138208404',owner_user_name='tempest-ServerActionsTestOtherA-1138208404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:06:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb823f0374a04657be729eb153160659',uuid=00e09d93-3077-4770-abfd-b82ece646997,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converting VIF {"id": "d5f62963-3776-4468-b582-f2d31bf6a2be", "address": "fa:16:3e:d7:28:6b", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f62963-37", "ovs_interfaceid": "d5f62963-3776-4468-b582-f2d31bf6a2be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:28:6b,bridge_name='br-int',has_traffic_filtering=True,id=d5f62963-3776-4468-b582-f2d31bf6a2be,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f62963-37') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_vif [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:28:6b,bridge_name='br-int',has_traffic_filtering=True,id=d5f62963-3776-4468-b582-f2d31bf6a2be,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f62963-37') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5f62963-37, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db9332d1-fe6e-455e-a036-3d9bcaa1e208) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:08:58 user nova-compute[74039]: INFO os_vif [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:28:6b,bridge_name='br-int',has_traffic_filtering=True,id=d5f62963-3776-4468-b582-f2d31bf6a2be,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f62963-37')
Oct 20 09:08:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKlBfatR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:08:58 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ada2a5-5046-44c2-bb8c-106e34ce5816]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:08:58 user nova-compute[74039]: No targets found.
Oct 20 09:08:58 user nova-compute[74039]: iSNS:
Oct 20 09:08:58 user nova-compute[74039]: No targets found.
Oct 20 09:08:58 user nova-compute[74039]: STATIC:
Oct 20 09:08:58 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f
Oct 20 09:08:58 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:08:58 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:08:58 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1
Oct 20 09:08:58 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:08:58 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:08:58 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031
Oct 20 09:08:58 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:08:58 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:08:58 user nova-compute[74039]: FIRMWARE:
Oct 20 09:08:58 user nova-compute[74039]: No targets found.
Oct 20 09:08:58 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:08:58 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:08:58 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd31994-8cef-4312-a861-6e5ac56ff47b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7a307c-dbf3-4220-a3b6-b646c0b223c1]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:08:58 user nova-compute[74039]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)
Oct 20 09:08:58 user nova-compute[74039]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:08:58 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 (non-flash)
Oct 20 09:08:58 user nova-compute[74039]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)
Oct 20 09:08:58 user nova-compute[74039]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:08:58 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae845fc550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1'): ({'sdd'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Removing single pathed devices sdd {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fd889f-035f-4760-a0b8-5e4f667ec3c5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.040s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06fd557-3665-41b2-86ee-06d60dabc071]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Flushing IO for device /dev/sdd {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eae5eae-ff58-450b-8400-067da799cd92]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c623ff-93b1-46a9-9585-18ff498118ce]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5159dd19', '/dev/disk/by-id/scsi-23436313132633734', '/dev/disk/by-id/scsi-1SCST_BIO5159dd19-46112c74dc8aae53') {{(pid=85466) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d541c6c-e6fd-4f80-a1f8-eed2b991d8ba]: (4, None) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af8ef66-ca06-46b6-a5f0-743d8d4a7f53]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a5d11e-1a30-4cb4-92b0-67c57eed7ff4]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1, portal: 172.16.0.220,3260]
Oct 20 09:08:58 user nova-compute[74039]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1, portal: 172.16.0.220,3260] successful.
Oct 20 09:08:58 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:761590b5-010a-47bc-9316-294b487cf5c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf608639-fb67-45c1-bf9c-839304ea73a7]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] <== disconnect_volume: return (396ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:08:58 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Deleting instance files /opt/stack/data/nova/instances/00e09d93-3077-4770-abfd-b82ece646997_del
Oct 20 09:08:58 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Deletion of /opt/stack/data/nova/instances/00e09d93-3077-4770-abfd-b82ece646997_del complete
Oct 20 09:08:58 user nova-compute[74039]: INFO nova.compute.manager [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Took 1.33 seconds to destroy the instance on the hypervisor.
Oct 20 09:08:58 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 00e09d93-3077-4770-abfd-b82ece646997] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:08:59 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Took 1.02 seconds to deallocate network for instance.
Oct 20 09:08:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-589e376a-ca7e-49ba-b726-55a1af6149b4 req-e33865d6-14b6-41c2-8e9c-e17e7707874f service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received event network-vif-deleted-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received event network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] Acquiring lock "00e09d93-3077-4770-abfd-b82ece646997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] No waiting events found dispatching network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:08:59 user nova-compute[74039]: WARNING nova.compute.manager [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received unexpected event network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be for instance with vm_state active and task_state deleting.
Oct 20 09:08:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received event network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] Acquiring lock "00e09d93-3077-4770-abfd-b82ece646997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] No waiting events found dispatching network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:08:59 user nova-compute[74039]: WARNING nova.compute.manager [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received unexpected event network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be for instance with vm_state active and task_state deleting.
Oct 20 09:08:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received event network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] Acquiring lock "00e09d93-3077-4770-abfd-b82ece646997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] No waiting events found dispatching network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:08:59 user nova-compute[74039]: WARNING nova.compute.manager [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received unexpected event network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be for instance with vm_state active and task_state deleting.
Oct 20 09:08:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received event network-vif-unplugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] Acquiring lock "00e09d93-3077-4770-abfd-b82ece646997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] No waiting events found dispatching network-vif-unplugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received event network-vif-unplugged-d5f62963-3776-4468-b582-f2d31bf6a2be for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received event network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] Acquiring lock "00e09d93-3077-4770-abfd-b82ece646997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] Lock "00e09d93-3077-4770-abfd-b82ece646997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:08:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] No waiting events found dispatching network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:08:59 user nova-compute[74039]: WARNING nova.compute.manager [req-51072130-bcc2-4f5e-9458-178c3dcf4921 req-2b1ff103-700b-4299-8c0c-4f884feac2b1 service nova] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Received unexpected event network-vif-plugged-d5f62963-3776-4468-b582-f2d31bf6a2be for instance with vm_state active and task_state deleting.
Oct 20 09:09:00 user nova-compute[74039]: INFO nova.compute.manager [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Took 0.86 seconds to detach 1 volumes for instance.
Oct 20 09:09:00 user nova-compute[74039]: DEBUG nova.compute.manager [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 00e09d93-3077-4770-abfd-b82ece646997] Deleting volume: 761590b5-010a-47bc-9316-294b487cf5c1 {{(pid=74039) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 09:09:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:09:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:09:00 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:09:00 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:09:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:01 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Deleted allocations for instance 00e09d93-3077-4770-abfd-b82ece646997
Oct 20 09:09:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5adabb58-ac30-4476-9f20-4b6ef99f25f6 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "00e09d93-3077-4770-abfd-b82ece646997" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.967s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:01 user nova-compute[74039]: DEBUG nova.compute.manager [req-8d1ad301-c90f-4fa1-accd-a43e238700bf req-d7c3de9a-5bb8-4d7a-b883-dd47b603b527 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received event network-changed-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:09:01 user nova-compute[74039]: DEBUG nova.compute.manager [req-8d1ad301-c90f-4fa1-accd-a43e238700bf req-d7c3de9a-5bb8-4d7a-b883-dd47b603b527 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Refreshing instance network info cache due to event network-changed-fea0e0ca-2480-435a-b0de-0381ebf787e7. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:09:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d1ad301-c90f-4fa1-accd-a43e238700bf req-d7c3de9a-5bb8-4d7a-b883-dd47b603b527 service nova] Acquiring lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:09:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d1ad301-c90f-4fa1-accd-a43e238700bf req-d7c3de9a-5bb8-4d7a-b883-dd47b603b527 service nova] Acquired lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:09:01 user nova-compute[74039]: DEBUG nova.network.neutron [req-8d1ad301-c90f-4fa1-accd-a43e238700bf req-d7c3de9a-5bb8-4d7a-b883-dd47b603b527 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Refreshing network info cache for port fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:09:02 user nova-compute[74039]: DEBUG nova.network.neutron [req-8d1ad301-c90f-4fa1-accd-a43e238700bf req-d7c3de9a-5bb8-4d7a-b883-dd47b603b527 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Updated VIF entry in instance network info cache for port fea0e0ca-2480-435a-b0de-0381ebf787e7. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:09:02 user nova-compute[74039]: DEBUG nova.network.neutron [req-8d1ad301-c90f-4fa1-accd-a43e238700bf req-d7c3de9a-5bb8-4d7a-b883-dd47b603b527 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Updating instance_info_cache with network_info: [{"id": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "address": "fa:16:3e:40:f2:06", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea0e0ca-24", "ovs_interfaceid": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:09:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d1ad301-c90f-4fa1-accd-a43e238700bf req-d7c3de9a-5bb8-4d7a-b883-dd47b603b527 service nova] Releasing lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:09:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "eca753ae-f542-431d-bb70-197394e6c566" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:09:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "eca753ae-f542-431d-bb70-197394e6c566" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:09:02 user nova-compute[74039]: INFO nova.compute.manager [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Detaching volume 2d1323e8-966f-4604-8f89-6816b404bd0f
Oct 20 09:09:02 user nova-compute[74039]: INFO nova.virt.block_device [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Attempting to driver detach volume 2d1323e8-966f-4604-8f89-6816b404bd0f from mountpoint /dev/vdb
Oct 20 09:09:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Attempting to detach device vdb from instance eca753ae-f542-431d-bb70-197394e6c566 from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 09:09:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:09:02 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:09:02 user nova-compute[74039]:   <source dev="/dev/sde"/>
Oct 20 09:09:02 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:09:02 user nova-compute[74039]:   <serial>2d1323e8-966f-4604-8f89-6816b404bd0f</serial>
Oct 20 09:09:02 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:09:02 user nova-compute[74039]: </disk>
Oct 20 09:09:02 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:09:02 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Successfully detached device vdb from instance eca753ae-f542-431d-bb70-197394e6c566 from the persistent domain config.
Oct 20 09:09:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eca753ae-f542-431d-bb70-197394e6c566 from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 09:09:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:09:02 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:09:02 user nova-compute[74039]:   <source dev="/dev/sde"/>
Oct 20 09:09:02 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:09:02 user nova-compute[74039]:   <serial>2d1323e8-966f-4604-8f89-6816b404bd0f</serial>
Oct 20 09:09:02 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:09:02 user nova-compute[74039]: </disk>
Oct 20 09:09:02 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:09:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eca753ae-f542-431d-bb70-197394e6c566 {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 09:09:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:03 user nova-compute[74039]: DEBUG nova.compute.manager [req-90de9884-ac4f-40f3-8abf-27f30efc9abc req-621c9ec6-2dab-4896-8a31-ab76e01734e2 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received event network-changed-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:09:03 user nova-compute[74039]: DEBUG nova.compute.manager [req-90de9884-ac4f-40f3-8abf-27f30efc9abc req-621c9ec6-2dab-4896-8a31-ab76e01734e2 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Refreshing instance network info cache due to event network-changed-fea0e0ca-2480-435a-b0de-0381ebf787e7. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:09:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-90de9884-ac4f-40f3-8abf-27f30efc9abc req-621c9ec6-2dab-4896-8a31-ab76e01734e2 service nova] Acquiring lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:09:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-90de9884-ac4f-40f3-8abf-27f30efc9abc req-621c9ec6-2dab-4896-8a31-ab76e01734e2 service nova] Acquired lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:09:03 user nova-compute[74039]: DEBUG nova.network.neutron [req-90de9884-ac4f-40f3-8abf-27f30efc9abc req-621c9ec6-2dab-4896-8a31-ab76e01734e2 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Refreshing network info cache for port fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:09:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:04 user nova-compute[74039]: DEBUG nova.network.neutron [req-90de9884-ac4f-40f3-8abf-27f30efc9abc req-621c9ec6-2dab-4896-8a31-ab76e01734e2 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Updated VIF entry in instance network info cache for port fea0e0ca-2480-435a-b0de-0381ebf787e7. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:09:04 user nova-compute[74039]: DEBUG nova.network.neutron [req-90de9884-ac4f-40f3-8abf-27f30efc9abc req-621c9ec6-2dab-4896-8a31-ab76e01734e2 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Updating instance_info_cache with network_info: [{"id": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "address": "fa:16:3e:40:f2:06", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea0e0ca-24", "ovs_interfaceid": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:09:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-90de9884-ac4f-40f3-8abf-27f30efc9abc req-621c9ec6-2dab-4896-8a31-ab76e01734e2 service nova] Releasing lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:09:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.compute.manager [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:09:13 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Creating image(s)
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Did not create local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Ensure instance console log exists: /opt/stack/data/nova/instances/7ef84a0f-b5bd-4df4-b3e1-da05581d2b17/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Start _get_guest_xml network_info=[{"id": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "address": "fa:16:3e:63:49:5e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc0a1c-ee", "ovs_interfaceid": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b6babed8-870e-4a16-864d-8d8645613993', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abucNVZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7ef84a0f-b5bd-4df4-b3e1-da05581d2b17', 'attached_at': '', 'detached_at': '', 'volume_id': '2bae475b-ece4-4c2a-b9a4-c2291830bd14', 'serial': '2bae475b-ece4-4c2a-b9a4-c2291830bd14'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:09:13 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:09:13 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abucNVZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:09:13 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:09:13 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:09:13 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e164ec-f09d-4eb6-bcd9-e554b7aae315]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:09:13 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7cdaba-feee-4dd8-b026-41255f8f66d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14] added
Oct 20 09:09:13 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da6a9f2-0a6e-4080-8c32-54a9692b80c0]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66ec749-4d7d-4975-b570-7d65dfda8c92]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abucNVZr {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abucNVZr" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[162ad191-ce04-43d0-83db-c96308db9e52]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'abucNVZr'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8abb5dc-9e71-4739-bc4e-48dfd0621686]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[05de6c23-ed5c-4f3d-93d4-bbd6325a6b2a]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)
Oct 20 09:09:13 user nova-compute[74039]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:09:13 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)
Oct 20 09:09:13 user nova-compute[74039]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:09:13 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c867c2-ebea-4f68-a2a3-b3e91996004b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14, portal: 172.16.0.220,3260]
Oct 20 09:09:13 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14, portal: 172.16.0.220,3260] successful.
Oct 20 09:09:13 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c91314-0f27-4fc8-b0e8-fb6b3aac267f]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6906c1-bc75-40d9-9412-6f47981ed3b5]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)
Oct 20 09:09:13 user nova-compute[74039]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:09:13 user nova-compute[74039]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:09:13 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)
Oct 20 09:09:13 user nova-compute[74039]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:09:13 user nova-compute[74039]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:09:13 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[546f4748-64de-4e9d-856f-c268bef394cd]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:13 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: None {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abucNVZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26164666436653062', 'path': '/dev/sdc'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164666436653062', 'path': '/dev/sdc'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:08:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1276384976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1276384976',id=36,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7ed96a82048434fb0d79a55838184e4',ramdisk_id='',reservation_id='r-vf8crc97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:08:32Z,user_data=None,user_id='1e07a52b4e3b4a65b34f71fb2cca8de3',uuid=7ef84a0f-b5bd-4df4-b3e1-da05581d2b17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "address": "fa:16:3e:63:49:5e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc0a1c-ee", "ovs_interfaceid": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converting VIF {"id": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "address": "fa:16:3e:63:49:5e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc0a1c-ee", "ovs_interfaceid": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:49:5e,bridge_name='br-int',has_traffic_filtering=True,id=f9fc0a1c-ee0c-4540-9221-b93d88aafe99,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc0a1c-ee') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG nova.objects.instance [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:09:14 user nova-compute[74039]:   <uuid>7ef84a0f-b5bd-4df4-b3e1-da05581d2b17</uuid>
Oct 20 09:09:14 user nova-compute[74039]:   <name>instance-00000024</name>
Oct 20 09:09:14 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:09:14 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:09:14 user nova-compute[74039]:   <metadata>
Oct 20 09:09:14 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:09:14 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:09:14 user nova-compute[74039]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1276384976</nova:name>
Oct 20 09:09:14 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:09:13</nova:creationTime>
Oct 20 09:09:14 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:09:14 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:09:14 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:09:14 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:09:14 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:09:14 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:09:14 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:09:14 user nova-compute[74039]:       <nova:owner>
Oct 20 09:09:14 user nova-compute[74039]:         <nova:user uuid="1e07a52b4e3b4a65b34f71fb2cca8de3">tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member</nova:user>
Oct 20 09:09:14 user nova-compute[74039]:         <nova:project uuid="d7ed96a82048434fb0d79a55838184e4">tempest-ServerBootFromVolumeStableRescueTest-1728924155</nova:project>
Oct 20 09:09:14 user nova-compute[74039]:       </nova:owner>
Oct 20 09:09:14 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:09:14 user nova-compute[74039]:       <nova:ports>
Oct 20 09:09:14 user nova-compute[74039]:         <nova:port uuid="f9fc0a1c-ee0c-4540-9221-b93d88aafe99">
Oct 20 09:09:14 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 09:09:14 user nova-compute[74039]:         </nova:port>
Oct 20 09:09:14 user nova-compute[74039]:       </nova:ports>
Oct 20 09:09:14 user nova-compute[74039]:     </nova:instance>
Oct 20 09:09:14 user nova-compute[74039]:   </metadata>
Oct 20 09:09:14 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:09:14 user nova-compute[74039]:     <system>
Oct 20 09:09:14 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:09:14 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:09:14 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:09:14 user nova-compute[74039]:       <entry name="serial">7ef84a0f-b5bd-4df4-b3e1-da05581d2b17</entry>
Oct 20 09:09:14 user nova-compute[74039]:       <entry name="uuid">7ef84a0f-b5bd-4df4-b3e1-da05581d2b17</entry>
Oct 20 09:09:14 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:09:14 user nova-compute[74039]:     </system>
Oct 20 09:09:14 user nova-compute[74039]:   </sysinfo>
Oct 20 09:09:14 user nova-compute[74039]:   <os>
Oct 20 09:09:14 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:09:14 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:09:14 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:09:14 user nova-compute[74039]:   </os>
Oct 20 09:09:14 user nova-compute[74039]:   <features>
Oct 20 09:09:14 user nova-compute[74039]:     <acpi/>
Oct 20 09:09:14 user nova-compute[74039]:     <apic/>
Oct 20 09:09:14 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:09:14 user nova-compute[74039]:   </features>
Oct 20 09:09:14 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:09:14 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:09:14 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:09:14 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:09:14 user nova-compute[74039]:   </clock>
Oct 20 09:09:14 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:09:14 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:09:14 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:09:14 user nova-compute[74039]:   </cpu>
Oct 20 09:09:14 user nova-compute[74039]:   <devices>
Oct 20 09:09:14 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 09:09:14 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:09:14 user nova-compute[74039]:       <source dev="/dev/sdc"/>
Oct 20 09:09:14 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:09:14 user nova-compute[74039]:       <serial>2bae475b-ece4-4c2a-b9a4-c2291830bd14</serial>
Oct 20 09:09:14 user nova-compute[74039]:     </disk>
Oct 20 09:09:14 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:09:14 user nova-compute[74039]:       <mac address="fa:16:3e:63:49:5e"/>
Oct 20 09:09:14 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:09:14 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:09:14 user nova-compute[74039]:       <target dev="tapf9fc0a1c-ee"/>
Oct 20 09:09:14 user nova-compute[74039]:     </interface>
Oct 20 09:09:14 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:09:14 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/7ef84a0f-b5bd-4df4-b3e1-da05581d2b17/console.log" append="off"/>
Oct 20 09:09:14 user nova-compute[74039]:     </serial>
Oct 20 09:09:14 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:09:14 user nova-compute[74039]:     <video>
Oct 20 09:09:14 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:09:14 user nova-compute[74039]:     </video>
Oct 20 09:09:14 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:09:14 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:09:14 user nova-compute[74039]:     </rng>
Oct 20 09:09:14 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:09:14 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:09:14 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:09:14 user nova-compute[74039]:     </memballoon>
Oct 20 09:09:14 user nova-compute[74039]:   </devices>
Oct 20 09:09:14 user nova-compute[74039]: </domain>
Oct 20 09:09:14 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:08:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1276384976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1276384976',id=36,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7ed96a82048434fb0d79a55838184e4',ramdisk_id='',reservation_id='r-vf8crc97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:08:32Z,user_data=None,user_id='1e07a52b4e3b4a65b34f71fb2cca8de3',uuid=7ef84a0f-b5bd-4df4-b3e1-da05581d2b17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "address": "fa:16:3e:63:49:5e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc0a1c-ee", "ovs_interfaceid": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converting VIF {"id": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "address": "fa:16:3e:63:49:5e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc0a1c-ee", "ovs_interfaceid": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:49:5e,bridge_name='br-int',has_traffic_filtering=True,id=f9fc0a1c-ee0c-4540-9221-b93d88aafe99,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc0a1c-ee') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG os_vif [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:49:5e,bridge_name='br-int',has_traffic_filtering=True,id=f9fc0a1c-ee0c-4540-9221-b93d88aafe99,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc0a1c-ee') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33aa7cec-e687-5e70-ab4d-7b5be140648e', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9fc0a1c-ee, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9fc0a1c-ee, col_values=(('qos', UUID('71b72e65-d877-4abc-8a16-3ddb9031d742')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9fc0a1c-ee, col_values=(('external_ids', {'iface-id': 'f9fc0a1c-ee0c-4540-9221-b93d88aafe99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:49:5e', 'vm-uuid': '7ef84a0f-b5bd-4df4-b3e1-da05581d2b17'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:14 user nova-compute[74039]: INFO os_vif [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:49:5e,bridge_name='br-int',has_traffic_filtering=True,id=f9fc0a1c-ee0c-4540-9221-b93d88aafe99,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc0a1c-ee')
Oct 20 09:09:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:09:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] No VIF found with MAC fa:16:3e:63:49:5e, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:09:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:16 user nova-compute[74039]: DEBUG nova.compute.manager [req-0d62ce9a-3f09-48d7-b8e3-ef9b31b636d2 req-7a85cb47-14d3-4de5-a533-05e22c80bb0f service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received event network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:09:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0d62ce9a-3f09-48d7-b8e3-ef9b31b636d2 req-7a85cb47-14d3-4de5-a533-05e22c80bb0f service nova] Acquiring lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:09:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0d62ce9a-3f09-48d7-b8e3-ef9b31b636d2 req-7a85cb47-14d3-4de5-a533-05e22c80bb0f service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:09:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0d62ce9a-3f09-48d7-b8e3-ef9b31b636d2 req-7a85cb47-14d3-4de5-a533-05e22c80bb0f service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:16 user nova-compute[74039]: DEBUG nova.compute.manager [req-0d62ce9a-3f09-48d7-b8e3-ef9b31b636d2 req-7a85cb47-14d3-4de5-a533-05e22c80bb0f service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] No waiting events found dispatching network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:09:16 user nova-compute[74039]: WARNING nova.compute.manager [req-0d62ce9a-3f09-48d7-b8e3-ef9b31b636d2 req-7a85cb47-14d3-4de5-a533-05e22c80bb0f service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received unexpected event network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 for instance with vm_state building and task_state spawning.
Oct 20 09:09:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:18 user nova-compute[74039]: DEBUG nova.compute.manager [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:09:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:09:18 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Instance spawned successfully.
Oct 20 09:09:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:09:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:09:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:09:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:09:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:09:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:09:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:09:18 user nova-compute[74039]: DEBUG nova.compute.manager [req-6e5589b1-f0fb-402a-b9b3-ccd720a1dffc req-7a2159f5-08ba-46ac-9864-c97b4da94b0a service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received event network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:09:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6e5589b1-f0fb-402a-b9b3-ccd720a1dffc req-7a2159f5-08ba-46ac-9864-c97b4da94b0a service nova] Acquiring lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:09:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6e5589b1-f0fb-402a-b9b3-ccd720a1dffc req-7a2159f5-08ba-46ac-9864-c97b4da94b0a service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:09:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6e5589b1-f0fb-402a-b9b3-ccd720a1dffc req-7a2159f5-08ba-46ac-9864-c97b4da94b0a service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:18 user nova-compute[74039]: DEBUG nova.compute.manager [req-6e5589b1-f0fb-402a-b9b3-ccd720a1dffc req-7a2159f5-08ba-46ac-9864-c97b4da94b0a service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] No waiting events found dispatching network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:09:18 user nova-compute[74039]: WARNING nova.compute.manager [req-6e5589b1-f0fb-402a-b9b3-ccd720a1dffc req-7a2159f5-08ba-46ac-9864-c97b4da94b0a service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received unexpected event network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 for instance with vm_state building and task_state spawning.
Oct 20 09:09:18 user nova-compute[74039]: INFO nova.compute.manager [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Took 5.22 seconds to spawn the instance on the hypervisor.
Oct 20 09:09:18 user nova-compute[74039]: DEBUG nova.compute.manager [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:09:18 user nova-compute[74039]: INFO nova.compute.manager [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Took 46.59 seconds to build instance.
Oct 20 09:09:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-523ca5b2-6ca2-4e4a-bbfb-5b3e8d06a256 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.695s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-2e0cf90e-db26-417f-bd2c-3062484dcf9e req-83207d26-8e72-4b87-8d82-5d897266cc04 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Received event network-changed-ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:09:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-2e0cf90e-db26-417f-bd2c-3062484dcf9e req-83207d26-8e72-4b87-8d82-5d897266cc04 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Refreshing instance network info cache due to event network-changed-ceda34ef-339f-4423-adf1-5d39a1412398. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:09:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2e0cf90e-db26-417f-bd2c-3062484dcf9e req-83207d26-8e72-4b87-8d82-5d897266cc04 service nova] Acquiring lock "refresh_cache-eb7a44c0-2405-4ff2-b6db-8ace80f44377" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:09:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2e0cf90e-db26-417f-bd2c-3062484dcf9e req-83207d26-8e72-4b87-8d82-5d897266cc04 service nova] Acquired lock "refresh_cache-eb7a44c0-2405-4ff2-b6db-8ace80f44377" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:09:20 user nova-compute[74039]: DEBUG nova.network.neutron [req-2e0cf90e-db26-417f-bd2c-3062484dcf9e req-83207d26-8e72-4b87-8d82-5d897266cc04 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Refreshing network info cache for port ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:09:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:09:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:09:20 user nova-compute[74039]: DEBUG nova.objects.instance [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lazy-loading 'flavor' on Instance uuid eb7a44c0-2405-4ff2-b6db-8ace80f44377 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:09:20 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Ignoring supplied device name: /dev/vdb
Oct 20 09:09:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG nova.network.neutron [req-2e0cf90e-db26-417f-bd2c-3062484dcf9e req-83207d26-8e72-4b87-8d82-5d897266cc04 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Updated VIF entry in instance network info cache for port ceda34ef-339f-4423-adf1-5d39a1412398. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG nova.network.neutron [req-2e0cf90e-db26-417f-bd2c-3062484dcf9e req-83207d26-8e72-4b87-8d82-5d897266cc04 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Updating instance_info_cache with network_info: [{"id": "ceda34ef-339f-4423-adf1-5d39a1412398", "address": "fa:16:3e:b3:28:4d", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda34ef-33", "ovs_interfaceid": "ceda34ef-339f-4423-adf1-5d39a1412398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2e0cf90e-db26-417f-bd2c-3062484dcf9e req-83207d26-8e72-4b87-8d82-5d897266cc04 service nova] Releasing lock "refresh_cache-eb7a44c0-2405-4ff2-b6db-8ace80f44377" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:09:21 user nova-compute[74039]: INFO nova.compute.manager [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Attaching volume 141cc996-0d44-4c9c-926d-946f84842a9f to /dev/vdb
Oct 20 09:09:21 user nova-compute[74039]: DEBUG os_brick.utils [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[695f05f3-88c1-48fb-b3f0-54f0c398c0e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d813bf1-cab3-4c1b-b334-617d8d3d6da6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8376443-e4ac-43e7-81e0-aa0ab35c210f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f10965-3cee-4354-ac4f-e879479671f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:09:21 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:09:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93a3fe5-172b-46ee-a5f2-707ec991c7af]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG os_brick.utils [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:09:21 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Updating existing volume attachment record: 0463a30d-dd54-45af-8494-cab0c1ed3250 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:09:22 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance eca753ae-f542-431d-bb70-197394e6c566 is timed out.
Oct 20 09:09:22 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Successfully detached device vdb from instance eca753ae-f542-431d-bb70-197394e6c566 from the live domain config.
Oct 20 09:09:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:09:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LpwjWhiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:09:22 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:09:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:09:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:09:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[58648c37-6e64-4904-a375-27a6073a3efb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:09:22 user nova-compute[74039]: No targets found.
Oct 20 09:09:22 user nova-compute[74039]: iSNS:
Oct 20 09:09:22 user nova-compute[74039]: No targets found.
Oct 20 09:09:22 user nova-compute[74039]: STATIC:
Oct 20 09:09:22 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14
Oct 20 09:09:22 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:09:22 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:09:22 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f
Oct 20 09:09:22 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:09:22 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:09:22 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031
Oct 20 09:09:22 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:09:22 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:09:22 user nova-compute[74039]: FIRMWARE:
Oct 20 09:09:22 user nova-compute[74039]: No targets found.
Oct 20 09:09:22 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:09:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:09:22 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:09:22 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:09:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:09:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00c35e5-0b33-4ace-9e01-17f18538cbef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8250da-5020-455a-928c-94b9be3b3b62]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)
Oct 20 09:09:22 user nova-compute[74039]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:09:22 user nova-compute[74039]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:09:22 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:09:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f (non-flash)
Oct 20 09:09:22 user nova-compute[74039]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:09:22 user nova-compute[74039]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:09:22 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:09:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae7c18a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f'): ({'sde'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:09:22 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Removing single pathed devices sde {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:09:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[476c2754-d8ec-466d-b555-f946bfe5283b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b9a0ba-372e-4e01-af02-dba9ca79e944]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Flushing IO for device /dev/sde {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1181bb-2a16-484c-aa41-6e9eb27ad558]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cee5d5-be18-4d9d-9cd0-85d4546df71f]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] SCSI volumes sde have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9e2715-06c5-4175-b9db-80eac9433f44]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e55a53-1366-4f7b-b496-e0411d5c1378]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f, portal: 172.16.0.220,3260]
Oct 20 09:09:23 user nova-compute[74039]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f, portal: 172.16.0.220,3260] successful.
Oct 20 09:09:23 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d1323e8-966f-4604-8f89-6816b404bd0f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b85f2e-fbd4-4ebd-9848-0f31a2b8f512]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] <== disconnect_volume: return (336ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:09:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:09:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:09:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:09:25 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:09:25 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:09:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:09:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:09:25 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: eca753ae-f542-431d-bb70-197394e6c566] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:09:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: eca753ae-f542-431d-bb70-197394e6c566] Updating instance_info_cache with network_info: [{"id": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "address": "fa:16:3e:40:f2:06", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea0e0ca-24", "ovs_interfaceid": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:09:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-eca753ae-f542-431d-bb70-197394e6c566" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:09:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: eca753ae-f542-431d-bb70-197394e6c566] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:09:27 user nova-compute[74039]: DEBUG nova.objects.instance [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lazy-loading 'flavor' on Instance uuid eca753ae-f542-431d-bb70-197394e6c566 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:09:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9d5b34f8-d170-44d1-aee4-9015bbe96c7c tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "eca753ae-f542-431d-bb70-197394e6c566" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.811s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:09:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:09:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-96481c1e-5287-4923-861c-8f95d23547f7 req-61f26e18-0cd6-4e81-930c-fc3a4dc4df5d service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Received event network-changed-558d1748-92c4-4e5d-a341-b3b5c0389c45 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-96481c1e-5287-4923-861c-8f95d23547f7 req-61f26e18-0cd6-4e81-930c-fc3a4dc4df5d service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Refreshing instance network info cache due to event network-changed-558d1748-92c4-4e5d-a341-b3b5c0389c45. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-96481c1e-5287-4923-861c-8f95d23547f7 req-61f26e18-0cd6-4e81-930c-fc3a4dc4df5d service nova] Acquiring lock "refresh_cache-4f5d98e3-c1f6-4617-8847-b975e2c23990" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-96481c1e-5287-4923-861c-8f95d23547f7 req-61f26e18-0cd6-4e81-930c-fc3a4dc4df5d service nova] Acquired lock "refresh_cache-4f5d98e3-c1f6-4617-8847-b975e2c23990" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG nova.network.neutron [req-96481c1e-5287-4923-861c-8f95d23547f7 req-61f26e18-0cd6-4e81-930c-fc3a4dc4df5d service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Refreshing network info cache for port 558d1748-92c4-4e5d-a341-b3b5c0389c45 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "4f5d98e3-c1f6-4617-8847-b975e2c23990" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "4f5d98e3-c1f6-4617-8847-b975e2c23990-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:28 user nova-compute[74039]: INFO nova.compute.manager [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Terminating instance
Oct 20 09:09:28 user nova-compute[74039]: DEBUG nova.compute.manager [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG nova.network.neutron [req-96481c1e-5287-4923-861c-8f95d23547f7 req-61f26e18-0cd6-4e81-930c-fc3a4dc4df5d service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Updated VIF entry in instance network info cache for port 558d1748-92c4-4e5d-a341-b3b5c0389c45. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG nova.network.neutron [req-96481c1e-5287-4923-861c-8f95d23547f7 req-61f26e18-0cd6-4e81-930c-fc3a4dc4df5d service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Updating instance_info_cache with network_info: [{"id": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "address": "fa:16:3e:00:9a:92", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558d1748-92", "ovs_interfaceid": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-96481c1e-5287-4923-861c-8f95d23547f7 req-61f26e18-0cd6-4e81-930c-fc3a4dc4df5d service nova] Releasing lock "refresh_cache-4f5d98e3-c1f6-4617-8847-b975e2c23990" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-e0d8c794-ab50-4fa9-8715-0dadd53f2618 req-2a024e8b-c42c-4a3e-bfc8-39a73b9c14b4 service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Received event network-vif-unplugged-558d1748-92c4-4e5d-a341-b3b5c0389c45 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e0d8c794-ab50-4fa9-8715-0dadd53f2618 req-2a024e8b-c42c-4a3e-bfc8-39a73b9c14b4 service nova] Acquiring lock "4f5d98e3-c1f6-4617-8847-b975e2c23990-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e0d8c794-ab50-4fa9-8715-0dadd53f2618 req-2a024e8b-c42c-4a3e-bfc8-39a73b9c14b4 service nova] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e0d8c794-ab50-4fa9-8715-0dadd53f2618 req-2a024e8b-c42c-4a3e-bfc8-39a73b9c14b4 service nova] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-e0d8c794-ab50-4fa9-8715-0dadd53f2618 req-2a024e8b-c42c-4a3e-bfc8-39a73b9c14b4 service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] No waiting events found dispatching network-vif-unplugged-558d1748-92c4-4e5d-a341-b3b5c0389c45 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-e0d8c794-ab50-4fa9-8715-0dadd53f2618 req-2a024e8b-c42c-4a3e-bfc8-39a73b9c14b4 service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Received event network-vif-unplugged-558d1748-92c4-4e5d-a341-b3b5c0389c45 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:09:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:28 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Instance destroyed successfully.
Oct 20 09:09:28 user nova-compute[74039]: DEBUG nova.objects.instance [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lazy-loading 'resources' on Instance uuid 4f5d98e3-c1f6-4617-8847-b975e2c23990 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:09:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:01:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-608517850',display_name='tempest-TestStampPattern-server-608517850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-608517850',id=22,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCoYAYLQAIK0eZwZlLZsSngPmiUuCavbZvZuAXBNr5s5G9UwpQhAO/A9UrKL/K+8+IO1hH8/ytdfxCHYdYzvPmR2tPylGWVvOVVSYReebeMYYdncFm19RRSUV+eGOaikQ==',key_name='tempest-TestStampPattern-2133476221',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='976dd013512742419a09db1bcd91c33f',ramdisk_id='',reservation_id='r-2u29q444',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1484113572',owner_user_name='tempest-TestStampPattern-1484113572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:04:46Z,user_data=None,user_id='521e273869c2472195ea7f956c47cfca',uuid=4f5d98e3-c1f6-4617-8847-b975e2c23990,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "address": "fa:16:3e:00:9a:92", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558d1748-92", "ovs_interfaceid": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:09:29 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Converting VIF {"id": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "address": "fa:16:3e:00:9a:92", "network": {"id": "95c63035-cc80-442a-b660-301acdda2a79", "bridge": "br-int", "label": "tempest-TestStampPattern-22705023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976dd013512742419a09db1bcd91c33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558d1748-92", "ovs_interfaceid": "558d1748-92c4-4e5d-a341-b3b5c0389c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:09:29 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:9a:92,bridge_name='br-int',has_traffic_filtering=True,id=558d1748-92c4-4e5d-a341-b3b5c0389c45,network=Network(95c63035-cc80-442a-b660-301acdda2a79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558d1748-92') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:09:29 user nova-compute[74039]: DEBUG os_vif [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:9a:92,bridge_name='br-int',has_traffic_filtering=True,id=558d1748-92c4-4e5d-a341-b3b5c0389c45,network=Network(95c63035-cc80-442a-b660-301acdda2a79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558d1748-92') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:09:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap558d1748-92, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:09:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:09:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0bd3f814-2b74-4f37-8552-806966fc92e1) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:09:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:29 user nova-compute[74039]: INFO os_vif [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:9a:92,bridge_name='br-int',has_traffic_filtering=True,id=558d1748-92c4-4e5d-a341-b3b5c0389c45,network=Network(95c63035-cc80-442a-b660-301acdda2a79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558d1748-92')
Oct 20 09:09:29 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Deleting instance files /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990_del
Oct 20 09:09:29 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Deletion of /opt/stack/data/nova/instances/4f5d98e3-c1f6-4617-8847-b975e2c23990_del complete
Oct 20 09:09:29 user nova-compute[74039]: INFO nova.compute.manager [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Took 1.08 seconds to destroy the instance on the hypervisor.
Oct 20 09:09:29 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:09:29 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:09:29 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:09:30 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:09:30 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Took 0.77 seconds to deallocate network for instance.
Oct 20 09:09:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:09:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:09:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-c58b75e3-c177-415c-a224-3ffd2cf03773 req-52ddadae-a735-45d5-bb8e-0a162f2a1486 service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Received event network-vif-deleted-558d1748-92c4-4e5d-a341-b3b5c0389c45 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:09:30 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:09:30 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:09:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:30 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Deleted allocations for instance 4f5d98e3-c1f6-4617-8847-b975e2c23990
Oct 20 09:09:30 user nova-compute[74039]: INFO nova.compute.manager [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Rebuilding instance
Oct 20 09:09:30 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:09:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-57185c0c-a53d-4c3d-861d-d8e76868c586 tempest-TestStampPattern-1484113572 tempest-TestStampPattern-1484113572-project-member] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.544s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-e20d426b-b9ab-4873-9bc5-983ebaf41710 req-8ad63806-2fb3-4767-ab6a-de2b91a3a073 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Received event network-changed-0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:09:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-e20d426b-b9ab-4873-9bc5-983ebaf41710 req-8ad63806-2fb3-4767-ab6a-de2b91a3a073 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Refreshing instance network info cache due to event network-changed-0f6af989-65a9-4d64-ade0-b547815b31af. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:09:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e20d426b-b9ab-4873-9bc5-983ebaf41710 req-8ad63806-2fb3-4767-ab6a-de2b91a3a073 service nova] Acquiring lock "refresh_cache-d7d1582f-4a3b-4d1b-9454-eb70debf8b07" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:09:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e20d426b-b9ab-4873-9bc5-983ebaf41710 req-8ad63806-2fb3-4767-ab6a-de2b91a3a073 service nova] Acquired lock "refresh_cache-d7d1582f-4a3b-4d1b-9454-eb70debf8b07" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:09:30 user nova-compute[74039]: DEBUG nova.network.neutron [req-e20d426b-b9ab-4873-9bc5-983ebaf41710 req-8ad63806-2fb3-4767-ab6a-de2b91a3a073 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Refreshing network info cache for port 0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:09:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-35095185-879e-4944-a3d7-36771bdb8b76 req-0948bb3a-5b76-4f7e-ae8b-532d94be4046 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Received event network-vif-unplugged-0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-35095185-879e-4944-a3d7-36771bdb8b76 req-0948bb3a-5b76-4f7e-ae8b-532d94be4046 service nova] Acquiring lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-35095185-879e-4944-a3d7-36771bdb8b76 req-0948bb3a-5b76-4f7e-ae8b-532d94be4046 service nova] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-35095185-879e-4944-a3d7-36771bdb8b76 req-0948bb3a-5b76-4f7e-ae8b-532d94be4046 service nova] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-35095185-879e-4944-a3d7-36771bdb8b76 req-0948bb3a-5b76-4f7e-ae8b-532d94be4046 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] No waiting events found dispatching network-vif-unplugged-0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:09:31 user nova-compute[74039]: WARNING nova.compute.manager [req-35095185-879e-4944-a3d7-36771bdb8b76 req-0948bb3a-5b76-4f7e-ae8b-532d94be4046 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Received unexpected event network-vif-unplugged-0f6af989-65a9-4d64-ade0-b547815b31af for instance with vm_state active and task_state rebuilding.
Oct 20 09:09:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:31 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Instance destroyed successfully.
Oct 20 09:09:31 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Instance destroyed successfully.
Oct 20 09:09:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:07:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-708376907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1317353536',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2Qep7+ioVz4ToaltQb5B8e50cjc5EV3uc44CZSLG3G0pJ+dHSg4fhBqyGwCjA0p2uQ8QVyrcEdJbDBJuM2jMJFlpyM4SxXsL+MsZ1gKCrGcMvERPd26mEQnXws/T8dvA==',key_name='tempest-keypair-1840380994',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:08:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bc13d04ae90a4fb8ac51e288fe5ab140',ramdisk_id='',reservation_id='r-3osji2pv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1308908868',owner_user_name='tempest-ServerActionsV293TestJSON-1308908868-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:09:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bddf822c42cf4c1397db396e176462ff',uuid=d7d1582f-4a3b-4d1b-9454-eb70debf8b07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f6af989-65a9-4d64-ade0-b547815b31af", "address": "fa:16:3e:72:58:d1", "network": {"id": "d25b876b-0740-492c-96d6-04dfdd2e722e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1105647057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc13d04ae90a4fb8ac51e288fe5ab140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6af989-65", "ovs_interfaceid": "0f6af989-65a9-4d64-ade0-b547815b31af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Converting VIF {"id": "0f6af989-65a9-4d64-ade0-b547815b31af", "address": "fa:16:3e:72:58:d1", "network": {"id": "d25b876b-0740-492c-96d6-04dfdd2e722e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1105647057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc13d04ae90a4fb8ac51e288fe5ab140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6af989-65", "ovs_interfaceid": "0f6af989-65a9-4d64-ade0-b547815b31af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:58:d1,bridge_name='br-int',has_traffic_filtering=True,id=0f6af989-65a9-4d64-ade0-b547815b31af,network=Network(d25b876b-0740-492c-96d6-04dfdd2e722e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6af989-65') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_vif [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:58:d1,bridge_name='br-int',has_traffic_filtering=True,id=0f6af989-65a9-4d64-ade0-b547815b31af,network=Network(d25b876b-0740-492c-96d6-04dfdd2e722e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6af989-65') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f6af989-65, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2e07be5-8b9a-4f54-bad9-0e18e64d4dba) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:31 user nova-compute[74039]: INFO os_vif [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:58:d1,bridge_name='br-int',has_traffic_filtering=True,id=0f6af989-65a9-4d64-ade0-b547815b31af,network=Network(d25b876b-0740-492c-96d6-04dfdd2e722e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6af989-65')
Oct 20 09:09:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tmUrKhWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:09:31 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ea587e-775c-41dd-a3bb-7c68c3a4febb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:09:31 user nova-compute[74039]: No targets found.
Oct 20 09:09:31 user nova-compute[74039]: iSNS:
Oct 20 09:09:31 user nova-compute[74039]: No targets found.
Oct 20 09:09:31 user nova-compute[74039]: STATIC:
Oct 20 09:09:31 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14
Oct 20 09:09:31 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:09:31 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:09:31 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031
Oct 20 09:09:31 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:09:31 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:09:31 user nova-compute[74039]: FIRMWARE:
Oct 20 09:09:31 user nova-compute[74039]: No targets found.
Oct 20 09:09:31 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:09:31 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:09:31 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc12eba1-b1ef-4f23-a798-36d49797f1ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG nova.network.neutron [req-e20d426b-b9ab-4873-9bc5-983ebaf41710 req-8ad63806-2fb3-4767-ab6a-de2b91a3a073 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Updated VIF entry in instance network info cache for port 0f6af989-65a9-4d64-ade0-b547815b31af. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG nova.network.neutron [req-e20d426b-b9ab-4873-9bc5-983ebaf41710 req-8ad63806-2fb3-4767-ab6a-de2b91a3a073 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Updating instance_info_cache with network_info: [{"id": "0f6af989-65a9-4d64-ade0-b547815b31af", "address": "fa:16:3e:72:58:d1", "network": {"id": "d25b876b-0740-492c-96d6-04dfdd2e722e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1105647057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc13d04ae90a4fb8ac51e288fe5ab140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6af989-65", "ovs_interfaceid": "0f6af989-65a9-4d64-ade0-b547815b31af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd77a8dd-1aec-47f2-aa96-8c3d637469c9]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:09:31 user nova-compute[74039]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:09:31 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:09:31 user nova-compute[74039]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:09:31 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae84269870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031'): ({'sdb'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Removing single pathed devices sdb {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e20d426b-b9ab-4873-9bc5-983ebaf41710 req-8ad63806-2fb3-4767-ab6a-de2b91a3a073 service nova] Releasing lock "refresh_cache-d7d1582f-4a3b-4d1b-9454-eb70debf8b07" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-e20d426b-b9ab-4873-9bc5-983ebaf41710 req-8ad63806-2fb3-4767-ab6a-de2b91a3a073 service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Received event network-vif-plugged-558d1748-92c4-4e5d-a341-b3b5c0389c45 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e20d426b-b9ab-4873-9bc5-983ebaf41710 req-8ad63806-2fb3-4767-ab6a-de2b91a3a073 service nova] Acquiring lock "4f5d98e3-c1f6-4617-8847-b975e2c23990-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e20d426b-b9ab-4873-9bc5-983ebaf41710 req-8ad63806-2fb3-4767-ab6a-de2b91a3a073 service nova] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e20d426b-b9ab-4873-9bc5-983ebaf41710 req-8ad63806-2fb3-4767-ab6a-de2b91a3a073 service nova] Lock "4f5d98e3-c1f6-4617-8847-b975e2c23990-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-e20d426b-b9ab-4873-9bc5-983ebaf41710 req-8ad63806-2fb3-4767-ab6a-de2b91a3a073 service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] No waiting events found dispatching network-vif-plugged-558d1748-92c4-4e5d-a341-b3b5c0389c45 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:09:31 user nova-compute[74039]: WARNING nova.compute.manager [req-e20d426b-b9ab-4873-9bc5-983ebaf41710 req-8ad63806-2fb3-4767-ab6a-de2b91a3a073 service nova] [instance: 4f5d98e3-c1f6-4617-8847-b975e2c23990] Received unexpected event network-vif-plugged-558d1748-92c4-4e5d-a341-b3b5c0389c45 for instance with vm_state deleted and task_state None.
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Cleaning up deleted instances {{(pid=74039) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f22e19-b2b5-405f-8bf4-606a35bdf807]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] There are 0 instances to clean {{(pid=74039) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[15980312-ea48-4e4f-a8f9-61770e7dfdcc]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Flushing IO for device /dev/sdb {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b625da09-3249-49e3-9489-d77c16518887]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f4eb15-e528-42bf-b93f-ce711786318e]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23739313661663164', '/dev/disk/by-id/scsi-1SCST_BIO55e6b825-7916af1dacd11435', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_55e6b825') {{(pid=85466) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c7a64d-57cc-47ec-a49e-309d1e46cac0]: (4, None) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be9b0a7-41f0-47bd-9b5c-6c43f5916f39]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2de2f00-12c2-453c-a7ba-a1ee6af3288f]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031, portal: 172.16.0.220,3260]
Oct 20 09:09:31 user nova-compute[74039]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031, portal: 172.16.0.220,3260] successful.
Oct 20 09:09:31 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cf01b2-6e2e-4623-9b5f-809a4054d522]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] <== disconnect_volume: return (331ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:09:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:09:31 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Deleting instance files /opt/stack/data/nova/instances/d7d1582f-4a3b-4d1b-9454-eb70debf8b07_del
Oct 20 09:09:31 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Deletion of /opt/stack/data/nova/instances/d7d1582f-4a3b-4d1b-9454-eb70debf8b07_del complete
Oct 20 09:09:32 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance d7d1582f-4a3b-4d1b-9454-eb70debf8b07 could not be found.
Oct 20 09:09:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tmUrKhWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:09:32 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 09:09:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[83750781-9e94-48f7-b9c3-137a677da255]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:09:32 user nova-compute[74039]: No targets found.
Oct 20 09:09:32 user nova-compute[74039]: iSNS:
Oct 20 09:09:32 user nova-compute[74039]: No targets found.
Oct 20 09:09:32 user nova-compute[74039]: STATIC:
Oct 20 09:09:32 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14
Oct 20 09:09:32 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:09:32 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:09:32 user nova-compute[74039]: FIRMWARE:
Oct 20 09:09:32 user nova-compute[74039]: No targets found.
Oct 20 09:09:32 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:09:32 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:09:32 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a563cb29-dfe5-4134-a3c8-ff238256ab14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[128978df-f39a-4983-993e-5e5076757516]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:09:32 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:09:32 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae841e2290>, {}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Disconnecting from: [] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] <== disconnect_volume: return (70ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:09:32 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:09:33 user nova-compute[74039]: DEBUG nova.compute.manager [req-ea0fc6e5-bf1e-468a-a75b-aad28eb375f5 req-93e7166a-8881-451d-a0c6-671e5013f247 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Received event network-vif-plugged-0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:09:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ea0fc6e5-bf1e-468a-a75b-aad28eb375f5 req-93e7166a-8881-451d-a0c6-671e5013f247 service nova] Acquiring lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:09:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ea0fc6e5-bf1e-468a-a75b-aad28eb375f5 req-93e7166a-8881-451d-a0c6-671e5013f247 service nova] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:09:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ea0fc6e5-bf1e-468a-a75b-aad28eb375f5 req-93e7166a-8881-451d-a0c6-671e5013f247 service nova] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:33 user nova-compute[74039]: DEBUG nova.compute.manager [req-ea0fc6e5-bf1e-468a-a75b-aad28eb375f5 req-93e7166a-8881-451d-a0c6-671e5013f247 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] No waiting events found dispatching network-vif-plugged-0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:09:33 user nova-compute[74039]: WARNING nova.compute.manager [req-ea0fc6e5-bf1e-468a-a75b-aad28eb375f5 req-93e7166a-8881-451d-a0c6-671e5013f247 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Received unexpected event network-vif-plugged-0f6af989-65a9-4d64-ade0-b547815b31af for instance with vm_state active and task_state rebuilding.
Oct 20 09:09:33 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Preparing to wait for external event volume-reimaged-058aa9e3-d0b9-4712-a8c2-90300ae1d031 {{(pid=74039) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 20 09:09:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Acquiring lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:09:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:09:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:38 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:09:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:09:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:09:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:38 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:09:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUIufAlV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:09:39 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:09:39 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:09:39 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbde9ed-8984-497a-8c47-ea76ad059127]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:09:39 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d39f33d-e0a2-47a0-a239-1bb8df997052]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f] added
Oct 20 09:09:39 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[970fc0b4-3b05-4d06-a739-76605ed5de7c]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f22dbf7-3e49-487c-8947-9bdf6b3a5311]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sUIufAlV {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sUIufAlV" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[628b3441-8940-448b-8eb3-05bff3496e8e]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sUIufAlV'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[58188095-1662-4651-8773-5cb97b58d998]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9146177c-8b19-480f-ba13-99a501c8b425]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:09:39 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:09:39 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5a3bc7-3bb2-4101-a84d-e32e7c2adbe5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f, portal: 172.16.0.220,3260]
Oct 20 09:09:39 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f, portal: 172.16.0.220,3260] successful.
Oct 20 09:09:39 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf095595-1562-4210-9199-67f6cffc3f81]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3486825-bd56-4be2-9e7c-1e2dc9f90061]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:09:39 user nova-compute[74039]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)
Oct 20 09:09:39 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:09:39 user nova-compute[74039]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)
Oct 20 09:09:39 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd5ac22-4948-4b3a-aeb3-f990af7e6421]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:09:39 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:09:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUIufAlV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:09:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:09:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:09:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23865346131383532', 'path': '/dev/sdb'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:09:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865346131383532', 'path': '/dev/sdb'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:09:41 user nova-compute[74039]: DEBUG nova.objects.instance [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lazy-loading 'flavor' on Instance uuid eb7a44c0-2405-4ff2-b6db-8ace80f44377 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:09:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 09:09:41 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:09:41 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 09:09:41 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:09:41 user nova-compute[74039]:   <serial>141cc996-0d44-4c9c-926d-946f84842a9f</serial>
Oct 20 09:09:41 user nova-compute[74039]: </disk>
Oct 20 09:09:41 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 09:09:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:09:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:09:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:41 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:09:41 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:09:41 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7822MB free_disk=25.39553451538086GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:09:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:09:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:09:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:09:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:09:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] No VIF found with MAC fa:16:3e:b3:28:4d, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:09:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:09:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance eca753ae-f542-431d-bb70-197394e6c566 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:09:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:09:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance eb7a44c0-2405-4ff2-b6db-8ace80f44377 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:09:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance d7d1582f-4a3b-4d1b-9454-eb70debf8b07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:09:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 9589267e-e485-4f18-a435-c2623c949937 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:09:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:09:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance a250449f-72d0-4b64-825b-d47e0dff471a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:09:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:09:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:09:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-29483997-b9d3-4d86-8ae0-060ce449d893 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.897s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:42 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:09:42 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:09:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:09:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:42 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:09:42 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74039) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 09:09:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:09:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:09:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:09:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:09:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:09:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:58 user nova-compute[74039]: INFO nova.compute.manager [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Terminating instance
Oct 20 09:09:58 user nova-compute[74039]: DEBUG nova.compute.manager [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:09:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-5a9e8676-d095-4b10-a13d-84a1cabecfb4 req-f67bb623-e49e-4c76-8a1f-d021643b55f6 service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Received event network-vif-unplugged-708d272c-3434-4525-bcbd-3ee50e71eb47 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5a9e8676-d095-4b10-a13d-84a1cabecfb4 req-f67bb623-e49e-4c76-8a1f-d021643b55f6 service nova] Acquiring lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5a9e8676-d095-4b10-a13d-84a1cabecfb4 req-f67bb623-e49e-4c76-8a1f-d021643b55f6 service nova] Lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5a9e8676-d095-4b10-a13d-84a1cabecfb4 req-f67bb623-e49e-4c76-8a1f-d021643b55f6 service nova] Lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-5a9e8676-d095-4b10-a13d-84a1cabecfb4 req-f67bb623-e49e-4c76-8a1f-d021643b55f6 service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] No waiting events found dispatching network-vif-unplugged-708d272c-3434-4525-bcbd-3ee50e71eb47 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-5a9e8676-d095-4b10-a13d-84a1cabecfb4 req-f67bb623-e49e-4c76-8a1f-d021643b55f6 service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Received event network-vif-unplugged-708d272c-3434-4525-bcbd-3ee50e71eb47 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:59 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Instance destroyed successfully.
Oct 20 09:09:59 user nova-compute[74039]: DEBUG nova.objects.instance [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lazy-loading 'resources' on Instance uuid 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T08:48:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-55801458',display_name='tempest-ServerActionsTestOtherA-server-55801458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-55801458',id=3,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyyJ62onAPVNIcWwPgu8Qk09h8heuIgT4K5VQCSSgQo1m6HsMw9upnfKrs0KtZmErwiBvOSQvzot9EsqbPyLMmcaHuqRr6HWOREqecRp8rh7oJxELHXOR3Is97nl7PEUA==',key_name='tempest-keypair-612179765',keypairs=<?>,launch_index=0,launched_at=2023-10-20T08:48:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88a58985dce3491d8e45e6e468e0e549',ramdisk_id='',reservation_id='r-5c1v27eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1138208404',owner_user_name='tempest-ServerActionsTestOtherA-1138208404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T08:48:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb823f0374a04657be729eb153160659',uuid=336eb423-89bd-4e51-a2ca-efdc6ded0bf3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "708d272c-3434-4525-bcbd-3ee50e71eb47", "address": "fa:16:3e:3f:80:75", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708d272c-34", "ovs_interfaceid": "708d272c-3434-4525-bcbd-3ee50e71eb47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converting VIF {"id": "708d272c-3434-4525-bcbd-3ee50e71eb47", "address": "fa:16:3e:3f:80:75", "network": {"id": "85546ea9-5283-4a82-9386-6c6ba2b7a0df", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-945485380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88a58985dce3491d8e45e6e468e0e549", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708d272c-34", "ovs_interfaceid": "708d272c-3434-4525-bcbd-3ee50e71eb47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:80:75,bridge_name='br-int',has_traffic_filtering=True,id=708d272c-3434-4525-bcbd-3ee50e71eb47,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap708d272c-34') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG os_vif [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:80:75,bridge_name='br-int',has_traffic_filtering=True,id=708d272c-3434-4525-bcbd-3ee50e71eb47,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap708d272c-34') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap708d272c-34, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=248387a2-94aa-439c-beb7-4a38c0de12ea) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:09:59 user nova-compute[74039]: INFO os_vif [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:80:75,bridge_name='br-int',has_traffic_filtering=True,id=708d272c-3434-4525-bcbd-3ee50e71eb47,network=Network(85546ea9-5283-4a82-9386-6c6ba2b7a0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap708d272c-34')
Oct 20 09:09:59 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Deleting instance files /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3_del
Oct 20 09:09:59 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Deletion of /opt/stack/data/nova/instances/336eb423-89bd-4e51-a2ca-efdc6ded0bf3_del complete
Oct 20 09:09:59 user nova-compute[74039]: INFO nova.compute.manager [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Took 1.31 seconds to destroy the instance on the hypervisor.
Oct 20 09:09:59 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:09:59 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-f9973bb1-3834-404c-bdb6-a122412b3987 req-dff6bcec-e95a-4583-90e6-1daa87f37ca1 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Received event volume-reimaged-058aa9e3-d0b9-4712-a8c2-90300ae1d031 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f9973bb1-3834-404c-bdb6-a122412b3987 req-dff6bcec-e95a-4583-90e6-1daa87f37ca1 service nova] Acquiring lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f9973bb1-3834-404c-bdb6-a122412b3987 req-dff6bcec-e95a-4583-90e6-1daa87f37ca1 service nova] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f9973bb1-3834-404c-bdb6-a122412b3987 req-dff6bcec-e95a-4583-90e6-1daa87f37ca1 service nova] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-f9973bb1-3834-404c-bdb6-a122412b3987 req-dff6bcec-e95a-4583-90e6-1daa87f37ca1 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Processing event volume-reimaged-058aa9e3-d0b9-4712-a8c2-90300ae1d031 {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Instance event wait completed in 26 seconds for volume-reimaged {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:10:00 user nova-compute[74039]: INFO nova.virt.block_device [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Booting with volume 058aa9e3-d0b9-4712-a8c2-90300ae1d031 at /dev/vda
Oct 20 09:10:00 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Took 0.56 seconds to deallocate network for instance.
Oct 20 09:10:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-b6d2c2d5-4cde-44c2-8642-ef5839e33e92 req-440d835b-93b3-4ea5-b3c8-8ca064df513d service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Received event network-vif-deleted-708d272c-3434-4525-bcbd-3ee50e71eb47 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:10:00 user nova-compute[74039]: INFO nova.compute.manager [req-b6d2c2d5-4cde-44c2-8642-ef5839e33e92 req-440d835b-93b3-4ea5-b3c8-8ca064df513d service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Neutron deleted interface 708d272c-3434-4525-bcbd-3ee50e71eb47; detaching it from the instance and deleting it from the info cache
Oct 20 09:10:00 user nova-compute[74039]: DEBUG nova.network.neutron [req-b6d2c2d5-4cde-44c2-8642-ef5839e33e92 req-440d835b-93b3-4ea5-b3c8-8ca064df513d service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-b6d2c2d5-4cde-44c2-8642-ef5839e33e92 req-440d835b-93b3-4ea5-b3c8-8ca064df513d service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Detach interface failed, port_id=708d272c-3434-4525-bcbd-3ee50e71eb47, reason: Instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3 could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG os_brick.utils [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42f35ec-be57-4773-9214-26dd33568852]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63313db-6c0e-45cc-a5de-c1c40911913c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae7022c-2f9d-47cf-a29f-7f9dff7e7aa8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[539a783c-4132-48bd-9536-a2ac90ceba0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:10:00 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[076ac357-e4a7-4f4b-bea0-887195d4ce6e]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG os_brick.utils [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Updating existing volume attachment record: 05f14a24-2e71-4663-b9f3-5d6e07ef76a7 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:00 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Deleted allocations for instance 336eb423-89bd-4e51-a2ca-efdc6ded0bf3
Oct 20 09:10:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-01ca3f75-e137-4908-a98a-8d0d22306897 tempest-ServerActionsTestOtherA-1138208404 tempest-ServerActionsTestOtherA-1138208404-project-member] Lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.563s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:01 user nova-compute[74039]: DEBUG nova.compute.manager [req-70498382-d27c-4015-a3ea-c2810be4d2e9 req-1dca1d19-87ff-44ec-b76b-141aad759345 service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Received event network-vif-plugged-708d272c-3434-4525-bcbd-3ee50e71eb47 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:10:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-70498382-d27c-4015-a3ea-c2810be4d2e9 req-1dca1d19-87ff-44ec-b76b-141aad759345 service nova] Acquiring lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-70498382-d27c-4015-a3ea-c2810be4d2e9 req-1dca1d19-87ff-44ec-b76b-141aad759345 service nova] Lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-70498382-d27c-4015-a3ea-c2810be4d2e9 req-1dca1d19-87ff-44ec-b76b-141aad759345 service nova] Lock "336eb423-89bd-4e51-a2ca-efdc6ded0bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:01 user nova-compute[74039]: DEBUG nova.compute.manager [req-70498382-d27c-4015-a3ea-c2810be4d2e9 req-1dca1d19-87ff-44ec-b76b-141aad759345 service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] No waiting events found dispatching network-vif-plugged-708d272c-3434-4525-bcbd-3ee50e71eb47 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:10:01 user nova-compute[74039]: WARNING nova.compute.manager [req-70498382-d27c-4015-a3ea-c2810be4d2e9 req-1dca1d19-87ff-44ec-b76b-141aad759345 service nova] [instance: 336eb423-89bd-4e51-a2ca-efdc6ded0bf3] Received unexpected event network-vif-plugged-708d272c-3434-4525-bcbd-3ee50e71eb47 for instance with vm_state deleted and task_state None.
Oct 20 09:10:01 user nova-compute[74039]: DEBUG nova.compute.manager [req-70498382-d27c-4015-a3ea-c2810be4d2e9 req-1dca1d19-87ff-44ec-b76b-141aad759345 service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] Received event network-changed-88781e7b-db18-4d13-81c8-1408a4a40725 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:10:01 user nova-compute[74039]: DEBUG nova.compute.manager [req-70498382-d27c-4015-a3ea-c2810be4d2e9 req-1dca1d19-87ff-44ec-b76b-141aad759345 service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] Refreshing instance network info cache due to event network-changed-88781e7b-db18-4d13-81c8-1408a4a40725. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:10:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-70498382-d27c-4015-a3ea-c2810be4d2e9 req-1dca1d19-87ff-44ec-b76b-141aad759345 service nova] Acquiring lock "refresh_cache-9589267e-e485-4f18-a435-c2623c949937" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:10:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-70498382-d27c-4015-a3ea-c2810be4d2e9 req-1dca1d19-87ff-44ec-b76b-141aad759345 service nova] Acquired lock "refresh_cache-9589267e-e485-4f18-a435-c2623c949937" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:10:01 user nova-compute[74039]: DEBUG nova.network.neutron [req-70498382-d27c-4015-a3ea-c2810be4d2e9 req-1dca1d19-87ff-44ec-b76b-141aad759345 service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] Refreshing network info cache for port 88781e7b-db18-4d13-81c8-1408a4a40725 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:10:01 user nova-compute[74039]: DEBUG nova.network.neutron [req-70498382-d27c-4015-a3ea-c2810be4d2e9 req-1dca1d19-87ff-44ec-b76b-141aad759345 service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] Updated VIF entry in instance network info cache for port 88781e7b-db18-4d13-81c8-1408a4a40725. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:10:01 user nova-compute[74039]: DEBUG nova.network.neutron [req-70498382-d27c-4015-a3ea-c2810be4d2e9 req-1dca1d19-87ff-44ec-b76b-141aad759345 service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] Updating instance_info_cache with network_info: [{"id": "88781e7b-db18-4d13-81c8-1408a4a40725", "address": "fa:16:3e:a9:a8:9e", "network": {"id": "198b9730-8e45-4bb2-92ae-55624d070e9a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808796854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5443955df42049cbaddfaa14af72a30d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88781e7b-db", "ovs_interfaceid": "88781e7b-db18-4d13-81c8-1408a4a40725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:10:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-70498382-d27c-4015-a3ea-c2810be4d2e9 req-1dca1d19-87ff-44ec-b76b-141aad759345 service nova] Releasing lock "refresh_cache-9589267e-e485-4f18-a435-c2623c949937" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:10:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Acquiring lock "9589267e-e485-4f18-a435-c2623c949937" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "9589267e-e485-4f18-a435-c2623c949937" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG nova.objects.instance [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lazy-loading 'flavor' on Instance uuid 9589267e-e485-4f18-a435-c2623c949937 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "9589267e-e485-4f18-a435-c2623c949937" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Acquiring lock "9589267e-e485-4f18-a435-c2623c949937" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "9589267e-e485-4f18-a435-c2623c949937" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:06 user nova-compute[74039]: INFO nova.compute.manager [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Attaching volume be535fe1-7cb4-44cd-befd-64b7a2071099 to /dev/vdb
Oct 20 09:10:06 user nova-compute[74039]: DEBUG os_brick.utils [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8948fa-678a-4562-b649-353ec1406752]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da7df62-eb3b-4194-a2ab-46cc5d3b9cc5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9389e904-e576-4188-b691-75b1374b58c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4189ce6-ce79-4d0f-81d0-31e59f2d68dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:10:06 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:10:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[979d4a59-7ce1-4547-bde8-31225f99a708]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG os_brick.utils [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:10:06 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Updating existing volume attachment record: b91d94e6-c367-4e1b-bd12-b0036ada4ace {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:10:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "eca753ae-f542-431d-bb70-197394e6c566" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "eca753ae-f542-431d-bb70-197394e6c566" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "eca753ae-f542-431d-bb70-197394e6c566-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "eca753ae-f542-431d-bb70-197394e6c566-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "eca753ae-f542-431d-bb70-197394e6c566-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:09 user nova-compute[74039]: INFO nova.compute.manager [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Terminating instance
Oct 20 09:10:09 user nova-compute[74039]: DEBUG nova.compute.manager [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-22e64cb3-dd57-412c-8d6c-aa2186752c71 req-1dea447a-7272-492d-b19e-ea2ed3401dd0 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received event network-vif-unplugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-22e64cb3-dd57-412c-8d6c-aa2186752c71 req-1dea447a-7272-492d-b19e-ea2ed3401dd0 service nova] Acquiring lock "eca753ae-f542-431d-bb70-197394e6c566-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-22e64cb3-dd57-412c-8d6c-aa2186752c71 req-1dea447a-7272-492d-b19e-ea2ed3401dd0 service nova] Lock "eca753ae-f542-431d-bb70-197394e6c566-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-22e64cb3-dd57-412c-8d6c-aa2186752c71 req-1dea447a-7272-492d-b19e-ea2ed3401dd0 service nova] Lock "eca753ae-f542-431d-bb70-197394e6c566-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-22e64cb3-dd57-412c-8d6c-aa2186752c71 req-1dea447a-7272-492d-b19e-ea2ed3401dd0 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] No waiting events found dispatching network-vif-unplugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-22e64cb3-dd57-412c-8d6c-aa2186752c71 req-1dea447a-7272-492d-b19e-ea2ed3401dd0 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received event network-vif-unplugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:09 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: eca753ae-f542-431d-bb70-197394e6c566] Instance destroyed successfully.
Oct 20 09:10:09 user nova-compute[74039]: DEBUG nova.objects.instance [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lazy-loading 'resources' on Instance uuid eca753ae-f542-431d-bb70-197394e6c566 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1306062082',display_name='tempest-TestMinimumBasicScenario-server-1306062082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1306062082',id=28,image_ref='7cdfd334-c521-4c85-8c40-c3028dfa0fda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6OQrU6pZWixXAqtelPx1ZMTVSD0YEQXx9QVD1Qj9Mbp+ioNoFjbCbAW5cLdbKj6X/7XWn7NnKiwHscyMbHShiOzkNFZP4EoWAKJy88WSFI12WOamrK4nJYDchu4x69rQ==',key_name='tempest-TestMinimumBasicScenario-1024941050',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:04:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9d044b69c56433ca011f220f8578407',ramdisk_id='',reservation_id='r-0rpof6tn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7cdfd334-c521-4c85-8c40-c3028dfa0fda',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1802809099',owner_user_name='tempest-TestMinimumBasicScenario-1802809099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:07:16Z,user_data=None,user_id='af6af67060414d48b96ee116b9e6dbdb',uuid=eca753ae-f542-431d-bb70-197394e6c566,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "address": "fa:16:3e:40:f2:06", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea0e0ca-24", "ovs_interfaceid": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Converting VIF {"id": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "address": "fa:16:3e:40:f2:06", "network": {"id": "2e77e2c2-4d4b-4d53-91ef-923e86806faf", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-478550118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d044b69c56433ca011f220f8578407", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea0e0ca-24", "ovs_interfaceid": "fea0e0ca-2480-435a-b0de-0381ebf787e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:f2:06,bridge_name='br-int',has_traffic_filtering=True,id=fea0e0ca-2480-435a-b0de-0381ebf787e7,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea0e0ca-24') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:10:09 user nova-compute[74039]: DEBUG os_vif [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:f2:06,bridge_name='br-int',has_traffic_filtering=True,id=fea0e0ca-2480-435a-b0de-0381ebf787e7,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea0e0ca-24') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:10:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfea0e0ca-24, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:10:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:10:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a5b59be-3d91-436b-9931-7e50401e6381) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:10:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:10:10 user nova-compute[74039]: INFO os_vif [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:f2:06,bridge_name='br-int',has_traffic_filtering=True,id=fea0e0ca-2480-435a-b0de-0381ebf787e7,network=Network(2e77e2c2-4d4b-4d53-91ef-923e86806faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea0e0ca-24')
Oct 20 09:10:10 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Deleting instance files /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566_del
Oct 20 09:10:10 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Deletion of /opt/stack/data/nova/instances/eca753ae-f542-431d-bb70-197394e6c566_del complete
Oct 20 09:10:10 user nova-compute[74039]: INFO nova.compute.manager [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] [instance: eca753ae-f542-431d-bb70-197394e6c566] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 20 09:10:10 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:10:10 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: eca753ae-f542-431d-bb70-197394e6c566] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:10:10 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: eca753ae-f542-431d-bb70-197394e6c566] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:10:10 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: eca753ae-f542-431d-bb70-197394e6c566] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:10:10 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: eca753ae-f542-431d-bb70-197394e6c566] Took 0.55 seconds to deallocate network for instance.
Oct 20 09:10:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:11 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:10:11 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:10:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:11 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Deleted allocations for instance eca753ae-f542-431d-bb70-197394e6c566
Oct 20 09:10:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-323f0db8-a705-4cc6-85b8-5300da2c5c97 tempest-TestMinimumBasicScenario-1802809099 tempest-TestMinimumBasicScenario-1802809099-project-member] Lock "eca753ae-f542-431d-bb70-197394e6c566" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.185s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-730b75c7-4be6-4449-b0e3-82a29ce92755 req-33a61eea-48b6-443e-87ca-46a651448ce8 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received event network-vif-plugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:10:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-730b75c7-4be6-4449-b0e3-82a29ce92755 req-33a61eea-48b6-443e-87ca-46a651448ce8 service nova] Acquiring lock "eca753ae-f542-431d-bb70-197394e6c566-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-730b75c7-4be6-4449-b0e3-82a29ce92755 req-33a61eea-48b6-443e-87ca-46a651448ce8 service nova] Lock "eca753ae-f542-431d-bb70-197394e6c566-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-730b75c7-4be6-4449-b0e3-82a29ce92755 req-33a61eea-48b6-443e-87ca-46a651448ce8 service nova] Lock "eca753ae-f542-431d-bb70-197394e6c566-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-730b75c7-4be6-4449-b0e3-82a29ce92755 req-33a61eea-48b6-443e-87ca-46a651448ce8 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] No waiting events found dispatching network-vif-plugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:10:11 user nova-compute[74039]: WARNING nova.compute.manager [req-730b75c7-4be6-4449-b0e3-82a29ce92755 req-33a61eea-48b6-443e-87ca-46a651448ce8 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received unexpected event network-vif-plugged-fea0e0ca-2480-435a-b0de-0381ebf787e7 for instance with vm_state deleted and task_state None.
Oct 20 09:10:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-730b75c7-4be6-4449-b0e3-82a29ce92755 req-33a61eea-48b6-443e-87ca-46a651448ce8 service nova] [instance: eca753ae-f542-431d-bb70-197394e6c566] Received event network-vif-deleted-fea0e0ca-2480-435a-b0de-0381ebf787e7 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:10:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:10:19 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Creating image(s)
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Did not create local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Ensure instance console log exists: /opt/stack/data/nova/instances/d7d1582f-4a3b-4d1b-9454-eb70debf8b07/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Start _get_guest_xml network_info=[{"id": "0f6af989-65a9-4d64-ade0-b547815b31af", "address": "fa:16:3e:72:58:d1", "network": {"id": "d25b876b-0740-492c-96d6-04dfdd2e722e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1105647057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc13d04ae90a4fb8ac51e288fe5ab140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6af989-65", "ovs_interfaceid": "0f6af989-65a9-4d64-ade0-b547815b31af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '05f14a24-2e71-4663-b9f3-5d6e07ef76a7', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tmUrKhWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd7d1582f-4a3b-4d1b-9454-eb70debf8b07', 'attached_at': '', 'detached_at': '', 'volume_id': '058aa9e3-d0b9-4712-a8c2-90300ae1d031', 'serial': '058aa9e3-d0b9-4712-a8c2-90300ae1d031'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:10:19 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 09:10:19 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.objects.instance [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lazy-loading 'vcpu_model' on Instance uuid d7d1582f-4a3b-4d1b-9454-eb70debf8b07 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tmUrKhWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:10:19 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 09:10:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:10:19 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 09:10:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:10:19 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:10:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[928a3988-ed2e-4a31-a03b-7d4e0ff28f07]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:10:19 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[baba63eb-a900-4ad6-8c20-b7aa1ea3837c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031] added
Oct 20 09:10:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f1d7fc-66f9-448e-80e9-abb36e46ec1f]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[42023ba2-d6f4-4c32-82f9-62bde0d26c1b]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tmUrKhWs {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tmUrKhWs" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[52becc2c-0cdb-4d7e-90e4-d799f3f8530e]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tmUrKhWs'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7142f363-8fbd-463e-8a67-55e84783f3b3]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1280e478-d861-4327-b088-42b9d7a7098d]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:10:20 user nova-compute[74039]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)
Oct 20 09:10:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:10:20 user nova-compute[74039]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)
Oct 20 09:10:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[53adfdcc-bff9-4540-b44c-78578baf121f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031, portal: 172.16.0.220,3260]
Oct 20 09:10:20 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031, portal: 172.16.0.220,3260] successful.
Oct 20 09:10:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bcef7d-7292-480b-90cd-cb2fdccad7a8]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9b81ca-edca-42a0-bc44-ac2ee8ab1e9d]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:10:20 user nova-compute[74039]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)
Oct 20 09:10:20 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:10:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:10:20 user nova-compute[74039]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)
Oct 20 09:10:20 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:10:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9767831-b990-4c19-94c8-843cae37b642]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:20 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: None {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tmUrKhWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23739313661663164', 'path': '/dev/sdd'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739313661663164', 'path': '/dev/sdd'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T09:07:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-708376907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1317353536',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2Qep7+ioVz4ToaltQb5B8e50cjc5EV3uc44CZSLG3G0pJ+dHSg4fhBqyGwCjA0p2uQ8QVyrcEdJbDBJuM2jMJFlpyM4SxXsL+MsZ1gKCrGcMvERPd26mEQnXws/T8dvA==',key_name='tempest-keypair-1840380994',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:08:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bc13d04ae90a4fb8ac51e288fe5ab140',ramdisk_id='',reservation_id='r-3osji2pv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1308908868',owner_user_name='tempest-ServerActionsV293TestJSON-1308908868-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:10:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bddf822c42cf4c1397db396e176462ff',uuid=d7d1582f-4a3b-4d1b-9454-eb70debf8b07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f6af989-65a9-4d64-ade0-b547815b31af", "address": "fa:16:3e:72:58:d1", "network": {"id": "d25b876b-0740-492c-96d6-04dfdd2e722e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1105647057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc13d04ae90a4fb8ac51e288fe5ab140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6af989-65", "ovs_interfaceid": "0f6af989-65a9-4d64-ade0-b547815b31af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Converting VIF {"id": "0f6af989-65a9-4d64-ade0-b547815b31af", "address": "fa:16:3e:72:58:d1", "network": {"id": "d25b876b-0740-492c-96d6-04dfdd2e722e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1105647057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc13d04ae90a4fb8ac51e288fe5ab140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6af989-65", "ovs_interfaceid": "0f6af989-65a9-4d64-ade0-b547815b31af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:58:d1,bridge_name='br-int',has_traffic_filtering=True,id=0f6af989-65a9-4d64-ade0-b547815b31af,network=Network(d25b876b-0740-492c-96d6-04dfdd2e722e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6af989-65') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:10:21 user nova-compute[74039]:   <uuid>d7d1582f-4a3b-4d1b-9454-eb70debf8b07</uuid>
Oct 20 09:10:21 user nova-compute[74039]:   <name>instance-00000022</name>
Oct 20 09:10:21 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:10:21 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:10:21 user nova-compute[74039]:   <metadata>
Oct 20 09:10:21 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:10:21 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:10:21 user nova-compute[74039]:       <nova:name>tempest-ServerActionsV293TestJSON-server-708376907</nova:name>
Oct 20 09:10:21 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:10:19</nova:creationTime>
Oct 20 09:10:21 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:10:21 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:10:21 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:10:21 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:10:21 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:10:21 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:10:21 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:10:21 user nova-compute[74039]:       <nova:owner>
Oct 20 09:10:21 user nova-compute[74039]:         <nova:user uuid="bddf822c42cf4c1397db396e176462ff">tempest-ServerActionsV293TestJSON-1308908868-project-member</nova:user>
Oct 20 09:10:21 user nova-compute[74039]:         <nova:project uuid="bc13d04ae90a4fb8ac51e288fe5ab140">tempest-ServerActionsV293TestJSON-1308908868</nova:project>
Oct 20 09:10:21 user nova-compute[74039]:       </nova:owner>
Oct 20 09:10:21 user nova-compute[74039]:       <nova:ports>
Oct 20 09:10:21 user nova-compute[74039]:         <nova:port uuid="0f6af989-65a9-4d64-ade0-b547815b31af">
Oct 20 09:10:21 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 09:10:21 user nova-compute[74039]:         </nova:port>
Oct 20 09:10:21 user nova-compute[74039]:       </nova:ports>
Oct 20 09:10:21 user nova-compute[74039]:     </nova:instance>
Oct 20 09:10:21 user nova-compute[74039]:   </metadata>
Oct 20 09:10:21 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:10:21 user nova-compute[74039]:     <system>
Oct 20 09:10:21 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:10:21 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:10:21 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:10:21 user nova-compute[74039]:       <entry name="serial">d7d1582f-4a3b-4d1b-9454-eb70debf8b07</entry>
Oct 20 09:10:21 user nova-compute[74039]:       <entry name="uuid">d7d1582f-4a3b-4d1b-9454-eb70debf8b07</entry>
Oct 20 09:10:21 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:10:21 user nova-compute[74039]:     </system>
Oct 20 09:10:21 user nova-compute[74039]:   </sysinfo>
Oct 20 09:10:21 user nova-compute[74039]:   <os>
Oct 20 09:10:21 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:10:21 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:10:21 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:10:21 user nova-compute[74039]:   </os>
Oct 20 09:10:21 user nova-compute[74039]:   <features>
Oct 20 09:10:21 user nova-compute[74039]:     <acpi/>
Oct 20 09:10:21 user nova-compute[74039]:     <apic/>
Oct 20 09:10:21 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:10:21 user nova-compute[74039]:   </features>
Oct 20 09:10:21 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:10:21 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:10:21 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:10:21 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:10:21 user nova-compute[74039]:   </clock>
Oct 20 09:10:21 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:10:21 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:10:21 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:10:21 user nova-compute[74039]:   </cpu>
Oct 20 09:10:21 user nova-compute[74039]:   <devices>
Oct 20 09:10:21 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 09:10:21 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:10:21 user nova-compute[74039]:       <source dev="/dev/sdd"/>
Oct 20 09:10:21 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:10:21 user nova-compute[74039]:       <serial>058aa9e3-d0b9-4712-a8c2-90300ae1d031</serial>
Oct 20 09:10:21 user nova-compute[74039]:     </disk>
Oct 20 09:10:21 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:10:21 user nova-compute[74039]:       <mac address="fa:16:3e:72:58:d1"/>
Oct 20 09:10:21 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:10:21 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:10:21 user nova-compute[74039]:       <target dev="tap0f6af989-65"/>
Oct 20 09:10:21 user nova-compute[74039]:     </interface>
Oct 20 09:10:21 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:10:21 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/d7d1582f-4a3b-4d1b-9454-eb70debf8b07/console.log" append="off"/>
Oct 20 09:10:21 user nova-compute[74039]:     </serial>
Oct 20 09:10:21 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:10:21 user nova-compute[74039]:     <video>
Oct 20 09:10:21 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:10:21 user nova-compute[74039]:     </video>
Oct 20 09:10:21 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:10:21 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:10:21 user nova-compute[74039]:     </rng>
Oct 20 09:10:21 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:10:21 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:10:21 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:10:21 user nova-compute[74039]:     </memballoon>
Oct 20 09:10:21 user nova-compute[74039]:   </devices>
Oct 20 09:10:21 user nova-compute[74039]: </domain>
Oct 20 09:10:21 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T09:07:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-708376907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1317353536',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2Qep7+ioVz4ToaltQb5B8e50cjc5EV3uc44CZSLG3G0pJ+dHSg4fhBqyGwCjA0p2uQ8QVyrcEdJbDBJuM2jMJFlpyM4SxXsL+MsZ1gKCrGcMvERPd26mEQnXws/T8dvA==',key_name='tempest-keypair-1840380994',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:08:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bc13d04ae90a4fb8ac51e288fe5ab140',ramdisk_id='',reservation_id='r-3osji2pv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1308908868',owner_user_name='tempest-ServerActionsV293TestJSON-1308908868-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:10:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bddf822c42cf4c1397db396e176462ff',uuid=d7d1582f-4a3b-4d1b-9454-eb70debf8b07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f6af989-65a9-4d64-ade0-b547815b31af", "address": "fa:16:3e:72:58:d1", "network": {"id": "d25b876b-0740-492c-96d6-04dfdd2e722e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1105647057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc13d04ae90a4fb8ac51e288fe5ab140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6af989-65", "ovs_interfaceid": "0f6af989-65a9-4d64-ade0-b547815b31af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Converting VIF {"id": "0f6af989-65a9-4d64-ade0-b547815b31af", "address": "fa:16:3e:72:58:d1", "network": {"id": "d25b876b-0740-492c-96d6-04dfdd2e722e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1105647057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc13d04ae90a4fb8ac51e288fe5ab140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6af989-65", "ovs_interfaceid": "0f6af989-65a9-4d64-ade0-b547815b31af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:58:d1,bridge_name='br-int',has_traffic_filtering=True,id=0f6af989-65a9-4d64-ade0-b547815b31af,network=Network(d25b876b-0740-492c-96d6-04dfdd2e722e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6af989-65') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG os_vif [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:58:d1,bridge_name='br-int',has_traffic_filtering=True,id=0f6af989-65a9-4d64-ade0-b547815b31af,network=Network(d25b876b-0740-492c-96d6-04dfdd2e722e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6af989-65') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'beccc864-b591-5780-83bd-de2a52cdc1f0', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f6af989-65, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f6af989-65, col_values=(('qos', UUID('c6c22704-40ac-4921-933a-9013e82a73b5')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f6af989-65, col_values=(('external_ids', {'iface-id': '0f6af989-65a9-4d64-ade0-b547815b31af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:58:d1', 'vm-uuid': 'd7d1582f-4a3b-4d1b-9454-eb70debf8b07'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:21 user nova-compute[74039]: INFO os_vif [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:58:d1,bridge_name='br-int',has_traffic_filtering=True,id=0f6af989-65a9-4d64-ade0-b547815b31af,network=Network(d25b876b-0740-492c-96d6-04dfdd2e722e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6af989-65')
Oct 20 09:10:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:10:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] No VIF found with MAC fa:16:3e:72:58:d1, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:10:22 user nova-compute[74039]: INFO nova.compute.manager [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Rescuing
Oct 20 09:10:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:10:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquired lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:10:22 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:10:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:23 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Updating instance_info_cache with network_info: [{"id": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "address": "fa:16:3e:63:49:5e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc0a1c-ee", "ovs_interfaceid": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:10:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-4a8bfdfa-56e5-4b07-b54b-3ab2635ee39c req-2cfaaaed-9da4-4662-9af8-fa9f7d26f0b9 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Received event network-vif-plugged-0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:10:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a8bfdfa-56e5-4b07-b54b-3ab2635ee39c req-2cfaaaed-9da4-4662-9af8-fa9f7d26f0b9 service nova] Acquiring lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a8bfdfa-56e5-4b07-b54b-3ab2635ee39c req-2cfaaaed-9da4-4662-9af8-fa9f7d26f0b9 service nova] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a8bfdfa-56e5-4b07-b54b-3ab2635ee39c req-2cfaaaed-9da4-4662-9af8-fa9f7d26f0b9 service nova] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-4a8bfdfa-56e5-4b07-b54b-3ab2635ee39c req-2cfaaaed-9da4-4662-9af8-fa9f7d26f0b9 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] No waiting events found dispatching network-vif-plugged-0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:10:23 user nova-compute[74039]: WARNING nova.compute.manager [req-4a8bfdfa-56e5-4b07-b54b-3ab2635ee39c req-2cfaaaed-9da4-4662-9af8-fa9f7d26f0b9 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Received unexpected event network-vif-plugged-0f6af989-65a9-4d64-ade0-b547815b31af for instance with vm_state active and task_state rebuild_spawning.
Oct 20 09:10:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Releasing lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:10:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:24 user nova-compute[74039]: DEBUG nova.compute.manager [req-c54b829c-6caf-4422-8001-148c14173612 req-980fc830-d4ed-43ea-b96e-6f5bd03c7c6f service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received event network-vif-unplugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:10:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c54b829c-6caf-4422-8001-148c14173612 req-980fc830-d4ed-43ea-b96e-6f5bd03c7c6f service nova] Acquiring lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c54b829c-6caf-4422-8001-148c14173612 req-980fc830-d4ed-43ea-b96e-6f5bd03c7c6f service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c54b829c-6caf-4422-8001-148c14173612 req-980fc830-d4ed-43ea-b96e-6f5bd03c7c6f service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:24 user nova-compute[74039]: DEBUG nova.compute.manager [req-c54b829c-6caf-4422-8001-148c14173612 req-980fc830-d4ed-43ea-b96e-6f5bd03c7c6f service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] No waiting events found dispatching network-vif-unplugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:10:24 user nova-compute[74039]: WARNING nova.compute.manager [req-c54b829c-6caf-4422-8001-148c14173612 req-980fc830-d4ed-43ea-b96e-6f5bd03c7c6f service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received unexpected event network-vif-unplugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 for instance with vm_state active and task_state rescuing.
Oct 20 09:10:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:10:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:10:24 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Instance destroyed successfully.
Oct 20 09:10:24 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Attempting a stable device rescue
Oct 20 09:10:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74039) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 09:10:24 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Instance directory exists: not creating {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 09:10:24 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Creating image(s)
Oct 20 09:10:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ef84a0f-b5bd-4df4-b3e1-da05581d2b17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "/opt/stack/data/nova/instances/7ef84a0f-b5bd-4df4-b3e1-da05581d2b17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "/opt/stack/data/nova/instances/7ef84a0f-b5bd-4df4-b3e1-da05581d2b17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:24 user nova-compute[74039]: DEBUG nova.objects.instance [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:10:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:10:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c.part --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:25 user nova-compute[74039]: DEBUG nova.compute.manager [req-c659d8c1-93e7-4d3f-b159-4acc67e73a41 req-2262289f-7f35-4e46-b776-0943c11813d2 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Received event network-vif-plugged-0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:10:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c659d8c1-93e7-4d3f-b159-4acc67e73a41 req-2262289f-7f35-4e46-b776-0943c11813d2 service nova] Acquiring lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c659d8c1-93e7-4d3f-b159-4acc67e73a41 req-2262289f-7f35-4e46-b776-0943c11813d2 service nova] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c659d8c1-93e7-4d3f-b159-4acc67e73a41 req-2262289f-7f35-4e46-b776-0943c11813d2 service nova] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:25 user nova-compute[74039]: DEBUG nova.compute.manager [req-c659d8c1-93e7-4d3f-b159-4acc67e73a41 req-2262289f-7f35-4e46-b776-0943c11813d2 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] No waiting events found dispatching network-vif-plugged-0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:10:25 user nova-compute[74039]: WARNING nova.compute.manager [req-c659d8c1-93e7-4d3f-b159-4acc67e73a41 req-2262289f-7f35-4e46-b776-0943c11813d2 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Received unexpected event network-vif-plugged-0f6af989-65a9-4d64-ade0-b547815b31af for instance with vm_state active and task_state rebuild_spawning.
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:10:26 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Instance spawned successfully.
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c.part --force-share --output=json" returned: 0 in 0.267s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.virt.images [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] 6be84633-2c80-413d-9a9a-0198acfdf0fb was qcow2, converting to raw {{(pid=74039) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.privsep.utils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74039) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c.part /opt/stack/data/nova/instances/_base/6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c.converted {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-2a2d5a63-1bf6-4991-97e8-2ef7c21e745a req-3d66409b-2dba-49e0-9baa-9a900b56f781 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received event network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2a2d5a63-1bf6-4991-97e8-2ef7c21e745a req-3d66409b-2dba-49e0-9baa-9a900b56f781 service nova] Acquiring lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2a2d5a63-1bf6-4991-97e8-2ef7c21e745a req-3d66409b-2dba-49e0-9baa-9a900b56f781 service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2a2d5a63-1bf6-4991-97e8-2ef7c21e745a req-3d66409b-2dba-49e0-9baa-9a900b56f781 service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-2a2d5a63-1bf6-4991-97e8-2ef7c21e745a req-3d66409b-2dba-49e0-9baa-9a900b56f781 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] No waiting events found dispatching network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:10:26 user nova-compute[74039]: WARNING nova.compute.manager [req-2a2d5a63-1bf6-4991-97e8-2ef7c21e745a req-3d66409b-2dba-49e0-9baa-9a900b56f781 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received unexpected event network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 for instance with vm_state active and task_state rescuing.
Oct 20 09:10:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c.part /opt/stack/data/nova/instances/_base/6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c.converted" returned: 0 in 0.304s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c.converted --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.objects.instance [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74039) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f9973bb1-3834-404c-bdb6-a122412b3987 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.108s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.101s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c --force-share --output=json" returned: 0 in 0.236s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c,backing_fmt=raw /opt/stack/data/nova/instances/7ef84a0f-b5bd-4df4-b3e1-da05581d2b17/disk.rescue {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c,backing_fmt=raw /opt/stack/data/nova/instances/7ef84a0f-b5bd-4df4-b3e1-da05581d2b17/disk.rescue" returned: 0 in 0.055s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.objects.instance [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'migration_context' on Instance uuid 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.objects.base [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Object Instance<7ef84a0f-b5bd-4df4-b3e1-da05581d2b17> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Start _get_guest_xml network_info=[{"id": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "address": "fa:16:3e:63:49:5e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "vif_mac": "fa:16:3e:63:49:5e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc0a1c-ee", "ovs_interfaceid": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6be84633-2c80-413d-9a9a-0198acfdf0fb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b6babed8-870e-4a16-864d-8d8645613993', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abucNVZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '7ef84a0f-b5bd-4df4-b3e1-da05581d2b17', 'attached_at': '', 'detached_at': '', 'volume_id': '2bae475b-ece4-4c2a-b9a4-c2291830bd14', 'serial': '2bae475b-ece4-4c2a-b9a4-c2291830bd14'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.objects.instance [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'resources' on Instance uuid 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:10:26 user nova-compute[74039]: DEBUG nova.objects.base [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Object Instance<7ef84a0f-b5bd-4df4-b3e1-da05581d2b17> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.objects.instance [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'numa_topology' on Instance uuid 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.objects.base [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Object Instance<7ef84a0f-b5bd-4df4-b3e1-da05581d2b17> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:10:27 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:10:27 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.objects.instance [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.objects.base [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Object Instance<7ef84a0f-b5bd-4df4-b3e1-da05581d2b17> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abucNVZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:10:27 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:10:27 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:10:27 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c0dcb0-36eb-4c3a-b7de-4890ddd95a91]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = abucNVZr\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 09:10:27 user nova-compute[74039]: node.name = iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14
Oct 20 09:10:27 user nova-compute[74039]: node.tpgt = -1
Oct 20 09:10:27 user nova-compute[74039]: node.startup = automatic
Oct 20 09:10:27 user nova-compute[74039]: node.leading_login = No
Oct 20 09:10:27 user nova-compute[74039]: iface.iscsi_ifacename = default
Oct 20 09:10:27 user nova-compute[74039]: iface.net_ifacename = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.ipaddress = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.prefix_len = 0
Oct 20 09:10:27 user nova-compute[74039]: iface.hwaddress = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.transport_name = tcp
Oct 20 09:10:27 user nova-compute[74039]: iface.initiatorname = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.state = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.vlan_id = 0
Oct 20 09:10:27 user nova-compute[74039]: iface.vlan_priority = 0
Oct 20 09:10:27 user nova-compute[74039]: iface.vlan_state = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.iface_num = 0
Oct 20 09:10:27 user nova-compute[74039]: iface.mtu = 0
Oct 20 09:10:27 user nova-compute[74039]: iface.port = 0
Oct 20 09:10:27 user nova-compute[74039]: iface.bootproto = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.subnet_mask = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.gateway = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.dhcp_alt_client_id = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.dhcp_dns = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.dhcp_learn_iqn = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.dhcp_vendor_id_state = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.dhcp_vendor_id = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.dhcp_slp_da = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.fragmentation = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.gratuitous_arp = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.incoming_forwarding = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.tos_state = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.tos = 0
Oct 20 09:10:27 user nova-compute[74039]: iface.ttl = 0
Oct 20 09:10:27 user nova-compute[74039]: iface.delayed_ack = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.tcp_nagle = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.tcp_wsf_state = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.tcp_wsf = 0
Oct 20 09:10:27 user nova-compute[74039]: iface.tcp_timer_scale = 0
Oct 20 09:10:27 user nova-compute[74039]: iface.tcp_timestamp = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.redirect = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.def_task_mgmt_timeout = 0
Oct 20 09:10:27 user nova-compute[74039]: iface.header_digest = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.data_digest = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.immediate_data = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.initial_r2t = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.data_seq_inorder = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.data_pdu_inorder = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.erl = 0
Oct 20 09:10:27 user nova-compute[74039]: iface.max_receive_data_len = 0
Oct 20 09:10:27 user nova-compute[74039]: iface.first_burst_len = 0
Oct 20 09:10:27 user nova-compute[74039]: iface.max_outstanding_r2t = 0
Oct 20 09:10:27 user nova-compute[74039]: iface.max_burst_len = 0
Oct 20 09:10:27 user nova-compute[74039]: iface.chap_auth = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.bidi_chap = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.strict_login_compliance = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.discovery_auth = <empty>
Oct 20 09:10:27 user nova-compute[74039]: iface.discovery_logout = <empty>
Oct 20 09:10:27 user nova-compute[74039]: node.discovery_address = <empty>
Oct 20 09:10:27 user nova-compute[74039]: node.discovery_port = 0
Oct 20 09:10:27 user nova-compute[74039]: node.discovery_type = static
Oct 20 09:10:27 user nova-compute[74039]: node.session.initial_cmdsn = 0
Oct 20 09:10:27 user nova-compute[74039]: node.session.initial_login_retry_max = 8
Oct 20 09:10:27 user nova-compute[74039]: node.session.xmit_thread_priority = -20
Oct 20 09:10:27 user nova-compute[74039]: node.session.cmds_max = 128
Oct 20 09:10:27 user nova-compute[74039]: node.session.queue_depth = 32
Oct 20 09:10:27 user nova-compute[74039]: node.session.nr_sessions = 1
Oct 20 09:10:27 user nova-compute[74039]: node.session.auth.authmethod = CHAP
Oct 20 09:10:27 user nova-compute[74039]: node.session.auth.username = abucNVZr
Oct 20 09:10:27 user nova-compute[74039]: node.session.auth.password = ***
Oct 20 09:10:27 user nova-compute[74039]: node.session.auth.username_in = <empty>
Oct 20 09:10:27 user nova-compute[74039]: node.session.auth.password_in = <empty>
Oct 20 09:10:27 user nova-compute[74039]: node.session.auth.chap_algs = MD5
Oct 20 09:10:27 user nova-compute[74039]: node.session.timeo.replacement_timeout = 120
Oct 20 09:10:27 user nova-compute[74039]: node.session.err_timeo.abort_timeout = 15
Oct 20 09:10:27 user nova-compute[74039]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 09:10:27 user nova-compute[74039]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 09:10:27 user nova-compute[74039]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 09:10:27 user nova-compute[74039]: node.session.iscsi.FastAbort = Yes
Oct 20 09:10:27 user nova-compute[74039]: node.session.iscsi.InitialR2T = No
Oct 20 09:10:27 user nova-compute[74039]: node.session.iscsi.ImmediateData = Yes
Oct 20 09:10:27 user nova-compute[74039]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 09:10:27 user nova-compute[74039]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 09:10:27 user nova-compute[74039]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 09:10:27 user nova-compute[74039]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 09:10:27 user nova-compute[74039]: node.session.iscsi.MaxConnections = 1
Oct 20 09:10:27 user nova-compute[74039]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 09:10:27 user nova-compute[74039]: node.session.iscsi.ERL = 0
Oct 20 09:10:27 user nova-compute[74039]: node.session.scan = manual
Oct 20 09:10:27 user nova-compute[74039]: node.session.reopen_max = 0
Oct 20 09:10:27 user nova-compute[74039]: node.conn[0].address = 172.16.0.220
Oct 20 09:10:27 user nova-compute[74039]: node.conn[0].port = 3260
Oct 20 09:10:27 user nova-compute[74039]: node.conn[0].startup = manual
Oct 20 09:10:27 user nova-compute[74039]: node.conn[0].tcp.window_size = 524288
Oct 20 09:10:27 user nova-compute[74039]: node.conn[0].tcp.type_of_service = 0
Oct 20 09:10:27 user nova-compute[74039]: node.conn[0].timeo.logout_timeout = 15
Oct 20 09:10:27 user nova-compute[74039]: node.conn[0].timeo.login_timeout = 15
Oct 20 09:10:27 user nova-compute[74039]: node.conn[0].timeo.auth_timeout = 45
Oct 20 09:10:27 user nova-compute[74039]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 09:10:27 user nova-compute[74039]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 09:10:27 user nova-compute[74039]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 09:10:27 user nova-compute[74039]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 09:10:27 user nova-compute[74039]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 09:10:27 user nova-compute[74039]: node.conn[0].iscsi.DataDigest = None
Oct 20 09:10:27 user nova-compute[74039]: node.conn[0].iscsi.IFMarker = No
Oct 20 09:10:27 user nova-compute[74039]: node.conn[0].iscsi.OFMarker = No
Oct 20 09:10:27 user nova-compute[74039]: # END RECORD
Oct 20 09:10:27 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ed492b-3002-4066-a69d-abae1347a2f3]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee94b93c-dd4d-407a-9c42-d8c68438f4a0]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abucNVZr {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abucNVZr" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7652783-6df9-4d24-816e-bbb06baea900]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'abucNVZr'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ff53f7-4f21-40fa-a287-a582f5d821e7]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTJOlAZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:10:27 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2745a1a3-32bd-4ddc-8996-a2674810f32d]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:10:27 user nova-compute[74039]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)
Oct 20 09:10:27 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:10:27 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:10:27 user nova-compute[74039]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)
Oct 20 09:10:27 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:10:27 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.197s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] HCTL ('34', '0', '0', 0) found on session 36 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa48a287-d05e-46bc-96db-3c8ed68c4d7c]: (4, ('0 0 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Searching for a device in session 36 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abucNVZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.225s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] <== connect_volume: return (228ms) {'type': 'block', 'scsi_wwn': '26164666436653062', 'path': '/dev/sdc'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164666436653062', 'path': '/dev/sdc'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.043s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:10:27 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:10:27 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcd7be1-1976-435a-a31c-151cdf1361c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:10:27 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:08:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1276384976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1276384976',id=36,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:09:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7ed96a82048434fb0d79a55838184e4',ramdisk_id='',reservation_id='r-vf8crc97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:09:18Z,user_data=None,user_id='1e07a52b4e3b4a65b34f71fb2cca8de3',uuid=7ef84a0f-b5bd-4df4-b3e1-da05581d2b17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "address": "fa:16:3e:63:49:5e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "vif_mac": "fa:16:3e:63:49:5e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc0a1c-ee", "ovs_interfaceid": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converting VIF {"id": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "address": "fa:16:3e:63:49:5e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "vif_mac": "fa:16:3e:63:49:5e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc0a1c-ee", "ovs_interfaceid": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:49:5e,bridge_name='br-int',has_traffic_filtering=True,id=f9fc0a1c-ee0c-4540-9221-b93d88aafe99,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc0a1c-ee') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.objects.instance [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.objects.base [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Object Instance<7ef84a0f-b5bd-4df4-b3e1-da05581d2b17> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:10:27 user nova-compute[74039]:   <uuid>7ef84a0f-b5bd-4df4-b3e1-da05581d2b17</uuid>
Oct 20 09:10:27 user nova-compute[74039]:   <name>instance-00000024</name>
Oct 20 09:10:27 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:10:27 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:10:27 user nova-compute[74039]:   <metadata>
Oct 20 09:10:27 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:10:27 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:10:27 user nova-compute[74039]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1276384976</nova:name>
Oct 20 09:10:27 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:10:27</nova:creationTime>
Oct 20 09:10:27 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:10:27 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:10:27 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:10:27 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:10:27 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:10:27 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:10:27 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:10:27 user nova-compute[74039]:       <nova:owner>
Oct 20 09:10:27 user nova-compute[74039]:         <nova:user uuid="1e07a52b4e3b4a65b34f71fb2cca8de3">tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member</nova:user>
Oct 20 09:10:27 user nova-compute[74039]:         <nova:project uuid="d7ed96a82048434fb0d79a55838184e4">tempest-ServerBootFromVolumeStableRescueTest-1728924155</nova:project>
Oct 20 09:10:27 user nova-compute[74039]:       </nova:owner>
Oct 20 09:10:27 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:10:27 user nova-compute[74039]:       <nova:ports>
Oct 20 09:10:27 user nova-compute[74039]:         <nova:port uuid="f9fc0a1c-ee0c-4540-9221-b93d88aafe99">
Oct 20 09:10:27 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 09:10:27 user nova-compute[74039]:         </nova:port>
Oct 20 09:10:27 user nova-compute[74039]:       </nova:ports>
Oct 20 09:10:27 user nova-compute[74039]:     </nova:instance>
Oct 20 09:10:27 user nova-compute[74039]:   </metadata>
Oct 20 09:10:27 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:10:27 user nova-compute[74039]:     <system>
Oct 20 09:10:27 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:10:27 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:10:27 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:10:27 user nova-compute[74039]:       <entry name="serial">7ef84a0f-b5bd-4df4-b3e1-da05581d2b17</entry>
Oct 20 09:10:27 user nova-compute[74039]:       <entry name="uuid">7ef84a0f-b5bd-4df4-b3e1-da05581d2b17</entry>
Oct 20 09:10:27 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:10:27 user nova-compute[74039]:     </system>
Oct 20 09:10:27 user nova-compute[74039]:   </sysinfo>
Oct 20 09:10:27 user nova-compute[74039]:   <os>
Oct 20 09:10:27 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:10:27 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:10:27 user nova-compute[74039]:   </os>
Oct 20 09:10:27 user nova-compute[74039]:   <features>
Oct 20 09:10:27 user nova-compute[74039]:     <acpi/>
Oct 20 09:10:27 user nova-compute[74039]:     <apic/>
Oct 20 09:10:27 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:10:27 user nova-compute[74039]:   </features>
Oct 20 09:10:27 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:10:27 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:10:27 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:10:27 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:10:27 user nova-compute[74039]:   </clock>
Oct 20 09:10:27 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:10:27 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:10:27 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:10:27 user nova-compute[74039]:   </cpu>
Oct 20 09:10:27 user nova-compute[74039]:   <devices>
Oct 20 09:10:27 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 09:10:27 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:10:27 user nova-compute[74039]:       <source dev="/dev/sdc"/>
Oct 20 09:10:27 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:10:27 user nova-compute[74039]:       <serial>2bae475b-ece4-4c2a-b9a4-c2291830bd14</serial>
Oct 20 09:10:27 user nova-compute[74039]:     </disk>
Oct 20 09:10:27 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:10:27 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:10:27 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/7ef84a0f-b5bd-4df4-b3e1-da05581d2b17/disk.rescue"/>
Oct 20 09:10:27 user nova-compute[74039]:       <target dev="vdb" bus="virtio"/>
Oct 20 09:10:27 user nova-compute[74039]:       <boot order="1"/>
Oct 20 09:10:27 user nova-compute[74039]:     </disk>
Oct 20 09:10:27 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:10:27 user nova-compute[74039]:       <mac address="fa:16:3e:63:49:5e"/>
Oct 20 09:10:27 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:10:27 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:10:27 user nova-compute[74039]:       <target dev="tapf9fc0a1c-ee"/>
Oct 20 09:10:27 user nova-compute[74039]:     </interface>
Oct 20 09:10:27 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:10:27 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/7ef84a0f-b5bd-4df4-b3e1-da05581d2b17/console.log" append="off"/>
Oct 20 09:10:27 user nova-compute[74039]:     </serial>
Oct 20 09:10:27 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:10:27 user nova-compute[74039]:     <video>
Oct 20 09:10:27 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:10:27 user nova-compute[74039]:     </video>
Oct 20 09:10:27 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:10:27 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:10:27 user nova-compute[74039]:     </rng>
Oct 20 09:10:27 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:10:27 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:10:27 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:10:27 user nova-compute[74039]:     </memballoon>
Oct 20 09:10:27 user nova-compute[74039]:   </devices>
Oct 20 09:10:27 user nova-compute[74039]: </domain>
Oct 20 09:10:27 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[76734ce4-6062-4adc-b9ac-551363a5f2fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099] added
Oct 20 09:10:27 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:27 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Instance destroyed successfully.
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2738fd60-776a-411b-8a50-67dd3f152387]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f32483-d0c8-494d-82ea-78c531aed884]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nTJOlAZK {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] No VIF found with MAC fa:16:3e:63:49:5e, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Updating instance_info_cache with network_info: [{"id": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "address": "fa:16:3e:d6:ab:b8", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e6bac4-ee", "ovs_interfaceid": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nTJOlAZK" returned: 0 in 0.038s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c6c77a-7652-42e8-8d2c-f0a33738c737]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nTJOlAZK'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[145ceb71-4be8-4ccc-9aa1-fe0cfcd16820]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c9b845-2348-4cbf-8480-25eeab99182e]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:10:27 user nova-compute[74039]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)
Oct 20 09:10:27 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:10:27 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:10:27 user nova-compute[74039]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)
Oct 20 09:10:27 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:10:27 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[281c41d9-998b-40ff-9acb-5ead0de203ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099, portal: 172.16.0.220,3260]
Oct 20 09:10:27 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099, portal: 172.16.0.220,3260] successful.
Oct 20 09:10:27 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c5bbc0-df08-4c29-b181-ae76d165cccf]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca201aff-485c-4446-be28-293648ce8f05]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:10:27 user nova-compute[74039]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)
Oct 20 09:10:27 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:10:27 user nova-compute[74039]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 (non-flash)
Oct 20 09:10:27 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:10:27 user nova-compute[74039]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)
Oct 20 09:10:27 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:10:27 user nova-compute[74039]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 (non-flash)
Oct 20 09:10:27 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-d8c6f430-d803-45b1-b92e-87395ea0aa65 req-cc839a94-443e-4f32-9774-59f5b8852968 service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Received event network-changed-d20c0187-4d18-4dd3-8288-b59b1f841a71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-d8c6f430-d803-45b1-b92e-87395ea0aa65 req-cc839a94-443e-4f32-9774-59f5b8852968 service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Refreshing instance network info cache due to event network-changed-d20c0187-4d18-4dd3-8288-b59b1f841a71. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d8c6f430-d803-45b1-b92e-87395ea0aa65 req-cc839a94-443e-4f32-9774-59f5b8852968 service nova] Acquiring lock "refresh_cache-a250449f-72d0-4b64-825b-d47e0dff471a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d8c6f430-d803-45b1-b92e-87395ea0aa65 req-cc839a94-443e-4f32-9774-59f5b8852968 service nova] Acquired lock "refresh_cache-a250449f-72d0-4b64-825b-d47e0dff471a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG nova.network.neutron [req-d8c6f430-d803-45b1-b92e-87395ea0aa65 req-cc839a94-443e-4f32-9774-59f5b8852968 service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Refreshing network info cache for port d20c0187-4d18-4dd3-8288-b59b1f841a71 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[558c8ee0-5b4b-4585-8bf4-233a68d3e4ec]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:10:27 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTJOlAZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:10:28 user nova-compute[74039]: DEBUG nova.network.neutron [req-d8c6f430-d803-45b1-b92e-87395ea0aa65 req-cc839a94-443e-4f32-9774-59f5b8852968 service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Updated VIF entry in instance network info cache for port d20c0187-4d18-4dd3-8288-b59b1f841a71. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:10:28 user nova-compute[74039]: DEBUG nova.network.neutron [req-d8c6f430-d803-45b1-b92e-87395ea0aa65 req-cc839a94-443e-4f32-9774-59f5b8852968 service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Updating instance_info_cache with network_info: [{"id": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "address": "fa:16:3e:35:39:59", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c0187-4d", "ovs_interfaceid": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:10:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d8c6f430-d803-45b1-b92e-87395ea0aa65 req-cc839a94-443e-4f32-9774-59f5b8852968 service nova] Releasing lock "refresh_cache-a250449f-72d0-4b64-825b-d47e0dff471a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:10:28 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:10:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:10:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] <== connect_volume: return (1481ms) {'type': 'block', 'scsi_wwn': '23032353964383464', 'path': '/dev/sde'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:10:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032353964383464', 'path': '/dev/sde'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:10:28 user nova-compute[74039]: DEBUG nova.objects.instance [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lazy-loading 'flavor' on Instance uuid 9589267e-e485-4f18-a435-c2623c949937 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:10:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 09:10:28 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:10:28 user nova-compute[74039]:   <source dev="/dev/sde"/>
Oct 20 09:10:28 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:10:28 user nova-compute[74039]:   <serial>be535fe1-7cb4-44cd-befd-64b7a2071099</serial>
Oct 20 09:10:28 user nova-compute[74039]: </disk>
Oct 20 09:10:28 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 09:10:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-1d5c8e2a-9926-4f96-9465-dc0796e15ce2 req-d5770011-dd42-4ecb-9bba-0c69c7c91238 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received event network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:10:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1d5c8e2a-9926-4f96-9465-dc0796e15ce2 req-d5770011-dd42-4ecb-9bba-0c69c7c91238 service nova] Acquiring lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1d5c8e2a-9926-4f96-9465-dc0796e15ce2 req-d5770011-dd42-4ecb-9bba-0c69c7c91238 service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1d5c8e2a-9926-4f96-9465-dc0796e15ce2 req-d5770011-dd42-4ecb-9bba-0c69c7c91238 service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-1d5c8e2a-9926-4f96-9465-dc0796e15ce2 req-d5770011-dd42-4ecb-9bba-0c69c7c91238 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] No waiting events found dispatching network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:10:29 user nova-compute[74039]: WARNING nova.compute.manager [req-1d5c8e2a-9926-4f96-9465-dc0796e15ce2 req-d5770011-dd42-4ecb-9bba-0c69c7c91238 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received unexpected event network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 for instance with vm_state active and task_state rescuing.
Oct 20 09:10:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:10:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:10:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] No VIF found with MAC fa:16:3e:a9:a8:9e, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:10:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:10:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35212b7f-f1d3-46e7-a35d-2867f07e2156 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "9589267e-e485-4f18-a435-c2623c949937" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.243s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:30 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:10:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-52a7d447-2a46-4c68-9f37-b2c97caeab59 req-a93444f9-106f-47ad-8bd8-9362b725c812 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received event network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:10:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-52a7d447-2a46-4c68-9f37-b2c97caeab59 req-a93444f9-106f-47ad-8bd8-9362b725c812 service nova] Acquiring lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-52a7d447-2a46-4c68-9f37-b2c97caeab59 req-a93444f9-106f-47ad-8bd8-9362b725c812 service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-52a7d447-2a46-4c68-9f37-b2c97caeab59 req-a93444f9-106f-47ad-8bd8-9362b725c812 service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-52a7d447-2a46-4c68-9f37-b2c97caeab59 req-a93444f9-106f-47ad-8bd8-9362b725c812 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] No waiting events found dispatching network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:10:31 user nova-compute[74039]: WARNING nova.compute.manager [req-52a7d447-2a46-4c68-9f37-b2c97caeab59 req-a93444f9-106f-47ad-8bd8-9362b725c812 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received unexpected event network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 for instance with vm_state active and task_state rescuing.
Oct 20 09:10:32 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ab13d4bc-c724-4601-b7f5-492286109898 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:10:32 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:10:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Acquiring lock "9589267e-e485-4f18-a435-c2623c949937" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "9589267e-e485-4f18-a435-c2623c949937" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:32 user nova-compute[74039]: INFO nova.compute.manager [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Detaching volume be535fe1-7cb4-44cd-befd-64b7a2071099
Oct 20 09:10:32 user nova-compute[74039]: INFO nova.virt.block_device [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Attempting to driver detach volume be535fe1-7cb4-44cd-befd-64b7a2071099 from mountpoint /dev/vdb
Oct 20 09:10:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Attempting to detach device vdb from instance 9589267e-e485-4f18-a435-c2623c949937 from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 09:10:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:10:32 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:10:32 user nova-compute[74039]:   <source dev="/dev/sde"/>
Oct 20 09:10:32 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:10:32 user nova-compute[74039]:   <serial>be535fe1-7cb4-44cd-befd-64b7a2071099</serial>
Oct 20 09:10:32 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:10:32 user nova-compute[74039]: </disk>
Oct 20 09:10:32 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:10:32 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Successfully detached device vdb from instance 9589267e-e485-4f18-a435-c2623c949937 from the persistent domain config.
Oct 20 09:10:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9589267e-e485-4f18-a435-c2623c949937 from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 09:10:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:10:32 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:10:32 user nova-compute[74039]:   <source dev="/dev/sde"/>
Oct 20 09:10:32 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:10:32 user nova-compute[74039]:   <serial>be535fe1-7cb4-44cd-befd-64b7a2071099</serial>
Oct 20 09:10:32 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:10:32 user nova-compute[74039]: </disk>
Oct 20 09:10:32 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:10:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9589267e-e485-4f18-a435-c2623c949937 {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 09:10:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:38 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:10:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:40 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:10:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:40 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:10:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:10:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef84a0f-b5bd-4df4-b3e1-da05581d2b17/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef84a0f-b5bd-4df4-b3e1-da05581d2b17/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef84a0f-b5bd-4df4-b3e1-da05581d2b17/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef84a0f-b5bd-4df4-b3e1-da05581d2b17/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:42 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:10:42 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:10:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:43 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:10:43 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:10:43 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7851MB free_disk=25.343055725097656GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:10:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:43 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:10:43 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance eb7a44c0-2405-4ff2-b6db-8ace80f44377 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:10:43 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance d7d1582f-4a3b-4d1b-9454-eb70debf8b07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:10:43 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 9589267e-e485-4f18-a435-c2623c949937 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:10:43 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:10:43 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance a250449f-72d0-4b64-825b-d47e0dff471a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:10:43 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:10:43 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:10:43 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing inventories for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 09:10:43 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Updating ProviderTree inventory for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 09:10:43 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Updating inventory in ProviderTree for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 09:10:43 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing aggregate associations for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb, aggregates: None {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 09:10:43 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing trait associations for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 09:10:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:44 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:10:44 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:10:44 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:10:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.576s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:45 user nova-compute[74039]: INFO nova.compute.manager [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Detaching volume 141cc996-0d44-4c9c-926d-946f84842a9f
Oct 20 09:10:45 user nova-compute[74039]: INFO nova.virt.block_device [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Attempting to driver detach volume 141cc996-0d44-4c9c-926d-946f84842a9f from mountpoint /dev/vdb
Oct 20 09:10:45 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Attempting to detach device vdb from instance eb7a44c0-2405-4ff2-b6db-8ace80f44377 from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 09:10:45 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:10:45 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:10:45 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 09:10:45 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:10:45 user nova-compute[74039]:   <serial>141cc996-0d44-4c9c-926d-946f84842a9f</serial>
Oct 20 09:10:45 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:10:45 user nova-compute[74039]: </disk>
Oct 20 09:10:45 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:10:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:45 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Successfully detached device vdb from instance eb7a44c0-2405-4ff2-b6db-8ace80f44377 from the persistent domain config.
Oct 20 09:10:45 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eb7a44c0-2405-4ff2-b6db-8ace80f44377 from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 09:10:45 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:10:45 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:10:45 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 09:10:45 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:10:45 user nova-compute[74039]:   <serial>141cc996-0d44-4c9c-926d-946f84842a9f</serial>
Oct 20 09:10:45 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:10:45 user nova-compute[74039]: </disk>
Oct 20 09:10:45 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:10:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:45 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eb7a44c0-2405-4ff2-b6db-8ace80f44377 {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 09:10:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "a250449f-72d0-4b64-825b-d47e0dff471a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "a250449f-72d0-4b64-825b-d47e0dff471a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG nova.objects.instance [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lazy-loading 'flavor' on Instance uuid a250449f-72d0-4b64-825b-d47e0dff471a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "a250449f-72d0-4b64-825b-d47e0dff471a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "a250449f-72d0-4b64-825b-d47e0dff471a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "a250449f-72d0-4b64-825b-d47e0dff471a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:10:49 user nova-compute[74039]: INFO nova.compute.manager [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Attaching volume 10273a49-4975-4375-a381-92c87521946b to /dev/vdb
Oct 20 09:10:49 user nova-compute[74039]: DEBUG os_brick.utils [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b36deaa-ac50-4293-863b-6e81ab5872df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7313a81d-8da3-4520-aca5-8b1ed86aa7b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3b6eaf-efd2-4174-ae11-51e3f5479f31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[895197c1-d5d9-4dd8-a9ea-3ae675b429d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:10:49 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:10:49 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc98841-fed9-458d-ae31-aae90e138234]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG os_brick.utils [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:10:49 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Updating existing volume attachment record: 6bde85e1-cb86-463f-9336-298ddd929797 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:10:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:53 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9589267e-e485-4f18-a435-c2623c949937 is timed out.
Oct 20 09:10:53 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Successfully detached device vdb from instance 9589267e-e485-4f18-a435-c2623c949937 from the live domain config.
Oct 20 09:10:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTJOlAZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:10:53 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:10:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fda46f-b4b6-476d-85a7-6a918dcdc099]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:10:53 user nova-compute[74039]: No targets found.
Oct 20 09:10:53 user nova-compute[74039]: iSNS:
Oct 20 09:10:53 user nova-compute[74039]: No targets found.
Oct 20 09:10:53 user nova-compute[74039]: STATIC:
Oct 20 09:10:53 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14
Oct 20 09:10:53 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:10:53 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:10:53 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031
Oct 20 09:10:53 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:10:53 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:10:53 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f
Oct 20 09:10:53 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:10:53 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:10:53 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099
Oct 20 09:10:53 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:10:53 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:10:53 user nova-compute[74039]: FIRMWARE:
Oct 20 09:10:53 user nova-compute[74039]: No targets found.
Oct 20 09:10:53 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:10:53 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:10:53 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[be64ffbe-369f-45ec-9fa6-1b4e77ff2277]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6f4068-a7e2-42ce-8e4a-3f7e8775c1b8]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:10:53 user nova-compute[74039]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)
Oct 20 09:10:53 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:10:53 user nova-compute[74039]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 (non-flash)
Oct 20 09:10:53 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:10:53 user nova-compute[74039]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)
Oct 20 09:10:53 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:10:53 user nova-compute[74039]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 (non-flash)
Oct 20 09:10:53 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae7c1895a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099'): ({'sde'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Removing single pathed devices sde {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7174a82-2acd-4388-87c7-37436d685a3d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a5cba5-6ce2-404c-9016-95e938e87f8c]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Flushing IO for device /dev/sde {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c244bcd-6ba8-4ed9-ba0d-4ec8879124ad]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca1b128-8bfe-4198-95c4-b6976ef0f63d]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] SCSI volumes sde have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ef76f2-1c3f-4724-b388-e4f5e52d31ac]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[848e85ab-0bf2-417a-a277-1abceb0f7a10]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099, portal: 172.16.0.220,3260]
Oct 20 09:10:53 user nova-compute[74039]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099, portal: 172.16.0.220,3260] successful.
Oct 20 09:10:53 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be535fe1-7cb4-44cd-befd-64b7a2071099 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cfb230-dad0-4332-8cfd-ccee332a2c9b]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] <== disconnect_volume: return (391ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:10:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:10:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:10:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:05 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance eb7a44c0-2405-4ff2-b6db-8ace80f44377 is timed out.
Oct 20 09:11:05 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Successfully detached device vdb from instance eb7a44c0-2405-4ff2-b6db-8ace80f44377 from the live domain config.
Oct 20 09:11:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUIufAlV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:11:05 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:11:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f3caf2-d9c6-4a8a-9351-724ec5efe1fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:11:05 user nova-compute[74039]: No targets found.
Oct 20 09:11:05 user nova-compute[74039]: iSNS:
Oct 20 09:11:05 user nova-compute[74039]: No targets found.
Oct 20 09:11:05 user nova-compute[74039]: STATIC:
Oct 20 09:11:05 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14
Oct 20 09:11:05 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:11:05 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:11:05 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031
Oct 20 09:11:05 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:11:05 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:11:05 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f
Oct 20 09:11:05 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:11:05 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:11:05 user nova-compute[74039]: FIRMWARE:
Oct 20 09:11:05 user nova-compute[74039]: No targets found.
Oct 20 09:11:05 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:11:05 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:11:05 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc28dd99-b3b3-4561-bed2-c2138e06ac09]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[86afc601-1bda-4090-a5a1-7be5f1a65009]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:11:05 user nova-compute[74039]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)
Oct 20 09:11:05 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:11:05 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:11:05 user nova-compute[74039]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f (non-flash)
Oct 20 09:11:05 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:11:05 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae87bc6710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f'): ({'sdb'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Removing single pathed devices sdb {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.045s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[832e7671-e383-4aaa-9e46-ed4976a0a283]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d682d82-aebe-4181-8898-4a36eb85cbb3]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Flushing IO for device /dev/sdb {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:11:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b0557a-e5f9-474f-8a25-d89a86da7f27]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb45a43-4982-49fc-958a-ff958be51fef]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22f81af-a18d-4a2f-b6b6-6b9f2302ef65]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8c9709-9560-47fe-8378-b9380f1c20a4]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f, portal: 172.16.0.220,3260]
Oct 20 09:11:06 user nova-compute[74039]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f, portal: 172.16.0.220,3260] successful.
Oct 20 09:11:06 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f9e57b-bec5-42a7-b546-bcfc0aa2b791]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] <== disconnect_volume: return (406ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:11:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:20 user nova-compute[74039]: DEBUG nova.objects.instance [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lazy-loading 'flavor' on Instance uuid 9589267e-e485-4f18-a435-c2623c949937 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:11:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b2e9ee31-5023-47fb-ae93-1321182f95ac tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "9589267e-e485-4f18-a435-c2623c949937" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 47.516s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:11:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:11:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:11:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "a638e673-3249-4b12-9520-e3b49a4ac47a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:11:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:26 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:11:26 user nova-compute[74039]: INFO nova.compute.claims [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Claim successful on node user
Oct 20 09:11:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:26 user nova-compute[74039]: DEBUG nova.objects.instance [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lazy-loading 'flavor' on Instance uuid eb7a44c0-2405-4ff2-b6db-8ace80f44377 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:11:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ece550f2-a7b8-4701-95fb-be314d1d6f9e tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 41.653s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 41.473s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:26 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:11:26 user nova-compute[74039]: INFO nova.compute.manager [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Terminating instance
Oct 20 09:11:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:11:26 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:11:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:11:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG nova.compute.manager [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG nova.network.neutron [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:27 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:11:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG nova.compute.manager [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG nova.policy [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1ffed029a7d44bfaf17162b1385c667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bdcdfa65d545339549280d68c725c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-70485255-9494-4871-b486-41fb7a13733b req-32c9a3ed-ffdc-49a8-879b-137b82476e67 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Received event network-vif-unplugged-ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-70485255-9494-4871-b486-41fb7a13733b req-32c9a3ed-ffdc-49a8-879b-137b82476e67 service nova] Acquiring lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-70485255-9494-4871-b486-41fb7a13733b req-32c9a3ed-ffdc-49a8-879b-137b82476e67 service nova] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-70485255-9494-4871-b486-41fb7a13733b req-32c9a3ed-ffdc-49a8-879b-137b82476e67 service nova] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-70485255-9494-4871-b486-41fb7a13733b req-32c9a3ed-ffdc-49a8-879b-137b82476e67 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] No waiting events found dispatching network-vif-unplugged-ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-70485255-9494-4871-b486-41fb7a13733b req-32c9a3ed-ffdc-49a8-879b-137b82476e67 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Received event network-vif-unplugged-ceda34ef-339f-4423-adf1-5d39a1412398 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG nova.compute.manager [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:11:27 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Creating image(s)
Oct 20 09:11:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "/opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "/opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "/opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.284s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Didn't find any instances for network info cache update. {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 09:11:27 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Instance destroyed successfully.
Oct 20 09:11:27 user nova-compute[74039]: DEBUG nova.objects.instance [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lazy-loading 'resources' on Instance uuid eb7a44c0-2405-4ff2-b6db-8ace80f44377 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:07:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1991621703',display_name='tempest-VolumesSnapshotTestJSON-instance-1991621703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1991621703',id=33,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0BF/RoZxkuMFifRjaNAJBAnrKpqAfbD5ssDv2H7hjCDA3q1O140TB4gk/R4ytJzNMe2/rRACTMTjGdVy11QJE3oktYZ/sGb/SVQS1jgojkS0EVoR3pxlNL+K1utALxLA==',key_name='tempest-keypair-1852617440',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:07:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40be8c8bc79f4ce2a4857d36ddfe0667',ramdisk_id='',reservation_id='r-2phad53y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1434807460',owner_user_name='tempest-VolumesSnapshotTestJSON-1434807460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:07:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3196ef9f3da4311bb896432fbf55ed2',uuid=eb7a44c0-2405-4ff2-b6db-8ace80f44377,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ceda34ef-339f-4423-adf1-5d39a1412398", "address": "fa:16:3e:b3:28:4d", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda34ef-33", "ovs_interfaceid": "ceda34ef-339f-4423-adf1-5d39a1412398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Converting VIF {"id": "ceda34ef-339f-4423-adf1-5d39a1412398", "address": "fa:16:3e:b3:28:4d", "network": {"id": "c8baa945-5d9a-4bf8-830d-ab75cf318cad", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2032551183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40be8c8bc79f4ce2a4857d36ddfe0667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceda34ef-33", "ovs_interfaceid": "ceda34ef-339f-4423-adf1-5d39a1412398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:28:4d,bridge_name='br-int',has_traffic_filtering=True,id=ceda34ef-339f-4423-adf1-5d39a1412398,network=Network(c8baa945-5d9a-4bf8-830d-ab75cf318cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceda34ef-33') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG os_vif [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:28:4d,bridge_name='br-int',has_traffic_filtering=True,id=ceda34ef-339f-4423-adf1-5d39a1412398,network=Network(c8baa945-5d9a-4bf8-830d-ab75cf318cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceda34ef-33') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapceda34ef-33, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.291s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97ac4705-16ce-4d9b-971c-e17e2fadbc57) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk 1073741824" returned: 0 in 0.069s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.364s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:27 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:28 user nova-compute[74039]: INFO os_vif [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:28:4d,bridge_name='br-int',has_traffic_filtering=True,id=ceda34ef-339f-4423-adf1-5d39a1412398,network=Network(c8baa945-5d9a-4bf8-830d-ab75cf318cad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceda34ef-33')
Oct 20 09:11:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUIufAlV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:11:28 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:11:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[85aad746-3e5b-4f69-8d05-3677e0b06783]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:11:28 user nova-compute[74039]: No targets found.
Oct 20 09:11:28 user nova-compute[74039]: iSNS:
Oct 20 09:11:28 user nova-compute[74039]: No targets found.
Oct 20 09:11:28 user nova-compute[74039]: STATIC:
Oct 20 09:11:28 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14
Oct 20 09:11:28 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:11:28 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:11:28 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031
Oct 20 09:11:28 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:11:28 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:11:28 user nova-compute[74039]: FIRMWARE:
Oct 20 09:11:28 user nova-compute[74039]: No targets found.
Oct 20 09:11:28 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:11:28 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:11:28 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:141cc996-0d44-4c9c-926d-946f84842a9f', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d49d657-da99-4df7-8ae0-ac29c0ea8dab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[449ab39a-d22b-4a16-bbf6-c2407c7d1d19]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:11:28 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:11:28 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:11:28 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:11:28 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae8426ab90>, {}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Disconnecting from: [] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.101s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] <== disconnect_volume: return (107ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:11:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:11:28 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Deleting instance files /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377_del
Oct 20 09:11:28 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Deletion of /opt/stack/data/nova/instances/eb7a44c0-2405-4ff2-b6db-8ace80f44377_del complete
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.280s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.network.neutron [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Successfully created port: 32f68736-035f-4df9-8a0a-0714ef3b5e47 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:11:29 user nova-compute[74039]: INFO nova.compute.manager [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Took 1.59 seconds to destroy the instance on the hypervisor.
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Cannot resize image /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Ensure instance console log exists: /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Received event network-vif-plugged-ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] Acquiring lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] No waiting events found dispatching network-vif-plugged-ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:11:29 user nova-compute[74039]: WARNING nova.compute.manager [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Received unexpected event network-vif-plugged-ceda34ef-339f-4423-adf1-5d39a1412398 for instance with vm_state active and task_state deleting.
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Received event network-vif-plugged-ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] Acquiring lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] No waiting events found dispatching network-vif-plugged-ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:11:29 user nova-compute[74039]: WARNING nova.compute.manager [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Received unexpected event network-vif-plugged-ceda34ef-339f-4423-adf1-5d39a1412398 for instance with vm_state active and task_state deleting.
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Received event network-vif-plugged-ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] Acquiring lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] No waiting events found dispatching network-vif-plugged-ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:11:29 user nova-compute[74039]: WARNING nova.compute.manager [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Received unexpected event network-vif-plugged-ceda34ef-339f-4423-adf1-5d39a1412398 for instance with vm_state active and task_state deleting.
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Received event network-vif-unplugged-ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] Acquiring lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] No waiting events found dispatching network-vif-unplugged-ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-af0175cf-1013-4e3b-bbca-3a98b9549b47 req-c0a68722-20b4-4006-8ed0-a33c86fe1ab9 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Received event network-vif-unplugged-ceda34ef-339f-4423-adf1-5d39a1412398 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.network.neutron [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Successfully updated port: 32f68736-035f-4df9-8a0a-0714ef3b5e47 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "refresh_cache-a638e673-3249-4b12-9520-e3b49a4ac47a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquired lock "refresh_cache-a638e673-3249-4b12-9520-e3b49a4ac47a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.network.neutron [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-51edc497-bd17-47e6-b3ad-f71ad190af5a req-b0afdc2b-800c-4e33-9d77-2d9382892a85 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Received event network-changed-32f68736-035f-4df9-8a0a-0714ef3b5e47 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-51edc497-bd17-47e6-b3ad-f71ad190af5a req-b0afdc2b-800c-4e33-9d77-2d9382892a85 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Refreshing instance network info cache due to event network-changed-32f68736-035f-4df9-8a0a-0714ef3b5e47. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-51edc497-bd17-47e6-b3ad-f71ad190af5a req-b0afdc2b-800c-4e33-9d77-2d9382892a85 service nova] Acquiring lock "refresh_cache-a638e673-3249-4b12-9520-e3b49a4ac47a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:11:29 user nova-compute[74039]: DEBUG nova.network.neutron [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.network.neutron [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Updating instance_info_cache with network_info: [{"id": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "address": "fa:16:3e:f0:8b:d7", "network": {"id": "a7f821bb-906e-4142-b4d8-4d8f43e07afd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2060795733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41bdcdfa65d545339549280d68c725c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f68736-03", "ovs_interfaceid": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:11:30 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Took 1.81 seconds to deallocate network for instance.
Oct 20 09:11:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Releasing lock "refresh_cache-a638e673-3249-4b12-9520-e3b49a4ac47a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.compute.manager [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Instance network_info: |[{"id": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "address": "fa:16:3e:f0:8b:d7", "network": {"id": "a7f821bb-906e-4142-b4d8-4d8f43e07afd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2060795733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41bdcdfa65d545339549280d68c725c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f68736-03", "ovs_interfaceid": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-51edc497-bd17-47e6-b3ad-f71ad190af5a req-b0afdc2b-800c-4e33-9d77-2d9382892a85 service nova] Acquired lock "refresh_cache-a638e673-3249-4b12-9520-e3b49a4ac47a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.network.neutron [req-51edc497-bd17-47e6-b3ad-f71ad190af5a req-b0afdc2b-800c-4e33-9d77-2d9382892a85 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Refreshing network info cache for port 32f68736-035f-4df9-8a0a-0714ef3b5e47 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Start _get_guest_xml network_info=[{"id": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "address": "fa:16:3e:f0:8b:d7", "network": {"id": "a7f821bb-906e-4142-b4d8-4d8f43e07afd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2060795733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41bdcdfa65d545339549280d68c725c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f68736-03", "ovs_interfaceid": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-ec56e87e-a572-44f5-88c7-dc92500a6eef req-9a93d30e-319a-468f-ac1d-2fc1d3965499 service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Received event network-vif-deleted-ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:11:30 user nova-compute[74039]: WARNING nova.volume.cinder [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Attachment 0463a30d-dd54-45af-8494-cab0c1ed3250 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 0463a30d-dd54-45af-8494-cab0c1ed3250. (HTTP 404) (Request-ID: req-7c091642-5eff-4e59-855a-2bf07936b6f9)
Oct 20 09:11:30 user nova-compute[74039]: INFO nova.compute.manager [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Took 0.04 seconds to detach 1 volumes for instance.
Oct 20 09:11:30 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:11:30 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1670759370',display_name='tempest-TestServerVolumeAttachmentScenario-server-1670759370',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1670759370',id=38,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA704ou196mLyDQXct0q31pQdZk9EjqsOgq4GBS1i7TOJ9zGtHfF5t+1cK5X/iweyC9faT5dtODHVHOpSv3ZQDmfAP7pqVLyEYdhlkjQM7AGywr63DSEzPcsikkfi0kZeQ==',key_name='tempest-keypair-1551606917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41bdcdfa65d545339549280d68c725c2',ramdisk_id='',reservation_id='r-w2fhh888',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1075475771',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1075475771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1ffed029a7d44bfaf17162b1385c667',uuid=a638e673-3249-4b12-9520-e3b49a4ac47a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "address": "fa:16:3e:f0:8b:d7", "network": {"id": "a7f821bb-906e-4142-b4d8-4d8f43e07afd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2060795733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41bdcdfa65d545339549280d68c725c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f68736-03", "ovs_interfaceid": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Converting VIF {"id": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "address": "fa:16:3e:f0:8b:d7", "network": {"id": "a7f821bb-906e-4142-b4d8-4d8f43e07afd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2060795733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41bdcdfa65d545339549280d68c725c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f68736-03", "ovs_interfaceid": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:8b:d7,bridge_name='br-int',has_traffic_filtering=True,id=32f68736-035f-4df9-8a0a-0714ef3b5e47,network=Network(a7f821bb-906e-4142-b4d8-4d8f43e07afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f68736-03') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.objects.instance [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lazy-loading 'pci_devices' on Instance uuid a638e673-3249-4b12-9520-e3b49a4ac47a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:11:30 user nova-compute[74039]:   <uuid>a638e673-3249-4b12-9520-e3b49a4ac47a</uuid>
Oct 20 09:11:30 user nova-compute[74039]:   <name>instance-00000026</name>
Oct 20 09:11:30 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:11:30 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:11:30 user nova-compute[74039]:   <metadata>
Oct 20 09:11:30 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:11:30 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:11:30 user nova-compute[74039]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1670759370</nova:name>
Oct 20 09:11:30 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:11:30</nova:creationTime>
Oct 20 09:11:30 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:11:30 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:11:30 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:11:30 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:11:30 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:11:30 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:11:30 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:11:30 user nova-compute[74039]:       <nova:owner>
Oct 20 09:11:30 user nova-compute[74039]:         <nova:user uuid="f1ffed029a7d44bfaf17162b1385c667">tempest-TestServerVolumeAttachmentScenario-1075475771-project-member</nova:user>
Oct 20 09:11:30 user nova-compute[74039]:         <nova:project uuid="41bdcdfa65d545339549280d68c725c2">tempest-TestServerVolumeAttachmentScenario-1075475771</nova:project>
Oct 20 09:11:30 user nova-compute[74039]:       </nova:owner>
Oct 20 09:11:30 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:11:30 user nova-compute[74039]:       <nova:ports>
Oct 20 09:11:30 user nova-compute[74039]:         <nova:port uuid="32f68736-035f-4df9-8a0a-0714ef3b5e47">
Oct 20 09:11:30 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 09:11:30 user nova-compute[74039]:         </nova:port>
Oct 20 09:11:30 user nova-compute[74039]:       </nova:ports>
Oct 20 09:11:30 user nova-compute[74039]:     </nova:instance>
Oct 20 09:11:30 user nova-compute[74039]:   </metadata>
Oct 20 09:11:30 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:11:30 user nova-compute[74039]:     <system>
Oct 20 09:11:30 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:11:30 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:11:30 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:11:30 user nova-compute[74039]:       <entry name="serial">a638e673-3249-4b12-9520-e3b49a4ac47a</entry>
Oct 20 09:11:30 user nova-compute[74039]:       <entry name="uuid">a638e673-3249-4b12-9520-e3b49a4ac47a</entry>
Oct 20 09:11:30 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:11:30 user nova-compute[74039]:     </system>
Oct 20 09:11:30 user nova-compute[74039]:   </sysinfo>
Oct 20 09:11:30 user nova-compute[74039]:   <os>
Oct 20 09:11:30 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:11:30 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:11:30 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:11:30 user nova-compute[74039]:   </os>
Oct 20 09:11:30 user nova-compute[74039]:   <features>
Oct 20 09:11:30 user nova-compute[74039]:     <acpi/>
Oct 20 09:11:30 user nova-compute[74039]:     <apic/>
Oct 20 09:11:30 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:11:30 user nova-compute[74039]:   </features>
Oct 20 09:11:30 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:11:30 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:11:30 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:11:30 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:11:30 user nova-compute[74039]:   </clock>
Oct 20 09:11:30 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:11:30 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:11:30 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:11:30 user nova-compute[74039]:   </cpu>
Oct 20 09:11:30 user nova-compute[74039]:   <devices>
Oct 20 09:11:30 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:11:30 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:11:30 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk"/>
Oct 20 09:11:30 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:11:30 user nova-compute[74039]:     </disk>
Oct 20 09:11:30 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:11:30 user nova-compute[74039]:       <mac address="fa:16:3e:f0:8b:d7"/>
Oct 20 09:11:30 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:11:30 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:11:30 user nova-compute[74039]:       <target dev="tap32f68736-03"/>
Oct 20 09:11:30 user nova-compute[74039]:     </interface>
Oct 20 09:11:30 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:11:30 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/console.log" append="off"/>
Oct 20 09:11:30 user nova-compute[74039]:     </serial>
Oct 20 09:11:30 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:11:30 user nova-compute[74039]:     <video>
Oct 20 09:11:30 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:11:30 user nova-compute[74039]:     </video>
Oct 20 09:11:30 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:11:30 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:11:30 user nova-compute[74039]:     </rng>
Oct 20 09:11:30 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:11:30 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:11:30 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:11:30 user nova-compute[74039]:     </memballoon>
Oct 20 09:11:30 user nova-compute[74039]:   </devices>
Oct 20 09:11:30 user nova-compute[74039]: </domain>
Oct 20 09:11:30 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1670759370',display_name='tempest-TestServerVolumeAttachmentScenario-server-1670759370',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1670759370',id=38,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA704ou196mLyDQXct0q31pQdZk9EjqsOgq4GBS1i7TOJ9zGtHfF5t+1cK5X/iweyC9faT5dtODHVHOpSv3ZQDmfAP7pqVLyEYdhlkjQM7AGywr63DSEzPcsikkfi0kZeQ==',key_name='tempest-keypair-1551606917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41bdcdfa65d545339549280d68c725c2',ramdisk_id='',reservation_id='r-w2fhh888',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1075475771',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1075475771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1ffed029a7d44bfaf17162b1385c667',uuid=a638e673-3249-4b12-9520-e3b49a4ac47a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "address": "fa:16:3e:f0:8b:d7", "network": {"id": "a7f821bb-906e-4142-b4d8-4d8f43e07afd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2060795733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41bdcdfa65d545339549280d68c725c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f68736-03", "ovs_interfaceid": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Converting VIF {"id": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "address": "fa:16:3e:f0:8b:d7", "network": {"id": "a7f821bb-906e-4142-b4d8-4d8f43e07afd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2060795733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41bdcdfa65d545339549280d68c725c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f68736-03", "ovs_interfaceid": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:8b:d7,bridge_name='br-int',has_traffic_filtering=True,id=32f68736-035f-4df9-8a0a-0714ef3b5e47,network=Network(a7f821bb-906e-4142-b4d8-4d8f43e07afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f68736-03') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG os_vif [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:8b:d7,bridge_name='br-int',has_traffic_filtering=True,id=32f68736-035f-4df9-8a0a-0714ef3b5e47,network=Network(a7f821bb-906e-4142-b4d8-4d8f43e07afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f68736-03') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8245b440-34f5-5e40-a542-0d3b086c5b09', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32f68736-03, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32f68736-03, col_values=(('qos', UUID('71cb670c-96be-45ba-b5f9-e3951c9819ef')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32f68736-03, col_values=(('external_ids', {'iface-id': '32f68736-035f-4df9-8a0a-0714ef3b5e47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:8b:d7', 'vm-uuid': 'a638e673-3249-4b12-9520-e3b49a4ac47a'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:30 user nova-compute[74039]: INFO os_vif [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:8b:d7,bridge_name='br-int',has_traffic_filtering=True,id=32f68736-035f-4df9-8a0a-0714ef3b5e47,network=Network(a7f821bb-906e-4142-b4d8-4d8f43e07afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f68736-03')
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] No VIF found with MAC fa:16:3e:f0:8b:d7, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.network.neutron [req-51edc497-bd17-47e6-b3ad-f71ad190af5a req-b0afdc2b-800c-4e33-9d77-2d9382892a85 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Updated VIF entry in instance network info cache for port 32f68736-035f-4df9-8a0a-0714ef3b5e47. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.network.neutron [req-51edc497-bd17-47e6-b3ad-f71ad190af5a req-b0afdc2b-800c-4e33-9d77-2d9382892a85 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Updating instance_info_cache with network_info: [{"id": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "address": "fa:16:3e:f0:8b:d7", "network": {"id": "a7f821bb-906e-4142-b4d8-4d8f43e07afd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2060795733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41bdcdfa65d545339549280d68c725c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f68736-03", "ovs_interfaceid": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-51edc497-bd17-47e6-b3ad-f71ad190af5a req-b0afdc2b-800c-4e33-9d77-2d9382892a85 service nova] Releasing lock "refresh_cache-a638e673-3249-4b12-9520-e3b49a4ac47a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:11:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.548s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:31 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Deleted allocations for instance eb7a44c0-2405-4ff2-b6db-8ace80f44377
Oct 20 09:11:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2dd5292d-a7e4-4678-984d-ddc951dc5aa2 tempest-VolumesSnapshotTestJSON-1434807460 tempest-VolumesSnapshotTestJSON-1434807460-project-member] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.290s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-b78cc7fe-0cd3-4a3b-a1a7-cd4b116bc4a6 req-9cc4934d-6a81-4aa8-83d0-adc7688e15fb service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Received event network-vif-plugged-ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:11:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b78cc7fe-0cd3-4a3b-a1a7-cd4b116bc4a6 req-9cc4934d-6a81-4aa8-83d0-adc7688e15fb service nova] Acquiring lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b78cc7fe-0cd3-4a3b-a1a7-cd4b116bc4a6 req-9cc4934d-6a81-4aa8-83d0-adc7688e15fb service nova] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b78cc7fe-0cd3-4a3b-a1a7-cd4b116bc4a6 req-9cc4934d-6a81-4aa8-83d0-adc7688e15fb service nova] Lock "eb7a44c0-2405-4ff2-b6db-8ace80f44377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-b78cc7fe-0cd3-4a3b-a1a7-cd4b116bc4a6 req-9cc4934d-6a81-4aa8-83d0-adc7688e15fb service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] No waiting events found dispatching network-vif-plugged-ceda34ef-339f-4423-adf1-5d39a1412398 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:11:31 user nova-compute[74039]: WARNING nova.compute.manager [req-b78cc7fe-0cd3-4a3b-a1a7-cd4b116bc4a6 req-9cc4934d-6a81-4aa8-83d0-adc7688e15fb service nova] [instance: eb7a44c0-2405-4ff2-b6db-8ace80f44377] Received unexpected event network-vif-plugged-ceda34ef-339f-4423-adf1-5d39a1412398 for instance with vm_state deleted and task_state None.
Oct 20 09:11:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmBAuSQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:11:32 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:11:32 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:11:32 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:11:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260" returned: 21 in 0.036s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b667739-1e90-47c2-b400-092d6b940b07]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:11:32 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdc155e-0f87-46fd-afb9-e2240686fa34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b] added
Oct 20 09:11:32 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[43912ab8-753d-43e6-8568-ee1b369512cd]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b8e1fc-cfd2-41f1-bcc6-1fa7cde5d0cf]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LmBAuSQq {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LmBAuSQq" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd29eb6-c2fa-4267-a504-e72eb5c42772]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LmBAuSQq'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7143e4-23a1-4172-b815-cc30c5a62aee]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b824515-7c81-429a-b927-13ad79531496]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:11:32 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:11:32 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:11:32 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:11:32 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG nova.compute.manager [req-41048d8f-c0d7-4f82-b3e6-f5ec43ebec25 req-37331a35-ff43-4a66-810c-36a69aa80cd1 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Received event network-vif-plugged-32f68736-035f-4df9-8a0a-0714ef3b5e47 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-41048d8f-c0d7-4f82-b3e6-f5ec43ebec25 req-37331a35-ff43-4a66-810c-36a69aa80cd1 service nova] Acquiring lock "a638e673-3249-4b12-9520-e3b49a4ac47a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-41048d8f-c0d7-4f82-b3e6-f5ec43ebec25 req-37331a35-ff43-4a66-810c-36a69aa80cd1 service nova] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-41048d8f-c0d7-4f82-b3e6-f5ec43ebec25 req-37331a35-ff43-4a66-810c-36a69aa80cd1 service nova] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG nova.compute.manager [req-41048d8f-c0d7-4f82-b3e6-f5ec43ebec25 req-37331a35-ff43-4a66-810c-36a69aa80cd1 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] No waiting events found dispatching network-vif-plugged-32f68736-035f-4df9-8a0a-0714ef3b5e47 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:11:32 user nova-compute[74039]: WARNING nova.compute.manager [req-41048d8f-c0d7-4f82-b3e6-f5ec43ebec25 req-37331a35-ff43-4a66-810c-36a69aa80cd1 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Received unexpected event network-vif-plugged-32f68736-035f-4df9-8a0a-0714ef3b5e47 for instance with vm_state building and task_state spawning.
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b8959b-1909-470a-aa87-5f81adddea35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b, portal: 172.16.0.220,3260]
Oct 20 09:11:32 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b, portal: 172.16.0.220,3260] successful.
Oct 20 09:11:32 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d042de-5cfe-4656-84d5-3d779d39dde5]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b681c6-fc59-4b63-9ffb-918ad5f86d6f]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:11:32 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:11:32 user nova-compute[74039]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b (non-flash)
Oct 20 09:11:32 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:11:32 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:11:32 user nova-compute[74039]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b (non-flash)
Oct 20 09:11:32 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaa1698-d777-48e7-af5a-ad37d2d18b41]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:33 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:11:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmBAuSQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:11:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:11:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '23233636338343733', 'path': '/dev/sdb'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:11:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233636338343733', 'path': '/dev/sdb'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:11:33 user nova-compute[74039]: DEBUG nova.objects.instance [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lazy-loading 'flavor' on Instance uuid a250449f-72d0-4b64-825b-d47e0dff471a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:11:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 09:11:33 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:11:33 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 09:11:33 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:11:33 user nova-compute[74039]:   <serial>10273a49-4975-4375-a381-92c87521946b</serial>
Oct 20 09:11:33 user nova-compute[74039]: </disk>
Oct 20 09:11:33 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 09:11:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:11:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:11:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] No VIF found with MAC fa:16:3e:35:39:59, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:11:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-58370539-1f1f-4537-983d-c1e4f4a5dcd5 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "a250449f-72d0-4b64-825b-d47e0dff471a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 44.779s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:34 user nova-compute[74039]: DEBUG nova.compute.manager [req-5f8ef1a1-637b-48d8-9b1e-db03618f0b81 req-4f6f7b60-ecb8-49f7-853d-b4e28adc5742 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Received event network-vif-plugged-32f68736-035f-4df9-8a0a-0714ef3b5e47 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:11:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5f8ef1a1-637b-48d8-9b1e-db03618f0b81 req-4f6f7b60-ecb8-49f7-853d-b4e28adc5742 service nova] Acquiring lock "a638e673-3249-4b12-9520-e3b49a4ac47a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5f8ef1a1-637b-48d8-9b1e-db03618f0b81 req-4f6f7b60-ecb8-49f7-853d-b4e28adc5742 service nova] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5f8ef1a1-637b-48d8-9b1e-db03618f0b81 req-4f6f7b60-ecb8-49f7-853d-b4e28adc5742 service nova] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:34 user nova-compute[74039]: DEBUG nova.compute.manager [req-5f8ef1a1-637b-48d8-9b1e-db03618f0b81 req-4f6f7b60-ecb8-49f7-853d-b4e28adc5742 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] No waiting events found dispatching network-vif-plugged-32f68736-035f-4df9-8a0a-0714ef3b5e47 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:11:34 user nova-compute[74039]: WARNING nova.compute.manager [req-5f8ef1a1-637b-48d8-9b1e-db03618f0b81 req-4f6f7b60-ecb8-49f7-853d-b4e28adc5742 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Received unexpected event network-vif-plugged-32f68736-035f-4df9-8a0a-0714ef3b5e47 for instance with vm_state building and task_state spawning.
Oct 20 09:11:34 user nova-compute[74039]: DEBUG nova.compute.manager [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:11:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:11:34 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Instance spawned successfully.
Oct 20 09:11:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:11:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:11:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:11:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:11:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:11:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:11:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:11:34 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:11:34 user nova-compute[74039]: INFO nova.compute.manager [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Took 7.46 seconds to spawn the instance on the hypervisor.
Oct 20 09:11:34 user nova-compute[74039]: DEBUG nova.compute.manager [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:11:34 user nova-compute[74039]: INFO nova.compute.manager [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Took 8.50 seconds to build instance.
Oct 20 09:11:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-896cae4c-622c-4848-bb61-8885600a65ce tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.656s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "a250449f-72d0-4b64-825b-d47e0dff471a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "a250449f-72d0-4b64-825b-d47e0dff471a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:35 user nova-compute[74039]: INFO nova.compute.manager [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Detaching volume 10273a49-4975-4375-a381-92c87521946b
Oct 20 09:11:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:35 user nova-compute[74039]: INFO nova.virt.block_device [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Attempting to driver detach volume 10273a49-4975-4375-a381-92c87521946b from mountpoint /dev/vdb
Oct 20 09:11:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Attempting to detach device vdb from instance a250449f-72d0-4b64-825b-d47e0dff471a from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 09:11:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:11:35 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:11:35 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 09:11:35 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:11:35 user nova-compute[74039]:   <serial>10273a49-4975-4375-a381-92c87521946b</serial>
Oct 20 09:11:35 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:11:35 user nova-compute[74039]: </disk>
Oct 20 09:11:35 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:11:35 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Successfully detached device vdb from instance a250449f-72d0-4b64-825b-d47e0dff471a from the persistent domain config.
Oct 20 09:11:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a250449f-72d0-4b64-825b-d47e0dff471a from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 09:11:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:11:35 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:11:35 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 09:11:35 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:11:35 user nova-compute[74039]:   <serial>10273a49-4975-4375-a381-92c87521946b</serial>
Oct 20 09:11:35 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:11:35 user nova-compute[74039]: </disk>
Oct 20 09:11:35 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:11:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a250449f-72d0-4b64-825b-d47e0dff471a {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 09:11:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Acquiring lock "9589267e-e485-4f18-a435-c2623c949937" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "9589267e-e485-4f18-a435-c2623c949937" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Acquiring lock "9589267e-e485-4f18-a435-c2623c949937-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "9589267e-e485-4f18-a435-c2623c949937-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "9589267e-e485-4f18-a435-c2623c949937-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:36 user nova-compute[74039]: INFO nova.compute.manager [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Terminating instance
Oct 20 09:11:36 user nova-compute[74039]: DEBUG nova.compute.manager [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:11:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:36 user nova-compute[74039]: DEBUG nova.compute.manager [req-8d26a722-dfc4-4f46-a7ed-db9ffcb89c18 req-b437aa33-0eae-46cd-ad8a-17f632c6d2c2 service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] Received event network-vif-unplugged-88781e7b-db18-4d13-81c8-1408a4a40725 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:11:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d26a722-dfc4-4f46-a7ed-db9ffcb89c18 req-b437aa33-0eae-46cd-ad8a-17f632c6d2c2 service nova] Acquiring lock "9589267e-e485-4f18-a435-c2623c949937-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d26a722-dfc4-4f46-a7ed-db9ffcb89c18 req-b437aa33-0eae-46cd-ad8a-17f632c6d2c2 service nova] Lock "9589267e-e485-4f18-a435-c2623c949937-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8d26a722-dfc4-4f46-a7ed-db9ffcb89c18 req-b437aa33-0eae-46cd-ad8a-17f632c6d2c2 service nova] Lock "9589267e-e485-4f18-a435-c2623c949937-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:36 user nova-compute[74039]: DEBUG nova.compute.manager [req-8d26a722-dfc4-4f46-a7ed-db9ffcb89c18 req-b437aa33-0eae-46cd-ad8a-17f632c6d2c2 service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] No waiting events found dispatching network-vif-unplugged-88781e7b-db18-4d13-81c8-1408a4a40725 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:11:36 user nova-compute[74039]: DEBUG nova.compute.manager [req-8d26a722-dfc4-4f46-a7ed-db9ffcb89c18 req-b437aa33-0eae-46cd-ad8a-17f632c6d2c2 service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] Received event network-vif-unplugged-88781e7b-db18-4d13-81c8-1408a4a40725 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:11:37 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 9589267e-e485-4f18-a435-c2623c949937] Instance destroyed successfully.
Oct 20 09:11:37 user nova-compute[74039]: DEBUG nova.objects.instance [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lazy-loading 'resources' on Instance uuid 9589267e-e485-4f18-a435-c2623c949937 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:11:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1529463264',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1529463264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1529463',id=35,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpasCVn46ZR5GXMBUoXjUevMdxxe9+TL961C7evUBpC40kr46yjAaXhndQAqNEjh3bSchzmdZTIsO/usKr2bAkku+UMrf4vkIM6ospy/LfaVdN4ndo2I4tiIopIUzn++A==',key_name='tempest-keypair-1303445713',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:08:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5443955df42049cbaddfaa14af72a30d',ramdisk_id='',reservation_id='r-fzz4r4fl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1465022385',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:08:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='643e363e890d49f987785acb0e967281',uuid=9589267e-e485-4f18-a435-c2623c949937,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88781e7b-db18-4d13-81c8-1408a4a40725", "address": "fa:16:3e:a9:a8:9e", "network": {"id": "198b9730-8e45-4bb2-92ae-55624d070e9a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808796854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5443955df42049cbaddfaa14af72a30d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88781e7b-db", "ovs_interfaceid": "88781e7b-db18-4d13-81c8-1408a4a40725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:11:37 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Converting VIF {"id": "88781e7b-db18-4d13-81c8-1408a4a40725", "address": "fa:16:3e:a9:a8:9e", "network": {"id": "198b9730-8e45-4bb2-92ae-55624d070e9a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808796854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5443955df42049cbaddfaa14af72a30d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88781e7b-db", "ovs_interfaceid": "88781e7b-db18-4d13-81c8-1408a4a40725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:11:37 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:a8:9e,bridge_name='br-int',has_traffic_filtering=True,id=88781e7b-db18-4d13-81c8-1408a4a40725,network=Network(198b9730-8e45-4bb2-92ae-55624d070e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88781e7b-db') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:11:37 user nova-compute[74039]: DEBUG os_vif [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:a8:9e,bridge_name='br-int',has_traffic_filtering=True,id=88781e7b-db18-4d13-81c8-1408a4a40725,network=Network(198b9730-8e45-4bb2-92ae-55624d070e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88781e7b-db') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:11:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88781e7b-db, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:11:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:11:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1106300f-e2b5-4524-9c30-dc7133331abb) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:11:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:11:37 user nova-compute[74039]: INFO os_vif [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:a8:9e,bridge_name='br-int',has_traffic_filtering=True,id=88781e7b-db18-4d13-81c8-1408a4a40725,network=Network(198b9730-8e45-4bb2-92ae-55624d070e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88781e7b-db')
Oct 20 09:11:37 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Deleting instance files /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937_del
Oct 20 09:11:37 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Deletion of /opt/stack/data/nova/instances/9589267e-e485-4f18-a435-c2623c949937_del complete
Oct 20 09:11:37 user nova-compute[74039]: INFO nova.compute.manager [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] [instance: 9589267e-e485-4f18-a435-c2623c949937] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 20 09:11:37 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:11:37 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 9589267e-e485-4f18-a435-c2623c949937] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:11:37 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 9589267e-e485-4f18-a435-c2623c949937] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:11:38 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 9589267e-e485-4f18-a435-c2623c949937] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:11:38 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 9589267e-e485-4f18-a435-c2623c949937] Took 0.80 seconds to deallocate network for instance.
Oct 20 09:11:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:38 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:11:38 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:11:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:38 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Deleted allocations for instance 9589267e-e485-4f18-a435-c2623c949937
Oct 20 09:11:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-07cbc19e-a1f1-4ae9-8708-1d39d26d9d01 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385 tempest-TestServerVolumeAttachScenarioOldVersion-1465022385-project-member] Lock "9589267e-e485-4f18-a435-c2623c949937" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.569s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:39 user nova-compute[74039]: DEBUG nova.compute.manager [req-1b6b0fb0-193f-4424-8510-ea8a982510d5 req-c3be4bf1-d64d-4047-9e7e-21f6ebfa1e99 service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] Received event network-vif-plugged-88781e7b-db18-4d13-81c8-1408a4a40725 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:11:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1b6b0fb0-193f-4424-8510-ea8a982510d5 req-c3be4bf1-d64d-4047-9e7e-21f6ebfa1e99 service nova] Acquiring lock "9589267e-e485-4f18-a435-c2623c949937-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1b6b0fb0-193f-4424-8510-ea8a982510d5 req-c3be4bf1-d64d-4047-9e7e-21f6ebfa1e99 service nova] Lock "9589267e-e485-4f18-a435-c2623c949937-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1b6b0fb0-193f-4424-8510-ea8a982510d5 req-c3be4bf1-d64d-4047-9e7e-21f6ebfa1e99 service nova] Lock "9589267e-e485-4f18-a435-c2623c949937-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:39 user nova-compute[74039]: DEBUG nova.compute.manager [req-1b6b0fb0-193f-4424-8510-ea8a982510d5 req-c3be4bf1-d64d-4047-9e7e-21f6ebfa1e99 service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] No waiting events found dispatching network-vif-plugged-88781e7b-db18-4d13-81c8-1408a4a40725 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:11:39 user nova-compute[74039]: WARNING nova.compute.manager [req-1b6b0fb0-193f-4424-8510-ea8a982510d5 req-c3be4bf1-d64d-4047-9e7e-21f6ebfa1e99 service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] Received unexpected event network-vif-plugged-88781e7b-db18-4d13-81c8-1408a4a40725 for instance with vm_state deleted and task_state None.
Oct 20 09:11:39 user nova-compute[74039]: DEBUG nova.compute.manager [req-1b6b0fb0-193f-4424-8510-ea8a982510d5 req-c3be4bf1-d64d-4047-9e7e-21f6ebfa1e99 service nova] [instance: 9589267e-e485-4f18-a435-c2623c949937] Received event network-vif-deleted-88781e7b-db18-4d13-81c8-1408a4a40725 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:11:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:42 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:11:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:11:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:11:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef84a0f-b5bd-4df4-b3e1-da05581d2b17/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef84a0f-b5bd-4df4-b3e1-da05581d2b17/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef84a0f-b5bd-4df4-b3e1-da05581d2b17/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ef84a0f-b5bd-4df4-b3e1-da05581d2b17/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:11:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:45 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:11:45 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:11:45 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7996MB free_disk=25.413372039794922GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:11:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:11:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:11:45 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:11:45 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance d7d1582f-4a3b-4d1b-9454-eb70debf8b07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:11:45 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:11:45 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance a250449f-72d0-4b64-825b-d47e0dff471a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:11:45 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance a638e673-3249-4b12-9520-e3b49a4ac47a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:11:45 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:11:45 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:11:45 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:11:45 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:11:45 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:11:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:11:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:56 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a250449f-72d0-4b64-825b-d47e0dff471a is timed out.
Oct 20 09:11:56 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Successfully detached device vdb from instance a250449f-72d0-4b64-825b-d47e0dff471a from the live domain config.
Oct 20 09:11:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmBAuSQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:11:56 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:11:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[426cbf1c-8844-4038-a5b5-b28c3329a54c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:11:56 user nova-compute[74039]: No targets found.
Oct 20 09:11:56 user nova-compute[74039]: iSNS:
Oct 20 09:11:56 user nova-compute[74039]: No targets found.
Oct 20 09:11:56 user nova-compute[74039]: STATIC:
Oct 20 09:11:56 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14
Oct 20 09:11:56 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:11:56 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:11:56 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b
Oct 20 09:11:56 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:11:56 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:11:56 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031
Oct 20 09:11:56 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:11:56 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:11:56 user nova-compute[74039]: FIRMWARE:
Oct 20 09:11:56 user nova-compute[74039]: No targets found.
Oct 20 09:11:56 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:11:56 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:11:56 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d57e80-5240-4678-a6e9-0b6493ddccaa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6502ede4-d868-4760-95a9-cea34ba7c6b3]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:11:56 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:11:56 user nova-compute[74039]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b (non-flash)
Oct 20 09:11:56 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:11:56 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:11:56 user nova-compute[74039]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b (non-flash)
Oct 20 09:11:56 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae84269510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b'): ({'sdb'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Removing single pathed devices sdb {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a795f0-68a3-45eb-8c89-d96f48d705c2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1299d3c1-40d9-4205-a69f-fb5922ef8115]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Flushing IO for device /dev/sdb {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7338a38-0e60-401e-87f0-2495b2063151]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3cc06d-8021-4024-8331-00e80882c87c]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7b84a9-d391-49d8-940a-2c412a185e32]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee5356e-0222-4608-9245-dc207df276b6]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b, portal: 172.16.0.220,3260]
Oct 20 09:11:56 user nova-compute[74039]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b, portal: 172.16.0.220,3260] successful.
Oct 20 09:11:56 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10273a49-4975-4375-a381-92c87521946b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[64491766-c08a-4544-94a4-a20acc268219]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] <== disconnect_volume: return (367ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:11:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:11:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:11:57 user nova-compute[74039]: DEBUG nova.objects.instance [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lazy-loading 'flavor' on Instance uuid a250449f-72d0-4b64-825b-d47e0dff471a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:11:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-5373accd-3078-44af-bef2-c2e37446b961 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "a250449f-72d0-4b64-825b-d47e0dff471a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.040s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:11:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:12:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Acquiring lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:12:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:12:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Acquiring lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:12:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:12:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:12:12 user nova-compute[74039]: INFO nova.compute.manager [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Terminating instance
Oct 20 09:12:12 user nova-compute[74039]: DEBUG nova.compute.manager [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-a86a384b-ca8a-410e-bae1-65a6bea411b4 req-640ec87a-b4a1-464e-bc7e-9df2959d44bb service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Received event network-vif-unplugged-0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a86a384b-ca8a-410e-bae1-65a6bea411b4 req-640ec87a-b4a1-464e-bc7e-9df2959d44bb service nova] Acquiring lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a86a384b-ca8a-410e-bae1-65a6bea411b4 req-640ec87a-b4a1-464e-bc7e-9df2959d44bb service nova] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a86a384b-ca8a-410e-bae1-65a6bea411b4 req-640ec87a-b4a1-464e-bc7e-9df2959d44bb service nova] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-a86a384b-ca8a-410e-bae1-65a6bea411b4 req-640ec87a-b4a1-464e-bc7e-9df2959d44bb service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] No waiting events found dispatching network-vif-unplugged-0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-a86a384b-ca8a-410e-bae1-65a6bea411b4 req-640ec87a-b4a1-464e-bc7e-9df2959d44bb service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Received event network-vif-unplugged-0f6af989-65a9-4d64-ade0-b547815b31af for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:12:13 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Instance destroyed successfully.
Oct 20 09:12:13 user nova-compute[74039]: DEBUG nova.objects.instance [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lazy-loading 'resources' on Instance uuid d7d1582f-4a3b-4d1b-9454-eb70debf8b07 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T09:07:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-708376907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1317353536',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2Qep7+ioVz4ToaltQb5B8e50cjc5EV3uc44CZSLG3G0pJ+dHSg4fhBqyGwCjA0p2uQ8QVyrcEdJbDBJuM2jMJFlpyM4SxXsL+MsZ1gKCrGcMvERPd26mEQnXws/T8dvA==',key_name='tempest-keypair-1840380994',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:10:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc13d04ae90a4fb8ac51e288fe5ab140',ramdisk_id='',reservation_id='r-3osji2pv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1308908868',owner_user_name='tempest-ServerActionsV293TestJSON-1308908868-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:10:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bddf822c42cf4c1397db396e176462ff',uuid=d7d1582f-4a3b-4d1b-9454-eb70debf8b07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f6af989-65a9-4d64-ade0-b547815b31af", "address": "fa:16:3e:72:58:d1", "network": {"id": "d25b876b-0740-492c-96d6-04dfdd2e722e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1105647057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc13d04ae90a4fb8ac51e288fe5ab140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6af989-65", "ovs_interfaceid": "0f6af989-65a9-4d64-ade0-b547815b31af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Converting VIF {"id": "0f6af989-65a9-4d64-ade0-b547815b31af", "address": "fa:16:3e:72:58:d1", "network": {"id": "d25b876b-0740-492c-96d6-04dfdd2e722e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1105647057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc13d04ae90a4fb8ac51e288fe5ab140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6af989-65", "ovs_interfaceid": "0f6af989-65a9-4d64-ade0-b547815b31af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:58:d1,bridge_name='br-int',has_traffic_filtering=True,id=0f6af989-65a9-4d64-ade0-b547815b31af,network=Network(d25b876b-0740-492c-96d6-04dfdd2e722e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6af989-65') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG os_vif [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:58:d1,bridge_name='br-int',has_traffic_filtering=True,id=0f6af989-65a9-4d64-ade0-b547815b31af,network=Network(d25b876b-0740-492c-96d6-04dfdd2e722e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6af989-65') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f6af989-65, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6c22704-40ac-4921-933a-9013e82a73b5) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:12:13 user nova-compute[74039]: INFO os_vif [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:58:d1,bridge_name='br-int',has_traffic_filtering=True,id=0f6af989-65a9-4d64-ade0-b547815b31af,network=Network(d25b876b-0740-492c-96d6-04dfdd2e722e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6af989-65')
Oct 20 09:12:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tmUrKhWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:12:13 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:12:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[219c8624-bfd9-4f34-94d1-b618ad9afb00]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:12:13 user nova-compute[74039]: No targets found.
Oct 20 09:12:13 user nova-compute[74039]: iSNS:
Oct 20 09:12:13 user nova-compute[74039]: No targets found.
Oct 20 09:12:13 user nova-compute[74039]: STATIC:
Oct 20 09:12:13 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14
Oct 20 09:12:13 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:12:13 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:12:13 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031
Oct 20 09:12:13 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:12:13 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:12:13 user nova-compute[74039]: FIRMWARE:
Oct 20 09:12:13 user nova-compute[74039]: No targets found.
Oct 20 09:12:13 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:12:13 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:12:13 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[779c9575-10e5-4768-933d-9a15d8da3f0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b604b3f-90de-4987-a6dd-472d6f15468a]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:12:13 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:12:13 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:12:13 user nova-compute[74039]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 (non-flash)
Oct 20 09:12:13 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae6c445fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031'): ({'sdd'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Removing single pathed devices sdd {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7113a9b2-261b-48be-a124-8c6ec6971dfd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[460914cf-9610-4010-ad0b-fcbc055dfb06]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Flushing IO for device /dev/sdd {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce606e4d-9a6b-4c45-bd2f-24443da16c74]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:12:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bd0267-2b7a-480f-ba2c-0c72739142a3]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4594a281-fe0f-444b-9272-4aaf23ce56be]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:12:14 user nova-compute[74039]: INFO nova.compute.manager [None req-42f39e9c-ba90-4b8f-82bc-72056ac0e121 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Unrescuing
Oct 20 09:12:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-42f39e9c-ba90-4b8f-82bc-72056ac0e121 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-42f39e9c-ba90-4b8f-82bc-72056ac0e121 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquired lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG nova.network.neutron [None req-42f39e9c-ba90-4b8f-82bc-72056ac0e121 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccb7f67-4e3c-4b95-9b95-9547f012e0ed]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031, portal: 172.16.0.220,3260]
Oct 20 09:12:14 user nova-compute[74039]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031, portal: 172.16.0.220,3260] successful.
Oct 20 09:12:14 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:058aa9e3-d0b9-4712-a8c2-90300ae1d031 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9198aa-28b4-4a3e-88bf-4b4f49997da6]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] <== disconnect_volume: return (368ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:12:14 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Deleting instance files /opt/stack/data/nova/instances/d7d1582f-4a3b-4d1b-9454-eb70debf8b07_del
Oct 20 09:12:14 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Deletion of /opt/stack/data/nova/instances/d7d1582f-4a3b-4d1b-9454-eb70debf8b07_del complete
Oct 20 09:12:14 user nova-compute[74039]: INFO nova.compute.manager [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Took 1.31 seconds to destroy the instance on the hypervisor.
Oct 20 09:12:14 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:12:14 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:12:15 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:12:15 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Took 0.88 seconds to deallocate network for instance.
Oct 20 09:12:15 user nova-compute[74039]: DEBUG nova.network.neutron [None req-42f39e9c-ba90-4b8f-82bc-72056ac0e121 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Updating instance_info_cache with network_info: [{"id": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "address": "fa:16:3e:63:49:5e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc0a1c-ee", "ovs_interfaceid": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:12:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-42f39e9c-ba90-4b8f-82bc-72056ac0e121 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Releasing lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:12:15 user nova-compute[74039]: DEBUG nova.objects.instance [None req-42f39e9c-ba90-4b8f-82bc-72056ac0e121 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'flavor' on Instance uuid 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:12:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:15 user nova-compute[74039]: DEBUG nova.compute.manager [req-a7caa36d-1ef5-4815-9642-4a0809309434 req-926830af-f80b-4470-81d8-205600c27ff6 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Received event network-vif-plugged-0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:12:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a7caa36d-1ef5-4815-9642-4a0809309434 req-926830af-f80b-4470-81d8-205600c27ff6 service nova] Acquiring lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:12:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a7caa36d-1ef5-4815-9642-4a0809309434 req-926830af-f80b-4470-81d8-205600c27ff6 service nova] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:12:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a7caa36d-1ef5-4815-9642-4a0809309434 req-926830af-f80b-4470-81d8-205600c27ff6 service nova] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:12:15 user nova-compute[74039]: DEBUG nova.compute.manager [req-a7caa36d-1ef5-4815-9642-4a0809309434 req-926830af-f80b-4470-81d8-205600c27ff6 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] No waiting events found dispatching network-vif-plugged-0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:12:15 user nova-compute[74039]: WARNING nova.compute.manager [req-a7caa36d-1ef5-4815-9642-4a0809309434 req-926830af-f80b-4470-81d8-205600c27ff6 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Received unexpected event network-vif-plugged-0f6af989-65a9-4d64-ade0-b547815b31af for instance with vm_state active and task_state deleting.
Oct 20 09:12:15 user nova-compute[74039]: DEBUG nova.compute.manager [req-a7caa36d-1ef5-4815-9642-4a0809309434 req-926830af-f80b-4470-81d8-205600c27ff6 service nova] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Received event network-vif-deleted-0f6af989-65a9-4d64-ade0-b547815b31af {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:12:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:15 user nova-compute[74039]: DEBUG nova.compute.manager [req-2860bdcb-b6ee-4017-a7d0-0fb18b3545e1 req-f514ef4c-7dcc-4292-b8d5-189b8f0a6e81 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received event network-vif-unplugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:12:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2860bdcb-b6ee-4017-a7d0-0fb18b3545e1 req-f514ef4c-7dcc-4292-b8d5-189b8f0a6e81 service nova] Acquiring lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:12:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2860bdcb-b6ee-4017-a7d0-0fb18b3545e1 req-f514ef4c-7dcc-4292-b8d5-189b8f0a6e81 service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:12:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2860bdcb-b6ee-4017-a7d0-0fb18b3545e1 req-f514ef4c-7dcc-4292-b8d5-189b8f0a6e81 service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:12:15 user nova-compute[74039]: DEBUG nova.compute.manager [req-2860bdcb-b6ee-4017-a7d0-0fb18b3545e1 req-f514ef4c-7dcc-4292-b8d5-189b8f0a6e81 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] No waiting events found dispatching network-vif-unplugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:12:15 user nova-compute[74039]: WARNING nova.compute.manager [req-2860bdcb-b6ee-4017-a7d0-0fb18b3545e1 req-f514ef4c-7dcc-4292-b8d5-189b8f0a6e81 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received unexpected event network-vif-unplugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 for instance with vm_state rescued and task_state unrescuing.
Oct 20 09:12:16 user nova-compute[74039]: INFO nova.compute.manager [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Took 0.94 seconds to detach 1 volumes for instance.
Oct 20 09:12:16 user nova-compute[74039]: DEBUG nova.compute.manager [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] [instance: d7d1582f-4a3b-4d1b-9454-eb70debf8b07] Deleting volume: 058aa9e3-d0b9-4712-a8c2-90300ae1d031 {{(pid=74039) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 09:12:16 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Instance destroyed successfully.
Oct 20 09:12:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:12:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:12:16 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:12:16 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:12:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:12:16 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Deleted allocations for instance d7d1582f-4a3b-4d1b-9454-eb70debf8b07
Oct 20 09:12:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-528d10ba-c619-4121-a9d7-29f1b89e92e0 tempest-ServerActionsV293TestJSON-1308908868 tempest-ServerActionsV293TestJSON-1308908868-project-member] Lock "d7d1582f-4a3b-4d1b-9454-eb70debf8b07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.729s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:12:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:17 user nova-compute[74039]: DEBUG nova.compute.manager [req-9fd1fa48-8eea-4abb-9225-15910e560026 req-fb69a9dc-a002-4e83-afbc-244d49d7ae9a service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received event network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:12:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9fd1fa48-8eea-4abb-9225-15910e560026 req-fb69a9dc-a002-4e83-afbc-244d49d7ae9a service nova] Acquiring lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:12:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9fd1fa48-8eea-4abb-9225-15910e560026 req-fb69a9dc-a002-4e83-afbc-244d49d7ae9a service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:12:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9fd1fa48-8eea-4abb-9225-15910e560026 req-fb69a9dc-a002-4e83-afbc-244d49d7ae9a service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:12:17 user nova-compute[74039]: DEBUG nova.compute.manager [req-9fd1fa48-8eea-4abb-9225-15910e560026 req-fb69a9dc-a002-4e83-afbc-244d49d7ae9a service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] No waiting events found dispatching network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:12:17 user nova-compute[74039]: WARNING nova.compute.manager [req-9fd1fa48-8eea-4abb-9225-15910e560026 req-fb69a9dc-a002-4e83-afbc-244d49d7ae9a service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received unexpected event network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 for instance with vm_state rescued and task_state unrescuing.
Oct 20 09:12:17 user nova-compute[74039]: DEBUG nova.compute.manager [req-9fd1fa48-8eea-4abb-9225-15910e560026 req-fb69a9dc-a002-4e83-afbc-244d49d7ae9a service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received event network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:12:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9fd1fa48-8eea-4abb-9225-15910e560026 req-fb69a9dc-a002-4e83-afbc-244d49d7ae9a service nova] Acquiring lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:12:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9fd1fa48-8eea-4abb-9225-15910e560026 req-fb69a9dc-a002-4e83-afbc-244d49d7ae9a service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:12:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9fd1fa48-8eea-4abb-9225-15910e560026 req-fb69a9dc-a002-4e83-afbc-244d49d7ae9a service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:12:17 user nova-compute[74039]: DEBUG nova.compute.manager [req-9fd1fa48-8eea-4abb-9225-15910e560026 req-fb69a9dc-a002-4e83-afbc-244d49d7ae9a service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] No waiting events found dispatching network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:12:17 user nova-compute[74039]: WARNING nova.compute.manager [req-9fd1fa48-8eea-4abb-9225-15910e560026 req-fb69a9dc-a002-4e83-afbc-244d49d7ae9a service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received unexpected event network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 for instance with vm_state rescued and task_state unrescuing.
Oct 20 09:12:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:19 user nova-compute[74039]: DEBUG nova.compute.manager [None req-42f39e9c-ba90-4b8f-82bc-72056ac0e121 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:12:19 user nova-compute[74039]: DEBUG nova.compute.manager [req-da653fdc-1a8c-4f62-9fb7-2ea5c58ee5ea req-cd7e6ff3-448a-4fb6-901a-07d849cb3a9f service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received event network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:12:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-da653fdc-1a8c-4f62-9fb7-2ea5c58ee5ea req-cd7e6ff3-448a-4fb6-901a-07d849cb3a9f service nova] Acquiring lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:12:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-da653fdc-1a8c-4f62-9fb7-2ea5c58ee5ea req-cd7e6ff3-448a-4fb6-901a-07d849cb3a9f service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:12:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-da653fdc-1a8c-4f62-9fb7-2ea5c58ee5ea req-cd7e6ff3-448a-4fb6-901a-07d849cb3a9f service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:12:19 user nova-compute[74039]: DEBUG nova.compute.manager [req-da653fdc-1a8c-4f62-9fb7-2ea5c58ee5ea req-cd7e6ff3-448a-4fb6-901a-07d849cb3a9f service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] No waiting events found dispatching network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:12:19 user nova-compute[74039]: WARNING nova.compute.manager [req-da653fdc-1a8c-4f62-9fb7-2ea5c58ee5ea req-cd7e6ff3-448a-4fb6-901a-07d849cb3a9f service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received unexpected event network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 for instance with vm_state active and task_state None.
Oct 20 09:12:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:12:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:12:25 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:12:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "a250449f-72d0-4b64-825b-d47e0dff471a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:12:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "a250449f-72d0-4b64-825b-d47e0dff471a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:12:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "a250449f-72d0-4b64-825b-d47e0dff471a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:12:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "a250449f-72d0-4b64-825b-d47e0dff471a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:12:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "a250449f-72d0-4b64-825b-d47e0dff471a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:12:25 user nova-compute[74039]: INFO nova.compute.manager [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Terminating instance
Oct 20 09:12:25 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:12:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-bd256aa8-7df1-4ae7-9000-c1d8162a04f6 req-d46bfcad-3673-46dc-b7c3-f561f242ffa9 service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Received event network-vif-unplugged-d20c0187-4d18-4dd3-8288-b59b1f841a71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bd256aa8-7df1-4ae7-9000-c1d8162a04f6 req-d46bfcad-3673-46dc-b7c3-f561f242ffa9 service nova] Acquiring lock "a250449f-72d0-4b64-825b-d47e0dff471a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bd256aa8-7df1-4ae7-9000-c1d8162a04f6 req-d46bfcad-3673-46dc-b7c3-f561f242ffa9 service nova] Lock "a250449f-72d0-4b64-825b-d47e0dff471a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bd256aa8-7df1-4ae7-9000-c1d8162a04f6 req-d46bfcad-3673-46dc-b7c3-f561f242ffa9 service nova] Lock "a250449f-72d0-4b64-825b-d47e0dff471a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-bd256aa8-7df1-4ae7-9000-c1d8162a04f6 req-d46bfcad-3673-46dc-b7c3-f561f242ffa9 service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] No waiting events found dispatching network-vif-unplugged-d20c0187-4d18-4dd3-8288-b59b1f841a71 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG nova.compute.manager [req-bd256aa8-7df1-4ae7-9000-c1d8162a04f6 req-d46bfcad-3673-46dc-b7c3-f561f242ffa9 service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Received event network-vif-unplugged-d20c0187-4d18-4dd3-8288-b59b1f841a71 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:12:26 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Instance destroyed successfully.
Oct 20 09:12:26 user nova-compute[74039]: DEBUG nova.objects.instance [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lazy-loading 'resources' on Instance uuid a250449f-72d0-4b64-825b-d47e0dff471a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:08:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1880434280',display_name='tempest-AttachVolumeNegativeTest-server-1880434280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1880434280',id=37,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvoutzbOI4PJvBd2S5Wt4TwXsa556j2Br7X7CFuGIvzSFK9NSVbi2ihiZ55sc0eJPx9qY6p841KLwTTTUVNj0qrlQ77W5a0YniA0ypNX3EDtNbn086l8URYFXdo8Bobvg==',key_name='tempest-keypair-618841242',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:08:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='143bda69e4714560b4b2286adaefb4c5',ramdisk_id='',reservation_id='r-vjoflt5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-639731200',owner_user_name='tempest-AttachVolumeNegativeTest-639731200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6faf5f2e03204805a06ac9f83b9a61bb',uuid=a250449f-72d0-4b64-825b-d47e0dff471a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "address": "fa:16:3e:35:39:59", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c0187-4d", "ovs_interfaceid": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converting VIF {"id": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "address": "fa:16:3e:35:39:59", "network": {"id": "c3440443-5f66-4c07-9c39-eb0bfc7644d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-288566011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "143bda69e4714560b4b2286adaefb4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20c0187-4d", "ovs_interfaceid": "d20c0187-4d18-4dd3-8288-b59b1f841a71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:39:59,bridge_name='br-int',has_traffic_filtering=True,id=d20c0187-4d18-4dd3-8288-b59b1f841a71,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c0187-4d') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG os_vif [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:39:59,bridge_name='br-int',has_traffic_filtering=True,id=d20c0187-4d18-4dd3-8288-b59b1f841a71,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c0187-4d') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd20c0187-4d, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c5e33c7-8746-4176-af05-24b4ab11b60f) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:26 user nova-compute[74039]: INFO os_vif [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:39:59,bridge_name='br-int',has_traffic_filtering=True,id=d20c0187-4d18-4dd3-8288-b59b1f841a71,network=Network(c3440443-5f66-4c07-9c39-eb0bfc7644d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20c0187-4d')
Oct 20 09:12:26 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Deleting instance files /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a_del
Oct 20 09:12:26 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Deletion of /opt/stack/data/nova/instances/a250449f-72d0-4b64-825b-d47e0dff471a_del complete
Oct 20 09:12:26 user nova-compute[74039]: INFO nova.compute.manager [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 20 09:12:26 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:12:26 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:12:27 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:12:27 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Took 0.88 seconds to deallocate network for instance.
Oct 20 09:12:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-cd332cd0-39c9-497b-934f-b02c7de81e2d req-0993e17d-0fa1-4409-8ff7-2a91173c4c5f service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Received event network-vif-deleted-d20c0187-4d18-4dd3-8288-b59b1f841a71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:12:27 user nova-compute[74039]: INFO nova.compute.manager [req-cd332cd0-39c9-497b-934f-b02c7de81e2d req-0993e17d-0fa1-4409-8ff7-2a91173c4c5f service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Neutron deleted interface d20c0187-4d18-4dd3-8288-b59b1f841a71; detaching it from the instance and deleting it from the info cache
Oct 20 09:12:27 user nova-compute[74039]: DEBUG nova.network.neutron [req-cd332cd0-39c9-497b-934f-b02c7de81e2d req-0993e17d-0fa1-4409-8ff7-2a91173c4c5f service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:12:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-cd332cd0-39c9-497b-934f-b02c7de81e2d req-0993e17d-0fa1-4409-8ff7-2a91173c4c5f service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Detach interface failed, port_id=d20c0187-4d18-4dd3-8288-b59b1f841a71, reason: Instance a250449f-72d0-4b64-825b-d47e0dff471a could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 09:12:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:12:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:12:27 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:12:27 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:12:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:12:28 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Deleted allocations for instance a250449f-72d0-4b64-825b-d47e0dff471a
Oct 20 09:12:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef1f9842-3300-4cd2-b2ff-3ed85ebf4f21 tempest-AttachVolumeNegativeTest-639731200 tempest-AttachVolumeNegativeTest-639731200-project-member] Lock "a250449f-72d0-4b64-825b-d47e0dff471a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.281s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:12:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-778b32a6-71f4-47e0-9a69-84ee4e7ab525 req-b6edb444-2d58-48fc-aaec-424e3afc3b88 service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Received event network-vif-plugged-d20c0187-4d18-4dd3-8288-b59b1f841a71 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:12:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-778b32a6-71f4-47e0-9a69-84ee4e7ab525 req-b6edb444-2d58-48fc-aaec-424e3afc3b88 service nova] Acquiring lock "a250449f-72d0-4b64-825b-d47e0dff471a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:12:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-778b32a6-71f4-47e0-9a69-84ee4e7ab525 req-b6edb444-2d58-48fc-aaec-424e3afc3b88 service nova] Lock "a250449f-72d0-4b64-825b-d47e0dff471a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:12:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-778b32a6-71f4-47e0-9a69-84ee4e7ab525 req-b6edb444-2d58-48fc-aaec-424e3afc3b88 service nova] Lock "a250449f-72d0-4b64-825b-d47e0dff471a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:12:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-778b32a6-71f4-47e0-9a69-84ee4e7ab525 req-b6edb444-2d58-48fc-aaec-424e3afc3b88 service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] No waiting events found dispatching network-vif-plugged-d20c0187-4d18-4dd3-8288-b59b1f841a71 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:12:28 user nova-compute[74039]: WARNING nova.compute.manager [req-778b32a6-71f4-47e0-9a69-84ee4e7ab525 req-b6edb444-2d58-48fc-aaec-424e3afc3b88 service nova] [instance: a250449f-72d0-4b64-825b-d47e0dff471a] Received unexpected event network-vif-plugged-d20c0187-4d18-4dd3-8288-b59b1f841a71 for instance with vm_state deleted and task_state None.
Oct 20 09:12:28 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:12:28 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:12:28 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Rebuilding the list of instances to heal {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 09:12:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:12:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:12:28 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:12:28 user nova-compute[74039]: DEBUG nova.objects.instance [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lazy-loading 'info_cache' on Instance uuid 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:12:29 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Updating instance_info_cache with network_info: [{"id": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "address": "fa:16:3e:d6:ab:b8", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e6bac4-ee", "ovs_interfaceid": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:12:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:12:29 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:12:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:12:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:30 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:12:30 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:12:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:31 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:12:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:34 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:12:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:42 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:12:42 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:12:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:12:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:12:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:12:42 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:12:42 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:12:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:12:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:12:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:12:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:12:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:12:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:12:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:12:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:12:43 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:12:43 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:12:43 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8550MB free_disk=25.401588439941406GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:12:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:12:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:12:44 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:12:44 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:12:44 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance a638e673-3249-4b12-9520-e3b49a4ac47a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:12:44 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:12:44 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:12:44 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:12:44 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:12:44 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:12:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:12:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:12:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:12:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:12:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:12:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:12:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:12:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:13:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:13:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:13:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:13:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Acquiring lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:13:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:13:16 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:13:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:13:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:13:16 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:13:16 user nova-compute[74039]: INFO nova.compute.claims [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Claim successful on node user
Oct 20 09:13:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:16 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:13:16 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:13:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:13:16 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:13:16 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:13:16 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:13:16 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:13:16 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG nova.policy [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b959b678b5fb44d08c0ef8f113004e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4517bc9ca141198f7fbc358756a880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:13:17 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Creating image(s)
Oct 20 09:13:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Acquiring lock "/opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "/opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "/opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.183s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.215s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk 1073741824" returned: 0 in 0.053s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG nova.compute.manager [req-56368c91-0718-4866-ae67-969e6edbd061 req-0c426aac-8c22-44f0-9625-6157ba4e4167 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Received event network-changed-32f68736-035f-4df9-8a0a-0714ef3b5e47 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG nova.compute.manager [req-56368c91-0718-4866-ae67-969e6edbd061 req-0c426aac-8c22-44f0-9625-6157ba4e4167 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Refreshing instance network info cache due to event network-changed-32f68736-035f-4df9-8a0a-0714ef3b5e47. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-56368c91-0718-4866-ae67-969e6edbd061 req-0c426aac-8c22-44f0-9625-6157ba4e4167 service nova] Acquiring lock "refresh_cache-a638e673-3249-4b12-9520-e3b49a4ac47a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-56368c91-0718-4866-ae67-969e6edbd061 req-0c426aac-8c22-44f0-9625-6157ba4e4167 service nova] Acquired lock "refresh_cache-a638e673-3249-4b12-9520-e3b49a4ac47a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG nova.network.neutron [req-56368c91-0718-4866-ae67-969e6edbd061 req-0c426aac-8c22-44f0-9625-6157ba4e4167 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Refreshing network info cache for port 32f68736-035f-4df9-8a0a-0714ef3b5e47 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.186s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:13:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Cannot resize image /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Ensure instance console log exists: /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Successfully created port: eb611398-f36f-449f-8a0f-d2028c761079 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG nova.network.neutron [req-56368c91-0718-4866-ae67-969e6edbd061 req-0c426aac-8c22-44f0-9625-6157ba4e4167 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Updated VIF entry in instance network info cache for port 32f68736-035f-4df9-8a0a-0714ef3b5e47. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG nova.network.neutron [req-56368c91-0718-4866-ae67-969e6edbd061 req-0c426aac-8c22-44f0-9625-6157ba4e4167 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Updating instance_info_cache with network_info: [{"id": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "address": "fa:16:3e:f0:8b:d7", "network": {"id": "a7f821bb-906e-4142-b4d8-4d8f43e07afd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2060795733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41bdcdfa65d545339549280d68c725c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f68736-03", "ovs_interfaceid": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-56368c91-0718-4866-ae67-969e6edbd061 req-0c426aac-8c22-44f0-9625-6157ba4e4167 service nova] Releasing lock "refresh_cache-a638e673-3249-4b12-9520-e3b49a4ac47a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "a638e673-3249-4b12-9520-e3b49a4ac47a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG nova.objects.instance [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lazy-loading 'flavor' on Instance uuid a638e673-3249-4b12-9520-e3b49a4ac47a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "a638e673-3249-4b12-9520-e3b49a4ac47a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:13:18 user nova-compute[74039]: INFO nova.compute.manager [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Attaching volume 6104eecf-1cbf-4c35-a788-65762ee5af56 to /dev/vdb
Oct 20 09:13:18 user nova-compute[74039]: DEBUG os_brick.utils [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5577d0-8181-4a11-9f44-243fa47e06fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Successfully updated port: eb611398-f36f-449f-8a0f-d2028c761079 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bb9993-4759-4f8f-bee1-fff01d2cc3e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Acquiring lock "refresh_cache-d109c52e-1d09-4ed1-9c63-97abcf37ff92" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Acquired lock "refresh_cache-d109c52e-1d09-4ed1-9c63-97abcf37ff92" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[91418587-2e54-4e3f-887a-92a55c70a064]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[005bd6ac-1edc-4daf-8682-0f7d29f4e8a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:13:18 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:13:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a3b372-062e-4aa5-a421-aab40f9dce0f]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG os_brick.utils [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Updating existing volume attachment record: 06d050bb-1dac-4a98-8bb1-6c252665a02f {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:13:18 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Updating instance_info_cache with network_info: [{"id": "eb611398-f36f-449f-8a0f-d2028c761079", "address": "fa:16:3e:a6:40:db", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb611398-f3", "ovs_interfaceid": "eb611398-f36f-449f-8a0f-d2028c761079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Releasing lock "refresh_cache-d109c52e-1d09-4ed1-9c63-97abcf37ff92" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Instance network_info: |[{"id": "eb611398-f36f-449f-8a0f-d2028c761079", "address": "fa:16:3e:a6:40:db", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb611398-f3", "ovs_interfaceid": "eb611398-f36f-449f-8a0f-d2028c761079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Start _get_guest_xml network_info=[{"id": "eb611398-f36f-449f-8a0f-d2028c761079", "address": "fa:16:3e:a6:40:db", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb611398-f3", "ovs_interfaceid": "eb611398-f36f-449f-8a0f-d2028c761079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:13:19 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:13:19 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-849691281',display_name='tempest-ServersNegativeTestJSON-server-849691281',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-849691281',id=39,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc4517bc9ca141198f7fbc358756a880',ramdisk_id='',reservation_id='r-3eaucgmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1549503071',owner_user_name='tempest-ServersNegativeTestJSON-1549503071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:13:17Z,user_data=None,user_id='b959b678b5fb44d08c0ef8f113004e91',uuid=d109c52e-1d09-4ed1-9c63-97abcf37ff92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb611398-f36f-449f-8a0f-d2028c761079", "address": "fa:16:3e:a6:40:db", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb611398-f3", "ovs_interfaceid": "eb611398-f36f-449f-8a0f-d2028c761079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Converting VIF {"id": "eb611398-f36f-449f-8a0f-d2028c761079", "address": "fa:16:3e:a6:40:db", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb611398-f3", "ovs_interfaceid": "eb611398-f36f-449f-8a0f-d2028c761079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:40:db,bridge_name='br-int',has_traffic_filtering=True,id=eb611398-f36f-449f-8a0f-d2028c761079,network=Network(55f22c53-eb29-43fd-9039-5f9d4b28eff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb611398-f3') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.objects.instance [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lazy-loading 'pci_devices' on Instance uuid d109c52e-1d09-4ed1-9c63-97abcf37ff92 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:13:19 user nova-compute[74039]:   <uuid>d109c52e-1d09-4ed1-9c63-97abcf37ff92</uuid>
Oct 20 09:13:19 user nova-compute[74039]:   <name>instance-00000027</name>
Oct 20 09:13:19 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:13:19 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:13:19 user nova-compute[74039]:   <metadata>
Oct 20 09:13:19 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:13:19 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:13:19 user nova-compute[74039]:       <nova:name>tempest-ServersNegativeTestJSON-server-849691281</nova:name>
Oct 20 09:13:19 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:13:19</nova:creationTime>
Oct 20 09:13:19 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:13:19 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:13:19 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:13:19 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:13:19 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:13:19 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:13:19 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:13:19 user nova-compute[74039]:       <nova:owner>
Oct 20 09:13:19 user nova-compute[74039]:         <nova:user uuid="b959b678b5fb44d08c0ef8f113004e91">tempest-ServersNegativeTestJSON-1549503071-project-member</nova:user>
Oct 20 09:13:19 user nova-compute[74039]:         <nova:project uuid="cc4517bc9ca141198f7fbc358756a880">tempest-ServersNegativeTestJSON-1549503071</nova:project>
Oct 20 09:13:19 user nova-compute[74039]:       </nova:owner>
Oct 20 09:13:19 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:13:19 user nova-compute[74039]:       <nova:ports>
Oct 20 09:13:19 user nova-compute[74039]:         <nova:port uuid="eb611398-f36f-449f-8a0f-d2028c761079">
Oct 20 09:13:19 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 09:13:19 user nova-compute[74039]:         </nova:port>
Oct 20 09:13:19 user nova-compute[74039]:       </nova:ports>
Oct 20 09:13:19 user nova-compute[74039]:     </nova:instance>
Oct 20 09:13:19 user nova-compute[74039]:   </metadata>
Oct 20 09:13:19 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:13:19 user nova-compute[74039]:     <system>
Oct 20 09:13:19 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:13:19 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:13:19 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:13:19 user nova-compute[74039]:       <entry name="serial">d109c52e-1d09-4ed1-9c63-97abcf37ff92</entry>
Oct 20 09:13:19 user nova-compute[74039]:       <entry name="uuid">d109c52e-1d09-4ed1-9c63-97abcf37ff92</entry>
Oct 20 09:13:19 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:13:19 user nova-compute[74039]:     </system>
Oct 20 09:13:19 user nova-compute[74039]:   </sysinfo>
Oct 20 09:13:19 user nova-compute[74039]:   <os>
Oct 20 09:13:19 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:13:19 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:13:19 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:13:19 user nova-compute[74039]:   </os>
Oct 20 09:13:19 user nova-compute[74039]:   <features>
Oct 20 09:13:19 user nova-compute[74039]:     <acpi/>
Oct 20 09:13:19 user nova-compute[74039]:     <apic/>
Oct 20 09:13:19 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:13:19 user nova-compute[74039]:   </features>
Oct 20 09:13:19 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:13:19 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:13:19 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:13:19 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:13:19 user nova-compute[74039]:   </clock>
Oct 20 09:13:19 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:13:19 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:13:19 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:13:19 user nova-compute[74039]:   </cpu>
Oct 20 09:13:19 user nova-compute[74039]:   <devices>
Oct 20 09:13:19 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:13:19 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:13:19 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk"/>
Oct 20 09:13:19 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:13:19 user nova-compute[74039]:     </disk>
Oct 20 09:13:19 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:13:19 user nova-compute[74039]:       <mac address="fa:16:3e:a6:40:db"/>
Oct 20 09:13:19 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:13:19 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:13:19 user nova-compute[74039]:       <target dev="tapeb611398-f3"/>
Oct 20 09:13:19 user nova-compute[74039]:     </interface>
Oct 20 09:13:19 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:13:19 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/console.log" append="off"/>
Oct 20 09:13:19 user nova-compute[74039]:     </serial>
Oct 20 09:13:19 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:13:19 user nova-compute[74039]:     <video>
Oct 20 09:13:19 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:13:19 user nova-compute[74039]:     </video>
Oct 20 09:13:19 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:13:19 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:13:19 user nova-compute[74039]:     </rng>
Oct 20 09:13:19 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:13:19 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:13:19 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:13:19 user nova-compute[74039]:     </memballoon>
Oct 20 09:13:19 user nova-compute[74039]:   </devices>
Oct 20 09:13:19 user nova-compute[74039]: </domain>
Oct 20 09:13:19 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-849691281',display_name='tempest-ServersNegativeTestJSON-server-849691281',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-849691281',id=39,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc4517bc9ca141198f7fbc358756a880',ramdisk_id='',reservation_id='r-3eaucgmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1549503071',owner_user_name='tempest-ServersNegativeTestJSON-1549503071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:13:17Z,user_data=None,user_id='b959b678b5fb44d08c0ef8f113004e91',uuid=d109c52e-1d09-4ed1-9c63-97abcf37ff92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb611398-f36f-449f-8a0f-d2028c761079", "address": "fa:16:3e:a6:40:db", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb611398-f3", "ovs_interfaceid": "eb611398-f36f-449f-8a0f-d2028c761079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Converting VIF {"id": "eb611398-f36f-449f-8a0f-d2028c761079", "address": "fa:16:3e:a6:40:db", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb611398-f3", "ovs_interfaceid": "eb611398-f36f-449f-8a0f-d2028c761079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:40:db,bridge_name='br-int',has_traffic_filtering=True,id=eb611398-f36f-449f-8a0f-d2028c761079,network=Network(55f22c53-eb29-43fd-9039-5f9d4b28eff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb611398-f3') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG os_vif [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:40:db,bridge_name='br-int',has_traffic_filtering=True,id=eb611398-f36f-449f-8a0f-d2028c761079,network=Network(55f22c53-eb29-43fd-9039-5f9d4b28eff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb611398-f3') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3a7cfa1-1de4-5797-80a8-a2a6e6d56eee', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb611398-f3, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb611398-f3, col_values=(('qos', UUID('c692ba1f-c926-425a-b1a5-bccf1be4eb7d')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb611398-f3, col_values=(('external_ids', {'iface-id': 'eb611398-f36f-449f-8a0f-d2028c761079', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:40:db', 'vm-uuid': 'd109c52e-1d09-4ed1-9c63-97abcf37ff92'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:19 user nova-compute[74039]: INFO os_vif [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:40:db,bridge_name='br-int',has_traffic_filtering=True,id=eb611398-f36f-449f-8a0f-d2028c761079,network=Network(55f22c53-eb29-43fd-9039-5f9d4b28eff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb611398-f3')
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] No VIF found with MAC fa:16:3e:a6:40:db, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.compute.manager [req-74438515-355c-4fe2-8ab8-d853d70c0a10 req-753d69c8-5fcd-4f35-adfd-258d710a1954 service nova] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Received event network-changed-eb611398-f36f-449f-8a0f-d2028c761079 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.compute.manager [req-74438515-355c-4fe2-8ab8-d853d70c0a10 req-753d69c8-5fcd-4f35-adfd-258d710a1954 service nova] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Refreshing instance network info cache due to event network-changed-eb611398-f36f-449f-8a0f-d2028c761079. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-74438515-355c-4fe2-8ab8-d853d70c0a10 req-753d69c8-5fcd-4f35-adfd-258d710a1954 service nova] Acquiring lock "refresh_cache-d109c52e-1d09-4ed1-9c63-97abcf37ff92" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-74438515-355c-4fe2-8ab8-d853d70c0a10 req-753d69c8-5fcd-4f35-adfd-258d710a1954 service nova] Acquired lock "refresh_cache-d109c52e-1d09-4ed1-9c63-97abcf37ff92" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:13:19 user nova-compute[74039]: DEBUG nova.network.neutron [req-74438515-355c-4fe2-8ab8-d853d70c0a10 req-753d69c8-5fcd-4f35-adfd-258d710a1954 service nova] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Refreshing network info cache for port eb611398-f36f-449f-8a0f-d2028c761079 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:13:20 user nova-compute[74039]: DEBUG nova.network.neutron [req-74438515-355c-4fe2-8ab8-d853d70c0a10 req-753d69c8-5fcd-4f35-adfd-258d710a1954 service nova] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Updated VIF entry in instance network info cache for port eb611398-f36f-449f-8a0f-d2028c761079. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:13:20 user nova-compute[74039]: DEBUG nova.network.neutron [req-74438515-355c-4fe2-8ab8-d853d70c0a10 req-753d69c8-5fcd-4f35-adfd-258d710a1954 service nova] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Updating instance_info_cache with network_info: [{"id": "eb611398-f36f-449f-8a0f-d2028c761079", "address": "fa:16:3e:a6:40:db", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb611398-f3", "ovs_interfaceid": "eb611398-f36f-449f-8a0f-d2028c761079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:13:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-74438515-355c-4fe2-8ab8-d853d70c0a10 req-753d69c8-5fcd-4f35-adfd-258d710a1954 service nova] Releasing lock "refresh_cache-d109c52e-1d09-4ed1-9c63-97abcf37ff92" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:13:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-8174f72f-17c0-42a5-8397-dc24dc0e928b req-24105276-b27d-44ad-9995-a135831e1db0 service nova] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Received event network-vif-plugged-eb611398-f36f-449f-8a0f-d2028c761079 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:13:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8174f72f-17c0-42a5-8397-dc24dc0e928b req-24105276-b27d-44ad-9995-a135831e1db0 service nova] Acquiring lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:13:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8174f72f-17c0-42a5-8397-dc24dc0e928b req-24105276-b27d-44ad-9995-a135831e1db0 service nova] Lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:13:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8174f72f-17c0-42a5-8397-dc24dc0e928b req-24105276-b27d-44ad-9995-a135831e1db0 service nova] Lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:13:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-8174f72f-17c0-42a5-8397-dc24dc0e928b req-24105276-b27d-44ad-9995-a135831e1db0 service nova] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] No waiting events found dispatching network-vif-plugged-eb611398-f36f-449f-8a0f-d2028c761079 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:13:21 user nova-compute[74039]: WARNING nova.compute.manager [req-8174f72f-17c0-42a5-8397-dc24dc0e928b req-24105276-b27d-44ad-9995-a135831e1db0 service nova] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Received unexpected event network-vif-plugged-eb611398-f36f-449f-8a0f-d2028c761079 for instance with vm_state building and task_state spawning.
Oct 20 09:13:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-8174f72f-17c0-42a5-8397-dc24dc0e928b req-24105276-b27d-44ad-9995-a135831e1db0 service nova] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Received event network-vif-plugged-eb611398-f36f-449f-8a0f-d2028c761079 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:13:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8174f72f-17c0-42a5-8397-dc24dc0e928b req-24105276-b27d-44ad-9995-a135831e1db0 service nova] Acquiring lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:13:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8174f72f-17c0-42a5-8397-dc24dc0e928b req-24105276-b27d-44ad-9995-a135831e1db0 service nova] Lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:13:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8174f72f-17c0-42a5-8397-dc24dc0e928b req-24105276-b27d-44ad-9995-a135831e1db0 service nova] Lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:13:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-8174f72f-17c0-42a5-8397-dc24dc0e928b req-24105276-b27d-44ad-9995-a135831e1db0 service nova] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] No waiting events found dispatching network-vif-plugged-eb611398-f36f-449f-8a0f-d2028c761079 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:13:21 user nova-compute[74039]: WARNING nova.compute.manager [req-8174f72f-17c0-42a5-8397-dc24dc0e928b req-24105276-b27d-44ad-9995-a135831e1db0 service nova] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Received unexpected event network-vif-plugged-eb611398-f36f-449f-8a0f-d2028c761079 for instance with vm_state building and task_state spawning.
Oct 20 09:13:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:13:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:13:23 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Instance spawned successfully.
Oct 20 09:13:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:13:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:13:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:13:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:13:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:13:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:13:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:13:23 user nova-compute[74039]: INFO nova.compute.manager [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Took 6.53 seconds to spawn the instance on the hypervisor.
Oct 20 09:13:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:13:23 user nova-compute[74039]: INFO nova.compute.manager [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Took 7.29 seconds to build instance.
Oct 20 09:13:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d95d6625-1429-4ac7-a508-84c48b4aa610 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.434s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:13:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:24 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:13:24 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:13:26 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:13:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:13:29 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:13:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:13:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:13:29 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:13:30 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Updating instance_info_cache with network_info: [{"id": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "address": "fa:16:3e:63:49:5e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc0a1c-ee", "ovs_interfaceid": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:13:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:13:30 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:13:30 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:13:31 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:13:31 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:13:32 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:13:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:36 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'czDpbAMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:13:38 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:13:38 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:13:38 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[274e8e8e-0bf1-4ade-bbc9-403142da34f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:13:38 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.041s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77b308c-824e-4533-99c4-99ad12499684]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56] added
Oct 20 09:13:38 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[582cde5e-a6ca-41e7-8386-2dfb478b889c]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a44f3ce-c98a-4d27-b10f-2c349c7af470]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v czDpbAMP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v czDpbAMP" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8aafd9b-9e8a-48b6-b916-9086a0204e91]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'czDpbAMP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a87c9b-bd79-4107-b1db-20e4867f86d8]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2f6a87-5bab-4105-9a08-ea302a4d81e9]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:13:38 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:13:38 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4b3302-54fc-4764-9561-243dd6b27f8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56, portal: 172.16.0.220,3260]
Oct 20 09:13:38 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56, portal: 172.16.0.220,3260] successful.
Oct 20 09:13:38 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebeea06-015a-4393-ba30-f476f7e8dd81]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a8e821-8c92-414e-a9a0-0c9e4cd7cc1c]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:13:38 user nova-compute[74039]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 (non-flash)
Oct 20 09:13:38 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:13:38 user nova-compute[74039]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 (non-flash)
Oct 20 09:13:38 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3546b2cf-c84a-45bf-a620-ef98f6f4f5ab]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:38 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:13:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:39 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:13:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'czDpbAMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:13:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:13:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26338333634353937', 'path': '/dev/sdb'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:13:39 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338333634353937', 'path': '/dev/sdb'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:13:39 user nova-compute[74039]: DEBUG nova.objects.instance [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lazy-loading 'flavor' on Instance uuid a638e673-3249-4b12-9520-e3b49a4ac47a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:13:39 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 09:13:39 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:13:39 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 09:13:39 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:13:39 user nova-compute[74039]:   <serial>6104eecf-1cbf-4c35-a788-65762ee5af56</serial>
Oct 20 09:13:39 user nova-compute[74039]: </disk>
Oct 20 09:13:39 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 09:13:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:13:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:13:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] No VIF found with MAC fa:16:3e:f0:8b:d7, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:13:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-9ce83654-ec5d-4be6-b036-99bd2b8bd8c8 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.937s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:13:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "a638e673-3249-4b12-9520-e3b49a4ac47a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:13:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:13:43 user nova-compute[74039]: DEBUG nova.objects.instance [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lazy-loading 'flavor' on Instance uuid a638e673-3249-4b12-9520-e3b49a4ac47a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:13:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "a638e673-3249-4b12-9520-e3b49a4ac47a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:13:44 user nova-compute[74039]: INFO nova.compute.manager [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Attaching volume bb2d082a-937d-4efc-b37c-5b7cec947d11 to /dev/vdc
Oct 20 09:13:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG os_brick.utils [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b3bf13-4ef0-4f63-9cae-2f252e3dfae1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b6e4a5-0d92-4750-bef4-707ad95fe55b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[483c2095-bcb5-4078-84f1-487d8863580d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd11a088-9fa2-4918-be66-a5fbd96d2e4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:13:44 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1489f7-73a8-4c17-93df-4ba5436d2ffb]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG os_brick.utils [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Updating existing volume attachment record: b644f8f9-62a4-432d-88f4-32ccf6ceb3a3 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:13:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:45 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:13:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:13:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:13:46 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:13:46 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:13:46 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:13:46 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8475MB free_disk=25.361770629882812GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:13:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:13:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:13:46 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:13:46 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:13:46 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance a638e673-3249-4b12-9520-e3b49a4ac47a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:13:46 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance d109c52e-1d09-4ed1-9c63-97abcf37ff92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:13:46 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:13:46 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:13:46 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:13:46 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:13:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:13:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:13:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:13:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKHzJygD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:14:02 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:14:02 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:14:02 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aad1408-48e6-4cfe-9c72-3219011205e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:14:02 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a506827-3e3f-4642-938c-031e7190fd45]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11] added
Oct 20 09:14:02 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[780774bb-14ee-4c7e-85cc-3f57f058ec1c]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0c96bd-f185-412b-a68f-18f3b424ba5a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TKHzJygD {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TKHzJygD" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaf89b7-48fd-4c08-bafb-6ae3ef107927]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TKHzJygD'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[99695318-bdcd-42f0-9ebf-9bab8658550c]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3137ddad-fd74-4fbc-92a4-2765eb2555c2]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:14:02 user nova-compute[74039]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 (non-flash)
Oct 20 09:14:02 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:14:02 user nova-compute[74039]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 (non-flash)
Oct 20 09:14:02 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de09665-852e-4616-95e8-d6cd46e25e9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11, portal: 172.16.0.220,3260]
Oct 20 09:14:02 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11, portal: 172.16.0.220,3260] successful.
Oct 20 09:14:02 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f94b186-7eb0-4a9b-87b5-53a60447933d]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf51ae8-1271-4ef8-8c67-5f8d0b7a3f3a]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:14:02 user nova-compute[74039]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 (non-flash)
Oct 20 09:14:02 user nova-compute[74039]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 (non-flash)
Oct 20 09:14:02 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:14:02 user nova-compute[74039]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 (non-flash)
Oct 20 09:14:02 user nova-compute[74039]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 (non-flash)
Oct 20 09:14:02 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[94330056-446b-4a74-bb19-34502d6b1596]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:02 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: None {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:14:03 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:14:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKHzJygD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:14:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:14:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23030656361623361', 'path': '/dev/sdd'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:14:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030656361623361', 'path': '/dev/sdd'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:14:03 user nova-compute[74039]: DEBUG nova.objects.instance [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lazy-loading 'flavor' on Instance uuid a638e673-3249-4b12-9520-e3b49a4ac47a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:14:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 09:14:03 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:14:03 user nova-compute[74039]:   <source dev="/dev/sdd"/>
Oct 20 09:14:03 user nova-compute[74039]:   <target dev="vdc" bus="virtio"/>
Oct 20 09:14:03 user nova-compute[74039]:   <serial>bb2d082a-937d-4efc-b37c-5b7cec947d11</serial>
Oct 20 09:14:03 user nova-compute[74039]: </disk>
Oct 20 09:14:03 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 09:14:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:14:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:14:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:14:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] No VIF found with MAC fa:16:3e:f0:8b:d7, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:14:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8a49ec42-96e5-4089-a7ca-08bc85dd280a tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.977s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:14:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:14:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:14:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:14:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:14:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:14:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "a638e673-3249-4b12-9520-e3b49a4ac47a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:14:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:14:05 user nova-compute[74039]: INFO nova.compute.manager [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Detaching volume bb2d082a-937d-4efc-b37c-5b7cec947d11
Oct 20 09:14:05 user nova-compute[74039]: INFO nova.virt.block_device [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Attempting to driver detach volume bb2d082a-937d-4efc-b37c-5b7cec947d11 from mountpoint /dev/vdc
Oct 20 09:14:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Attempting to detach device vdc from instance a638e673-3249-4b12-9520-e3b49a4ac47a from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 09:14:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:14:05 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:14:05 user nova-compute[74039]:   <source dev="/dev/sdd"/>
Oct 20 09:14:05 user nova-compute[74039]:   <target dev="vdc" bus="virtio"/>
Oct 20 09:14:05 user nova-compute[74039]:   <serial>bb2d082a-937d-4efc-b37c-5b7cec947d11</serial>
Oct 20 09:14:05 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 09:14:05 user nova-compute[74039]: </disk>
Oct 20 09:14:05 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:14:05 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Successfully detached device vdc from instance a638e673-3249-4b12-9520-e3b49a4ac47a from the persistent domain config.
Oct 20 09:14:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a638e673-3249-4b12-9520-e3b49a4ac47a from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 09:14:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:14:05 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:14:05 user nova-compute[74039]:   <source dev="/dev/sdd"/>
Oct 20 09:14:05 user nova-compute[74039]:   <target dev="vdc" bus="virtio"/>
Oct 20 09:14:05 user nova-compute[74039]:   <serial>bb2d082a-937d-4efc-b37c-5b7cec947d11</serial>
Oct 20 09:14:05 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 09:14:05 user nova-compute[74039]: </disk>
Oct 20 09:14:05 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:14:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a638e673-3249-4b12-9520-e3b49a4ac47a {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 09:14:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "bd1f0c3b-32f3-4954-b38d-b57e16259234" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:14:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:14:06 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:14:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:14:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:14:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:14:06 user nova-compute[74039]: INFO nova.compute.claims [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Claim successful on node user
Oct 20 09:14:07 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:14:07 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:14:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:14:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:14:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:14:07 user nova-compute[74039]: DEBUG nova.network.neutron [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:14:07 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:14:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:14:07 user nova-compute[74039]: DEBUG nova.policy [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e07a52b4e3b4a65b34f71fb2cca8de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ed96a82048434fb0d79a55838184e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:14:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:14:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:14:07 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Creating image(s)
Oct 20 09:14:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:14:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "/opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:14:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "/opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:14:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.189s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:14:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:14:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.192s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk 1073741824" returned: 0 in 0.052s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:14:07 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.188s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:08 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:14:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:08 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Cannot resize image /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:14:08 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:14:08 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Ensure instance console log exists: /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:14:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:14:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:14:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:14:08 user nova-compute[74039]: DEBUG nova.network.neutron [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Successfully created port: d9fed849-1f54-4316-8ba3-26c92e7f41cc {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:14:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:14:09 user nova-compute[74039]: DEBUG nova.network.neutron [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Successfully updated port: d9fed849-1f54-4316-8ba3-26c92e7f41cc {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:14:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "refresh_cache-bd1f0c3b-32f3-4954-b38d-b57e16259234" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:14:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquired lock "refresh_cache-bd1f0c3b-32f3-4954-b38d-b57e16259234" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:14:09 user nova-compute[74039]: DEBUG nova.network.neutron [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:14:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-2b9b90d2-9bcb-4061-bdd8-d7915709e503 req-d29e7c3f-4405-4470-afa6-427cb313016b service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Received event network-changed-d9fed849-1f54-4316-8ba3-26c92e7f41cc {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:14:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-2b9b90d2-9bcb-4061-bdd8-d7915709e503 req-d29e7c3f-4405-4470-afa6-427cb313016b service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Refreshing instance network info cache due to event network-changed-d9fed849-1f54-4316-8ba3-26c92e7f41cc. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:14:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2b9b90d2-9bcb-4061-bdd8-d7915709e503 req-d29e7c3f-4405-4470-afa6-427cb313016b service nova] Acquiring lock "refresh_cache-bd1f0c3b-32f3-4954-b38d-b57e16259234" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:14:09 user nova-compute[74039]: DEBUG nova.network.neutron [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:14:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.network.neutron [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Updating instance_info_cache with network_info: [{"id": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "address": "fa:16:3e:b2:6d:1e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fed849-1f", "ovs_interfaceid": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Releasing lock "refresh_cache-bd1f0c3b-32f3-4954-b38d-b57e16259234" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Instance network_info: |[{"id": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "address": "fa:16:3e:b2:6d:1e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fed849-1f", "ovs_interfaceid": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2b9b90d2-9bcb-4061-bdd8-d7915709e503 req-d29e7c3f-4405-4470-afa6-427cb313016b service nova] Acquired lock "refresh_cache-bd1f0c3b-32f3-4954-b38d-b57e16259234" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.network.neutron [req-2b9b90d2-9bcb-4061-bdd8-d7915709e503 req-d29e7c3f-4405-4470-afa6-427cb313016b service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Refreshing network info cache for port d9fed849-1f54-4316-8ba3-26c92e7f41cc {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Start _get_guest_xml network_info=[{"id": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "address": "fa:16:3e:b2:6d:1e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fed849-1f", "ovs_interfaceid": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:14:10 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:14:10 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1928279480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1928279480',id=40,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7ed96a82048434fb0d79a55838184e4',ramdisk_id='',reservation_id='r-1w2prayl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:14:07Z,user_data=None,user_id='1e07a52b4e3b4a65b34f71fb2cca8de3',uuid=bd1f0c3b-32f3-4954-b38d-b57e16259234,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "address": "fa:16:3e:b2:6d:1e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fed849-1f", "ovs_interfaceid": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converting VIF {"id": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "address": "fa:16:3e:b2:6d:1e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fed849-1f", "ovs_interfaceid": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6d:1e,bridge_name='br-int',has_traffic_filtering=True,id=d9fed849-1f54-4316-8ba3-26c92e7f41cc,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fed849-1f') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.objects.instance [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'pci_devices' on Instance uuid bd1f0c3b-32f3-4954-b38d-b57e16259234 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:14:10 user nova-compute[74039]:   <uuid>bd1f0c3b-32f3-4954-b38d-b57e16259234</uuid>
Oct 20 09:14:10 user nova-compute[74039]:   <name>instance-00000028</name>
Oct 20 09:14:10 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:14:10 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:14:10 user nova-compute[74039]:   <metadata>
Oct 20 09:14:10 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:14:10 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:14:10 user nova-compute[74039]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1928279480</nova:name>
Oct 20 09:14:10 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:14:10</nova:creationTime>
Oct 20 09:14:10 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:14:10 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:14:10 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:14:10 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:14:10 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:14:10 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:14:10 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:14:10 user nova-compute[74039]:       <nova:owner>
Oct 20 09:14:10 user nova-compute[74039]:         <nova:user uuid="1e07a52b4e3b4a65b34f71fb2cca8de3">tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member</nova:user>
Oct 20 09:14:10 user nova-compute[74039]:         <nova:project uuid="d7ed96a82048434fb0d79a55838184e4">tempest-ServerBootFromVolumeStableRescueTest-1728924155</nova:project>
Oct 20 09:14:10 user nova-compute[74039]:       </nova:owner>
Oct 20 09:14:10 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:14:10 user nova-compute[74039]:       <nova:ports>
Oct 20 09:14:10 user nova-compute[74039]:         <nova:port uuid="d9fed849-1f54-4316-8ba3-26c92e7f41cc">
Oct 20 09:14:10 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 09:14:10 user nova-compute[74039]:         </nova:port>
Oct 20 09:14:10 user nova-compute[74039]:       </nova:ports>
Oct 20 09:14:10 user nova-compute[74039]:     </nova:instance>
Oct 20 09:14:10 user nova-compute[74039]:   </metadata>
Oct 20 09:14:10 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:14:10 user nova-compute[74039]:     <system>
Oct 20 09:14:10 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:14:10 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:14:10 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:14:10 user nova-compute[74039]:       <entry name="serial">bd1f0c3b-32f3-4954-b38d-b57e16259234</entry>
Oct 20 09:14:10 user nova-compute[74039]:       <entry name="uuid">bd1f0c3b-32f3-4954-b38d-b57e16259234</entry>
Oct 20 09:14:10 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:14:10 user nova-compute[74039]:     </system>
Oct 20 09:14:10 user nova-compute[74039]:   </sysinfo>
Oct 20 09:14:10 user nova-compute[74039]:   <os>
Oct 20 09:14:10 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:14:10 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:14:10 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:14:10 user nova-compute[74039]:   </os>
Oct 20 09:14:10 user nova-compute[74039]:   <features>
Oct 20 09:14:10 user nova-compute[74039]:     <acpi/>
Oct 20 09:14:10 user nova-compute[74039]:     <apic/>
Oct 20 09:14:10 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:14:10 user nova-compute[74039]:   </features>
Oct 20 09:14:10 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:14:10 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:14:10 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:14:10 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:14:10 user nova-compute[74039]:   </clock>
Oct 20 09:14:10 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:14:10 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:14:10 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:14:10 user nova-compute[74039]:   </cpu>
Oct 20 09:14:10 user nova-compute[74039]:   <devices>
Oct 20 09:14:10 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:14:10 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:14:10 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk"/>
Oct 20 09:14:10 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:14:10 user nova-compute[74039]:     </disk>
Oct 20 09:14:10 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:14:10 user nova-compute[74039]:       <mac address="fa:16:3e:b2:6d:1e"/>
Oct 20 09:14:10 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:14:10 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:14:10 user nova-compute[74039]:       <target dev="tapd9fed849-1f"/>
Oct 20 09:14:10 user nova-compute[74039]:     </interface>
Oct 20 09:14:10 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:14:10 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/console.log" append="off"/>
Oct 20 09:14:10 user nova-compute[74039]:     </serial>
Oct 20 09:14:10 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:14:10 user nova-compute[74039]:     <video>
Oct 20 09:14:10 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:14:10 user nova-compute[74039]:     </video>
Oct 20 09:14:10 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:14:10 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:14:10 user nova-compute[74039]:     </rng>
Oct 20 09:14:10 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:14:10 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:14:10 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:14:10 user nova-compute[74039]:     </memballoon>
Oct 20 09:14:10 user nova-compute[74039]:   </devices>
Oct 20 09:14:10 user nova-compute[74039]: </domain>
Oct 20 09:14:10 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1928279480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1928279480',id=40,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7ed96a82048434fb0d79a55838184e4',ramdisk_id='',reservation_id='r-1w2prayl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:14:07Z,user_data=None,user_id='1e07a52b4e3b4a65b34f71fb2cca8de3',uuid=bd1f0c3b-32f3-4954-b38d-b57e16259234,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "address": "fa:16:3e:b2:6d:1e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fed849-1f", "ovs_interfaceid": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converting VIF {"id": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "address": "fa:16:3e:b2:6d:1e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fed849-1f", "ovs_interfaceid": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6d:1e,bridge_name='br-int',has_traffic_filtering=True,id=d9fed849-1f54-4316-8ba3-26c92e7f41cc,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fed849-1f') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG os_vif [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6d:1e,bridge_name='br-int',has_traffic_filtering=True,id=d9fed849-1f54-4316-8ba3-26c92e7f41cc,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fed849-1f') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '294c5005-9ed7-570c-9c2e-fcf6fe6ff2a7', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9fed849-1f, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9fed849-1f, col_values=(('qos', UUID('25168779-6d94-4b51-b271-fe0b8d8b2acf')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9fed849-1f, col_values=(('external_ids', {'iface-id': 'd9fed849-1f54-4316-8ba3-26c92e7f41cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:6d:1e', 'vm-uuid': 'bd1f0c3b-32f3-4954-b38d-b57e16259234'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:10 user nova-compute[74039]: INFO os_vif [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6d:1e,bridge_name='br-int',has_traffic_filtering=True,id=d9fed849-1f54-4316-8ba3-26c92e7f41cc,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fed849-1f')
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] No VIF found with MAC fa:16:3e:b2:6d:1e, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.network.neutron [req-2b9b90d2-9bcb-4061-bdd8-d7915709e503 req-d29e7c3f-4405-4470-afa6-427cb313016b service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Updated VIF entry in instance network info cache for port d9fed849-1f54-4316-8ba3-26c92e7f41cc. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG nova.network.neutron [req-2b9b90d2-9bcb-4061-bdd8-d7915709e503 req-d29e7c3f-4405-4470-afa6-427cb313016b service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Updating instance_info_cache with network_info: [{"id": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "address": "fa:16:3e:b2:6d:1e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fed849-1f", "ovs_interfaceid": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:14:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2b9b90d2-9bcb-4061-bdd8-d7915709e503 req-d29e7c3f-4405-4470-afa6-427cb313016b service nova] Releasing lock "refresh_cache-bd1f0c3b-32f3-4954-b38d-b57e16259234" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:14:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:12 user nova-compute[74039]: DEBUG nova.compute.manager [req-185da87d-f229-43ad-a291-0cbab04a27b3 req-c1a4c0e7-7b1e-4066-b33c-4db9cb53df6b service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Received event network-vif-plugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:14:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-185da87d-f229-43ad-a291-0cbab04a27b3 req-c1a4c0e7-7b1e-4066-b33c-4db9cb53df6b service nova] Acquiring lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:14:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-185da87d-f229-43ad-a291-0cbab04a27b3 req-c1a4c0e7-7b1e-4066-b33c-4db9cb53df6b service nova] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:14:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-185da87d-f229-43ad-a291-0cbab04a27b3 req-c1a4c0e7-7b1e-4066-b33c-4db9cb53df6b service nova] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:14:12 user nova-compute[74039]: DEBUG nova.compute.manager [req-185da87d-f229-43ad-a291-0cbab04a27b3 req-c1a4c0e7-7b1e-4066-b33c-4db9cb53df6b service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] No waiting events found dispatching network-vif-plugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:14:12 user nova-compute[74039]: WARNING nova.compute.manager [req-185da87d-f229-43ad-a291-0cbab04a27b3 req-c1a4c0e7-7b1e-4066-b33c-4db9cb53df6b service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Received unexpected event network-vif-plugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc for instance with vm_state building and task_state spawning.
Oct 20 09:14:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:13 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:14:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:14:14 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Instance spawned successfully.
Oct 20 09:14:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:14:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:14:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:14:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:14:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:14:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:14:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:14:14 user nova-compute[74039]: INFO nova.compute.manager [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Took 6.67 seconds to spawn the instance on the hypervisor.
Oct 20 09:14:14 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:14:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:14 user nova-compute[74039]: INFO nova.compute.manager [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Took 7.43 seconds to build instance.
Oct 20 09:14:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4696d3d6-72df-43a2-b44f-fabc76e00532 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.533s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:14:14 user nova-compute[74039]: DEBUG nova.compute.manager [req-5f3e63d0-bbb8-4524-9e12-4d0ddc82267f req-52b43ad7-35be-4464-8f8a-6025d1038c0f service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Received event network-vif-plugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:14:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5f3e63d0-bbb8-4524-9e12-4d0ddc82267f req-52b43ad7-35be-4464-8f8a-6025d1038c0f service nova] Acquiring lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:14:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5f3e63d0-bbb8-4524-9e12-4d0ddc82267f req-52b43ad7-35be-4464-8f8a-6025d1038c0f service nova] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:14:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5f3e63d0-bbb8-4524-9e12-4d0ddc82267f req-52b43ad7-35be-4464-8f8a-6025d1038c0f service nova] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:14:14 user nova-compute[74039]: DEBUG nova.compute.manager [req-5f3e63d0-bbb8-4524-9e12-4d0ddc82267f req-52b43ad7-35be-4464-8f8a-6025d1038c0f service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] No waiting events found dispatching network-vif-plugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:14:14 user nova-compute[74039]: WARNING nova.compute.manager [req-5f3e63d0-bbb8-4524-9e12-4d0ddc82267f req-52b43ad7-35be-4464-8f8a-6025d1038c0f service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Received unexpected event network-vif-plugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc for instance with vm_state active and task_state None.
Oct 20 09:14:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG nova.compute.manager [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:14:25 user nova-compute[74039]: INFO nova.compute.claims [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Claim successful on node user
Oct 20 09:14:25 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a638e673-3249-4b12-9520-e3b49a4ac47a is timed out.
Oct 20 09:14:25 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Successfully detached device vdc from instance a638e673-3249-4b12-9520-e3b49a4ac47a from the live domain config.
Oct 20 09:14:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKHzJygD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:14:25 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:14:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3d9081-9d1c-4bf7-abcc-c64c658fd7a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:14:25 user nova-compute[74039]: No targets found.
Oct 20 09:14:25 user nova-compute[74039]: iSNS:
Oct 20 09:14:25 user nova-compute[74039]: No targets found.
Oct 20 09:14:25 user nova-compute[74039]: STATIC:
Oct 20 09:14:25 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14
Oct 20 09:14:25 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:14:25 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:14:25 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11
Oct 20 09:14:25 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:14:25 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:14:25 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56
Oct 20 09:14:25 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:14:25 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:14:25 user nova-compute[74039]: FIRMWARE:
Oct 20 09:14:25 user nova-compute[74039]: No targets found.
Oct 20 09:14:25 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:14:25 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:14:25 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f92dc1f-bd65-4dc8-8a74-e6ed39e078af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7c0685-af9a-4371-bb62-dc52ce21150d]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:14:25 user nova-compute[74039]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 (non-flash)
Oct 20 09:14:25 user nova-compute[74039]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 (non-flash)
Oct 20 09:14:25 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:14:25 user nova-compute[74039]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 (non-flash)
Oct 20 09:14:25 user nova-compute[74039]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 (non-flash)
Oct 20 09:14:25 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae6c445360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11'): ({'sdd'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Removing single pathed devices sdd {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a8394b-6cbf-49b7-9fe8-c7163f58eb88]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8a361a-4a85-4086-a7dc-a92638f5e135]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Flushing IO for device /dev/sdd {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG nova.compute.manager [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef93ab1-2987-472c-8fd2-be8b389fc8b2]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[840c78da-69a8-4574-8592-ee57b5c71a9b]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG nova.compute.manager [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG nova.network.neutron [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a573c10-cafb-47ab-a4ad-1b6037005097]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:14:25 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG nova.compute.manager [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb93883-2df6-4c63-8735-f8c8131f8780]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11, portal: 172.16.0.220,3260]
Oct 20 09:14:25 user nova-compute[74039]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11, portal: 172.16.0.220,3260] successful.
Oct 20 09:14:25 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG nova.policy [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d7f85ab6fdc4c76be5d62d5b2a5962b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173c1e40b30c479292dd4f96e61bb72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb2d082a-937d-4efc-b37c-5b7cec947d11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dcb830-4d74-458f-bcd9-6c09515645df]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] <== disconnect_volume: return (344ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:14:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:14:26 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Creating image(s)
Oct 20 09:14:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "/opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "/opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "/opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.185s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.167s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk 1073741824" returned: 0 in 0.053s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.228s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG nova.network.neutron [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Successfully created port: d5bf552c-4108-4e8e-b919-e2fc9c22963e {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Cannot resize image /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Ensure instance console log exists: /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:14:26 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.network.neutron [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Successfully updated port: d5bf552c-4108-4e8e-b919-e2fc9c22963e {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "refresh_cache-69541e4b-dded-4e7c-9cfa-d93f8824179f" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquired lock "refresh_cache-69541e4b-dded-4e7c-9cfa-d93f8824179f" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.network.neutron [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-08ab4155-c3fd-4547-83ca-a651ed2f87cb req-b000f9cb-66bd-4633-ab99-af90f5203d2d service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Received event network-changed-d5bf552c-4108-4e8e-b919-e2fc9c22963e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-08ab4155-c3fd-4547-83ca-a651ed2f87cb req-b000f9cb-66bd-4633-ab99-af90f5203d2d service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Refreshing instance network info cache due to event network-changed-d5bf552c-4108-4e8e-b919-e2fc9c22963e. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-08ab4155-c3fd-4547-83ca-a651ed2f87cb req-b000f9cb-66bd-4633-ab99-af90f5203d2d service nova] Acquiring lock "refresh_cache-69541e4b-dded-4e7c-9cfa-d93f8824179f" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.network.neutron [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.network.neutron [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Updating instance_info_cache with network_info: [{"id": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "address": "fa:16:3e:53:1c:b8", "network": {"id": "4cdbb359-74da-4e4d-a725-6f0ce82cc435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1113356046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173c1e40b30c479292dd4f96e61bb72b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bf552c-41", "ovs_interfaceid": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Releasing lock "refresh_cache-69541e4b-dded-4e7c-9cfa-d93f8824179f" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.compute.manager [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Instance network_info: |[{"id": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "address": "fa:16:3e:53:1c:b8", "network": {"id": "4cdbb359-74da-4e4d-a725-6f0ce82cc435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1113356046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173c1e40b30c479292dd4f96e61bb72b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bf552c-41", "ovs_interfaceid": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-08ab4155-c3fd-4547-83ca-a651ed2f87cb req-b000f9cb-66bd-4633-ab99-af90f5203d2d service nova] Acquired lock "refresh_cache-69541e4b-dded-4e7c-9cfa-d93f8824179f" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.network.neutron [req-08ab4155-c3fd-4547-83ca-a651ed2f87cb req-b000f9cb-66bd-4633-ab99-af90f5203d2d service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Refreshing network info cache for port d5bf552c-4108-4e8e-b919-e2fc9c22963e {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Start _get_guest_xml network_info=[{"id": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "address": "fa:16:3e:53:1c:b8", "network": {"id": "4cdbb359-74da-4e4d-a725-6f0ce82cc435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1113356046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173c1e40b30c479292dd4f96e61bb72b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bf552c-41", "ovs_interfaceid": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:14:27 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:14:27 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1840740764',display_name='tempest-SnapshotDataIntegrityTests-server-1840740764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1840740764',id=41,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHwblTMABn6Dwi+fBbT7+8oEe8pKv+0+f6FrVgbdMaS0VoduxP/mybZyQDibWSOBKHUgpoGSQXATmsScB2zUvzsygfxb+A0mBZ8iCNszNsVVVFllokVzcTTsazQ6ypA+A==',key_name='tempest-keypair-1111917610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='173c1e40b30c479292dd4f96e61bb72b',ramdisk_id='',reservation_id='r-3dbpkdcx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1427567799',owner_user_name='tempest-SnapshotDataIntegrityTests-1427567799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:14:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d7f85ab6fdc4c76be5d62d5b2a5962b',uuid=69541e4b-dded-4e7c-9cfa-d93f8824179f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "address": "fa:16:3e:53:1c:b8", "network": {"id": "4cdbb359-74da-4e4d-a725-6f0ce82cc435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1113356046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173c1e40b30c479292dd4f96e61bb72b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bf552c-41", "ovs_interfaceid": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Converting VIF {"id": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "address": "fa:16:3e:53:1c:b8", "network": {"id": "4cdbb359-74da-4e4d-a725-6f0ce82cc435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1113356046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173c1e40b30c479292dd4f96e61bb72b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bf552c-41", "ovs_interfaceid": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:1c:b8,bridge_name='br-int',has_traffic_filtering=True,id=d5bf552c-4108-4e8e-b919-e2fc9c22963e,network=Network(4cdbb359-74da-4e4d-a725-6f0ce82cc435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5bf552c-41') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.objects.instance [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lazy-loading 'pci_devices' on Instance uuid 69541e4b-dded-4e7c-9cfa-d93f8824179f {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:14:27 user nova-compute[74039]:   <uuid>69541e4b-dded-4e7c-9cfa-d93f8824179f</uuid>
Oct 20 09:14:27 user nova-compute[74039]:   <name>instance-00000029</name>
Oct 20 09:14:27 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:14:27 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:14:27 user nova-compute[74039]:   <metadata>
Oct 20 09:14:27 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:14:27 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:14:27 user nova-compute[74039]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1840740764</nova:name>
Oct 20 09:14:27 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:14:27</nova:creationTime>
Oct 20 09:14:27 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:14:27 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:14:27 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:14:27 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:14:27 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:14:27 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:14:27 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:14:27 user nova-compute[74039]:       <nova:owner>
Oct 20 09:14:27 user nova-compute[74039]:         <nova:user uuid="5d7f85ab6fdc4c76be5d62d5b2a5962b">tempest-SnapshotDataIntegrityTests-1427567799-project-member</nova:user>
Oct 20 09:14:27 user nova-compute[74039]:         <nova:project uuid="173c1e40b30c479292dd4f96e61bb72b">tempest-SnapshotDataIntegrityTests-1427567799</nova:project>
Oct 20 09:14:27 user nova-compute[74039]:       </nova:owner>
Oct 20 09:14:27 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:14:27 user nova-compute[74039]:       <nova:ports>
Oct 20 09:14:27 user nova-compute[74039]:         <nova:port uuid="d5bf552c-4108-4e8e-b919-e2fc9c22963e">
Oct 20 09:14:27 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 09:14:27 user nova-compute[74039]:         </nova:port>
Oct 20 09:14:27 user nova-compute[74039]:       </nova:ports>
Oct 20 09:14:27 user nova-compute[74039]:     </nova:instance>
Oct 20 09:14:27 user nova-compute[74039]:   </metadata>
Oct 20 09:14:27 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:14:27 user nova-compute[74039]:     <system>
Oct 20 09:14:27 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:14:27 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:14:27 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:14:27 user nova-compute[74039]:       <entry name="serial">69541e4b-dded-4e7c-9cfa-d93f8824179f</entry>
Oct 20 09:14:27 user nova-compute[74039]:       <entry name="uuid">69541e4b-dded-4e7c-9cfa-d93f8824179f</entry>
Oct 20 09:14:27 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:14:27 user nova-compute[74039]:     </system>
Oct 20 09:14:27 user nova-compute[74039]:   </sysinfo>
Oct 20 09:14:27 user nova-compute[74039]:   <os>
Oct 20 09:14:27 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:14:27 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:14:27 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:14:27 user nova-compute[74039]:   </os>
Oct 20 09:14:27 user nova-compute[74039]:   <features>
Oct 20 09:14:27 user nova-compute[74039]:     <acpi/>
Oct 20 09:14:27 user nova-compute[74039]:     <apic/>
Oct 20 09:14:27 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:14:27 user nova-compute[74039]:   </features>
Oct 20 09:14:27 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:14:27 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:14:27 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:14:27 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:14:27 user nova-compute[74039]:   </clock>
Oct 20 09:14:27 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:14:27 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:14:27 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:14:27 user nova-compute[74039]:   </cpu>
Oct 20 09:14:27 user nova-compute[74039]:   <devices>
Oct 20 09:14:27 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:14:27 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:14:27 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk"/>
Oct 20 09:14:27 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:14:27 user nova-compute[74039]:     </disk>
Oct 20 09:14:27 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:14:27 user nova-compute[74039]:       <mac address="fa:16:3e:53:1c:b8"/>
Oct 20 09:14:27 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:14:27 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:14:27 user nova-compute[74039]:       <target dev="tapd5bf552c-41"/>
Oct 20 09:14:27 user nova-compute[74039]:     </interface>
Oct 20 09:14:27 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:14:27 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/console.log" append="off"/>
Oct 20 09:14:27 user nova-compute[74039]:     </serial>
Oct 20 09:14:27 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:14:27 user nova-compute[74039]:     <video>
Oct 20 09:14:27 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:14:27 user nova-compute[74039]:     </video>
Oct 20 09:14:27 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:14:27 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:14:27 user nova-compute[74039]:     </rng>
Oct 20 09:14:27 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:14:27 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:14:27 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:14:27 user nova-compute[74039]:     </memballoon>
Oct 20 09:14:27 user nova-compute[74039]:   </devices>
Oct 20 09:14:27 user nova-compute[74039]: </domain>
Oct 20 09:14:27 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1840740764',display_name='tempest-SnapshotDataIntegrityTests-server-1840740764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1840740764',id=41,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHwblTMABn6Dwi+fBbT7+8oEe8pKv+0+f6FrVgbdMaS0VoduxP/mybZyQDibWSOBKHUgpoGSQXATmsScB2zUvzsygfxb+A0mBZ8iCNszNsVVVFllokVzcTTsazQ6ypA+A==',key_name='tempest-keypair-1111917610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='173c1e40b30c479292dd4f96e61bb72b',ramdisk_id='',reservation_id='r-3dbpkdcx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1427567799',owner_user_name='tempest-SnapshotDataIntegrityTests-1427567799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:14:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d7f85ab6fdc4c76be5d62d5b2a5962b',uuid=69541e4b-dded-4e7c-9cfa-d93f8824179f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "address": "fa:16:3e:53:1c:b8", "network": {"id": "4cdbb359-74da-4e4d-a725-6f0ce82cc435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1113356046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173c1e40b30c479292dd4f96e61bb72b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bf552c-41", "ovs_interfaceid": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Converting VIF {"id": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "address": "fa:16:3e:53:1c:b8", "network": {"id": "4cdbb359-74da-4e4d-a725-6f0ce82cc435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1113356046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173c1e40b30c479292dd4f96e61bb72b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bf552c-41", "ovs_interfaceid": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:1c:b8,bridge_name='br-int',has_traffic_filtering=True,id=d5bf552c-4108-4e8e-b919-e2fc9c22963e,network=Network(4cdbb359-74da-4e4d-a725-6f0ce82cc435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5bf552c-41') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG os_vif [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:1c:b8,bridge_name='br-int',has_traffic_filtering=True,id=d5bf552c-4108-4e8e-b919-e2fc9c22963e,network=Network(4cdbb359-74da-4e4d-a725-6f0ce82cc435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5bf552c-41') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '129c4bd8-4d51-5cbe-ba63-f4159aa6c7f3', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5bf552c-41, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5bf552c-41, col_values=(('qos', UUID('7d9e7885-2d54-4066-bacf-5dcdd92839f4')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5bf552c-41, col_values=(('external_ids', {'iface-id': 'd5bf552c-4108-4e8e-b919-e2fc9c22963e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:1c:b8', 'vm-uuid': '69541e4b-dded-4e7c-9cfa-d93f8824179f'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:14:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:28 user nova-compute[74039]: INFO os_vif [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:1c:b8,bridge_name='br-int',has_traffic_filtering=True,id=d5bf552c-4108-4e8e-b919-e2fc9c22963e,network=Network(4cdbb359-74da-4e4d-a725-6f0ce82cc435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5bf552c-41')
Oct 20 09:14:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:14:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] No VIF found with MAC fa:16:3e:53:1c:b8, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:14:28 user nova-compute[74039]: DEBUG nova.network.neutron [req-08ab4155-c3fd-4547-83ca-a651ed2f87cb req-b000f9cb-66bd-4633-ab99-af90f5203d2d service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Updated VIF entry in instance network info cache for port d5bf552c-4108-4e8e-b919-e2fc9c22963e. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:14:28 user nova-compute[74039]: DEBUG nova.network.neutron [req-08ab4155-c3fd-4547-83ca-a651ed2f87cb req-b000f9cb-66bd-4633-ab99-af90f5203d2d service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Updating instance_info_cache with network_info: [{"id": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "address": "fa:16:3e:53:1c:b8", "network": {"id": "4cdbb359-74da-4e4d-a725-6f0ce82cc435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1113356046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173c1e40b30c479292dd4f96e61bb72b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bf552c-41", "ovs_interfaceid": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:14:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-08ab4155-c3fd-4547-83ca-a651ed2f87cb req-b000f9cb-66bd-4633-ab99-af90f5203d2d service nova] Releasing lock "refresh_cache-69541e4b-dded-4e7c-9cfa-d93f8824179f" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:14:28 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:14:29 user nova-compute[74039]: DEBUG nova.objects.instance [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lazy-loading 'flavor' on Instance uuid a638e673-3249-4b12-9520-e3b49a4ac47a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:14:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e0115aa5-180b-4f4b-9433-2f0e10cf4acf tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.187s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:14:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-7f280ba8-484c-4db9-b139-fdb6f4c33b57 req-b0e3d05c-e683-4633-a640-09cbe431bec6 service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Received event network-vif-plugged-d5bf552c-4108-4e8e-b919-e2fc9c22963e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:14:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7f280ba8-484c-4db9-b139-fdb6f4c33b57 req-b0e3d05c-e683-4633-a640-09cbe431bec6 service nova] Acquiring lock "69541e4b-dded-4e7c-9cfa-d93f8824179f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:14:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7f280ba8-484c-4db9-b139-fdb6f4c33b57 req-b0e3d05c-e683-4633-a640-09cbe431bec6 service nova] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:14:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7f280ba8-484c-4db9-b139-fdb6f4c33b57 req-b0e3d05c-e683-4633-a640-09cbe431bec6 service nova] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:14:29 user nova-compute[74039]: DEBUG nova.compute.manager [req-7f280ba8-484c-4db9-b139-fdb6f4c33b57 req-b0e3d05c-e683-4633-a640-09cbe431bec6 service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] No waiting events found dispatching network-vif-plugged-d5bf552c-4108-4e8e-b919-e2fc9c22963e {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:14:29 user nova-compute[74039]: WARNING nova.compute.manager [req-7f280ba8-484c-4db9-b139-fdb6f4c33b57 req-b0e3d05c-e683-4633-a640-09cbe431bec6 service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Received unexpected event network-vif-plugged-d5bf552c-4108-4e8e-b919-e2fc9c22963e for instance with vm_state building and task_state spawning.
Oct 20 09:14:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:14:29 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:14:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-a638e673-3249-4b12-9520-e3b49a4ac47a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:14:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-a638e673-3249-4b12-9520-e3b49a4ac47a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:14:29 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:14:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:30 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Updating instance_info_cache with network_info: [{"id": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "address": "fa:16:3e:f0:8b:d7", "network": {"id": "a7f821bb-906e-4142-b4d8-4d8f43e07afd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2060795733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41bdcdfa65d545339549280d68c725c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f68736-03", "ovs_interfaceid": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:14:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-a638e673-3249-4b12-9520-e3b49a4ac47a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:14:30 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:14:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:14:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:14:31 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Instance spawned successfully.
Oct 20 09:14:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:14:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:14:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:14:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:14:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:14:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:14:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:14:31 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:14:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-ebbc88cb-1c2f-4e36-9fae-07868adadca7 req-760391b3-69cd-403b-a899-6437662626ff service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Received event network-vif-plugged-d5bf552c-4108-4e8e-b919-e2fc9c22963e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:14:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ebbc88cb-1c2f-4e36-9fae-07868adadca7 req-760391b3-69cd-403b-a899-6437662626ff service nova] Acquiring lock "69541e4b-dded-4e7c-9cfa-d93f8824179f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:14:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ebbc88cb-1c2f-4e36-9fae-07868adadca7 req-760391b3-69cd-403b-a899-6437662626ff service nova] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:14:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ebbc88cb-1c2f-4e36-9fae-07868adadca7 req-760391b3-69cd-403b-a899-6437662626ff service nova] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:14:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-ebbc88cb-1c2f-4e36-9fae-07868adadca7 req-760391b3-69cd-403b-a899-6437662626ff service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] No waiting events found dispatching network-vif-plugged-d5bf552c-4108-4e8e-b919-e2fc9c22963e {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:14:31 user nova-compute[74039]: WARNING nova.compute.manager [req-ebbc88cb-1c2f-4e36-9fae-07868adadca7 req-760391b3-69cd-403b-a899-6437662626ff service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Received unexpected event network-vif-plugged-d5bf552c-4108-4e8e-b919-e2fc9c22963e for instance with vm_state building and task_state spawning.
Oct 20 09:14:31 user nova-compute[74039]: INFO nova.compute.manager [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Took 5.73 seconds to spawn the instance on the hypervisor.
Oct 20 09:14:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:14:31 user nova-compute[74039]: INFO nova.compute.manager [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Took 6.54 seconds to build instance.
Oct 20 09:14:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-26e5a1ea-93c8-4caa-bbff-dc791f86d105 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.648s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:14:32 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:14:32 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:14:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:33 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:14:33 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:14:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:38 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:14:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:40 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:14:40 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Cleaning up deleted instances {{(pid=74039) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 09:14:40 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] There are 0 instances to clean {{(pid=74039) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 09:14:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:44 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:14:44 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:14:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:14:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:14:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:14:44 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:14:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:45 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:14:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:14:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:14:46 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:14:47 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:14:47 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:14:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8157MB free_disk=25.317218780517578GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:14:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:14:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:14:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:14:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:14:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance a638e673-3249-4b12-9520-e3b49a4ac47a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:14:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance d109c52e-1d09-4ed1-9c63-97abcf37ff92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:14:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance bd1f0c3b-32f3-4954-b38d-b57e16259234 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:14:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 69541e4b-dded-4e7c-9cfa-d93f8824179f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:14:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:14:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:14:47 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:14:47 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:14:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:14:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:14:47 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:14:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:52 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:14:52 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74039) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 09:14:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "a638e673-3249-4b12-9520-e3b49a4ac47a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:14:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:14:55 user nova-compute[74039]: INFO nova.compute.manager [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Detaching volume 6104eecf-1cbf-4c35-a788-65762ee5af56
Oct 20 09:14:55 user nova-compute[74039]: INFO nova.virt.block_device [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Attempting to driver detach volume 6104eecf-1cbf-4c35-a788-65762ee5af56 from mountpoint /dev/vdb
Oct 20 09:14:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Attempting to detach device vdb from instance a638e673-3249-4b12-9520-e3b49a4ac47a from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 09:14:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:14:55 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:14:55 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 09:14:55 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:14:55 user nova-compute[74039]:   <serial>6104eecf-1cbf-4c35-a788-65762ee5af56</serial>
Oct 20 09:14:55 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:14:55 user nova-compute[74039]: </disk>
Oct 20 09:14:55 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:14:55 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Successfully detached device vdb from instance a638e673-3249-4b12-9520-e3b49a4ac47a from the persistent domain config.
Oct 20 09:14:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a638e673-3249-4b12-9520-e3b49a4ac47a from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 09:14:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:14:55 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:14:55 user nova-compute[74039]:   <source dev="/dev/sdb"/>
Oct 20 09:14:55 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:14:55 user nova-compute[74039]:   <serial>6104eecf-1cbf-4c35-a788-65762ee5af56</serial>
Oct 20 09:14:55 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:14:55 user nova-compute[74039]: </disk>
Oct 20 09:14:55 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:14:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a638e673-3249-4b12-9520-e3b49a4ac47a {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 09:14:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:14:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquiring lock "c75f37aa-657f-4076-b42b-b716ed608fac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "c75f37aa-657f-4076-b42b-b716ed608fac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG nova.compute.manager [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:15:00 user nova-compute[74039]: INFO nova.compute.claims [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Claim successful on node user
Oct 20 09:15:00 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG nova.compute.manager [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG nova.compute.manager [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG nova.network.neutron [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:15:00 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:15:00 user nova-compute[74039]: DEBUG nova.compute.manager [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG nova.policy [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80e383c8e1544ecebd906c182383eb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d6aa3596714916a466942e5e43ae2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:15:00 user nova-compute[74039]: INFO nova.virt.block_device [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Booting with volume aabc70a6-44d6-49c8-9503-04ea2a26ead2 at /dev/vda
Oct 20 09:15:00 user nova-compute[74039]: DEBUG os_brick.utils [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[014f5e55-ff85-4759-a246-ed5072b65932]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[71605f32-7ec5-44e3-8a5f-370ff95807fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5601a107-62c6-4cb9-82d9-939bc4569d41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a5d88d-cb57-4152-b9eb-23b84ed35acb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:15:00 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:15:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a11d3c-5e80-4394-b470-3cf5e360ba7c]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG os_brick.utils [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:15:00 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Updating existing volume attachment record: 9719ce49-2011-4c0b-8dba-b9af7338f620 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:15:01 user nova-compute[74039]: DEBUG nova.network.neutron [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Successfully created port: c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:15:02 user nova-compute[74039]: DEBUG nova.network.neutron [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Successfully updated port: c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:15:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquiring lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:15:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquired lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:15:02 user nova-compute[74039]: DEBUG nova.network.neutron [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:15:02 user nova-compute[74039]: DEBUG nova.network.neutron [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:15:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-165e3784-3df2-4c1b-b8f9-8793dce8275d req-718e54c0-05c6-4d53-8cac-5016cb92e161 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received event network-changed-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:15:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-165e3784-3df2-4c1b-b8f9-8793dce8275d req-718e54c0-05c6-4d53-8cac-5016cb92e161 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Refreshing instance network info cache due to event network-changed-c1e04f2d-ef5c-4de2-831e-28d7339feba3. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:15:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-165e3784-3df2-4c1b-b8f9-8793dce8275d req-718e54c0-05c6-4d53-8cac-5016cb92e161 service nova] Acquiring lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:15:02 user nova-compute[74039]: DEBUG nova.network.neutron [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Updating instance_info_cache with network_info: [{"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:15:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Releasing lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:15:02 user nova-compute[74039]: DEBUG nova.compute.manager [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Instance network_info: |[{"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:15:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-165e3784-3df2-4c1b-b8f9-8793dce8275d req-718e54c0-05c6-4d53-8cac-5016cb92e161 service nova] Acquired lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:15:02 user nova-compute[74039]: DEBUG nova.network.neutron [req-165e3784-3df2-4c1b-b8f9-8793dce8275d req-718e54c0-05c6-4d53-8cac-5016cb92e161 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Refreshing network info cache for port c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:15:02 user nova-compute[74039]: DEBUG nova.network.neutron [req-165e3784-3df2-4c1b-b8f9-8793dce8275d req-718e54c0-05c6-4d53-8cac-5016cb92e161 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Updated VIF entry in instance network info cache for port c1e04f2d-ef5c-4de2-831e-28d7339feba3. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:15:02 user nova-compute[74039]: DEBUG nova.network.neutron [req-165e3784-3df2-4c1b-b8f9-8793dce8275d req-718e54c0-05c6-4d53-8cac-5016cb92e161 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Updating instance_info_cache with network_info: [{"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:15:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-165e3784-3df2-4c1b-b8f9-8793dce8275d req-718e54c0-05c6-4d53-8cac-5016cb92e161 service nova] Releasing lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:15:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Acquiring lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:15:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:07 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:15:07 user nova-compute[74039]: INFO nova.compute.claims [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Claim successful on node user
Oct 20 09:15:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG nova.network.neutron [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:15:08 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:15:08 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG nova.policy [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b959b678b5fb44d08c0ef8f113004e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4517bc9ca141198f7fbc358756a880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:15:08 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Creating image(s)
Oct 20 09:15:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "/opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "/opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.170s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa/disk 1073741824" returned: 0 in 0.055s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG nova.network.neutron [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Successfully created port: 9848dd1a-610a-44ee-8c8a-61045bbc79e2 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.171s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:15:08 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Cannot resize image /opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Ensure instance console log exists: /opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.network.neutron [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Successfully updated port: 9848dd1a-610a-44ee-8c8a-61045bbc79e2 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Acquiring lock "refresh_cache-6ae64a71-333f-45bb-bd5c-46e6ed544afa" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Acquired lock "refresh_cache-6ae64a71-333f-45bb-bd5c-46e6ed544afa" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.network.neutron [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-1f918406-e8e4-4f81-a3bb-8d60d37254fa req-7f4a6d69-1d5a-4a8a-8e1c-7935a00cb5ea service nova] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Received event network-changed-9848dd1a-610a-44ee-8c8a-61045bbc79e2 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-1f918406-e8e4-4f81-a3bb-8d60d37254fa req-7f4a6d69-1d5a-4a8a-8e1c-7935a00cb5ea service nova] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Refreshing instance network info cache due to event network-changed-9848dd1a-610a-44ee-8c8a-61045bbc79e2. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1f918406-e8e4-4f81-a3bb-8d60d37254fa req-7f4a6d69-1d5a-4a8a-8e1c-7935a00cb5ea service nova] Acquiring lock "refresh_cache-6ae64a71-333f-45bb-bd5c-46e6ed544afa" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.network.neutron [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.network.neutron [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Updating instance_info_cache with network_info: [{"id": "9848dd1a-610a-44ee-8c8a-61045bbc79e2", "address": "fa:16:3e:6e:db:a7", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9848dd1a-61", "ovs_interfaceid": "9848dd1a-610a-44ee-8c8a-61045bbc79e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Releasing lock "refresh_cache-6ae64a71-333f-45bb-bd5c-46e6ed544afa" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Instance network_info: |[{"id": "9848dd1a-610a-44ee-8c8a-61045bbc79e2", "address": "fa:16:3e:6e:db:a7", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9848dd1a-61", "ovs_interfaceid": "9848dd1a-610a-44ee-8c8a-61045bbc79e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1f918406-e8e4-4f81-a3bb-8d60d37254fa req-7f4a6d69-1d5a-4a8a-8e1c-7935a00cb5ea service nova] Acquired lock "refresh_cache-6ae64a71-333f-45bb-bd5c-46e6ed544afa" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.network.neutron [req-1f918406-e8e4-4f81-a3bb-8d60d37254fa req-7f4a6d69-1d5a-4a8a-8e1c-7935a00cb5ea service nova] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Refreshing network info cache for port 9848dd1a-610a-44ee-8c8a-61045bbc79e2 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Start _get_guest_xml network_info=[{"id": "9848dd1a-610a-44ee-8c8a-61045bbc79e2", "address": "fa:16:3e:6e:db:a7", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9848dd1a-61", "ovs_interfaceid": "9848dd1a-610a-44ee-8c8a-61045bbc79e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:15:09 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:15:09 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:15:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1436094920',display_name='tempest-ServersNegativeTestJSON-server-1436094920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1436094920',id=43,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc4517bc9ca141198f7fbc358756a880',ramdisk_id='',reservation_id='r-35tu5p8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1549503071',owner_user_name='tempest-ServersNegativeTestJSON-1549503071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:15:08Z,user_data=None,user_id='b959b678b5fb44d08c0ef8f113004e91',uuid=6ae64a71-333f-45bb-bd5c-46e6ed544afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9848dd1a-610a-44ee-8c8a-61045bbc79e2", "address": "fa:16:3e:6e:db:a7", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9848dd1a-61", "ovs_interfaceid": "9848dd1a-610a-44ee-8c8a-61045bbc79e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Converting VIF {"id": "9848dd1a-610a-44ee-8c8a-61045bbc79e2", "address": "fa:16:3e:6e:db:a7", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9848dd1a-61", "ovs_interfaceid": "9848dd1a-610a-44ee-8c8a-61045bbc79e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:db:a7,bridge_name='br-int',has_traffic_filtering=True,id=9848dd1a-610a-44ee-8c8a-61045bbc79e2,network=Network(55f22c53-eb29-43fd-9039-5f9d4b28eff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9848dd1a-61') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.objects.instance [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ae64a71-333f-45bb-bd5c-46e6ed544afa {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:15:09 user nova-compute[74039]:   <uuid>6ae64a71-333f-45bb-bd5c-46e6ed544afa</uuid>
Oct 20 09:15:09 user nova-compute[74039]:   <name>instance-0000002b</name>
Oct 20 09:15:09 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:15:09 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:15:09 user nova-compute[74039]:   <metadata>
Oct 20 09:15:09 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:15:09 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:15:09 user nova-compute[74039]:       <nova:name>tempest-ServersNegativeTestJSON-server-1436094920</nova:name>
Oct 20 09:15:09 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:15:09</nova:creationTime>
Oct 20 09:15:09 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:15:09 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:15:09 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:15:09 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:15:09 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:15:09 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:15:09 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:15:09 user nova-compute[74039]:       <nova:owner>
Oct 20 09:15:09 user nova-compute[74039]:         <nova:user uuid="b959b678b5fb44d08c0ef8f113004e91">tempest-ServersNegativeTestJSON-1549503071-project-member</nova:user>
Oct 20 09:15:09 user nova-compute[74039]:         <nova:project uuid="cc4517bc9ca141198f7fbc358756a880">tempest-ServersNegativeTestJSON-1549503071</nova:project>
Oct 20 09:15:09 user nova-compute[74039]:       </nova:owner>
Oct 20 09:15:09 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:15:09 user nova-compute[74039]:       <nova:ports>
Oct 20 09:15:09 user nova-compute[74039]:         <nova:port uuid="9848dd1a-610a-44ee-8c8a-61045bbc79e2">
Oct 20 09:15:09 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 09:15:09 user nova-compute[74039]:         </nova:port>
Oct 20 09:15:09 user nova-compute[74039]:       </nova:ports>
Oct 20 09:15:09 user nova-compute[74039]:     </nova:instance>
Oct 20 09:15:09 user nova-compute[74039]:   </metadata>
Oct 20 09:15:09 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:15:09 user nova-compute[74039]:     <system>
Oct 20 09:15:09 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:15:09 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:15:09 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:15:09 user nova-compute[74039]:       <entry name="serial">6ae64a71-333f-45bb-bd5c-46e6ed544afa</entry>
Oct 20 09:15:09 user nova-compute[74039]:       <entry name="uuid">6ae64a71-333f-45bb-bd5c-46e6ed544afa</entry>
Oct 20 09:15:09 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:15:09 user nova-compute[74039]:     </system>
Oct 20 09:15:09 user nova-compute[74039]:   </sysinfo>
Oct 20 09:15:09 user nova-compute[74039]:   <os>
Oct 20 09:15:09 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:15:09 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:15:09 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:15:09 user nova-compute[74039]:   </os>
Oct 20 09:15:09 user nova-compute[74039]:   <features>
Oct 20 09:15:09 user nova-compute[74039]:     <acpi/>
Oct 20 09:15:09 user nova-compute[74039]:     <apic/>
Oct 20 09:15:09 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:15:09 user nova-compute[74039]:   </features>
Oct 20 09:15:09 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:15:09 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:15:09 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:15:09 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:15:09 user nova-compute[74039]:   </clock>
Oct 20 09:15:09 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:15:09 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:15:09 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:15:09 user nova-compute[74039]:   </cpu>
Oct 20 09:15:09 user nova-compute[74039]:   <devices>
Oct 20 09:15:09 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:15:09 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:15:09 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa/disk"/>
Oct 20 09:15:09 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:15:09 user nova-compute[74039]:     </disk>
Oct 20 09:15:09 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:15:09 user nova-compute[74039]:       <mac address="fa:16:3e:6e:db:a7"/>
Oct 20 09:15:09 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:15:09 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:15:09 user nova-compute[74039]:       <target dev="tap9848dd1a-61"/>
Oct 20 09:15:09 user nova-compute[74039]:     </interface>
Oct 20 09:15:09 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:15:09 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa/console.log" append="off"/>
Oct 20 09:15:09 user nova-compute[74039]:     </serial>
Oct 20 09:15:09 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:15:09 user nova-compute[74039]:     <video>
Oct 20 09:15:09 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:15:09 user nova-compute[74039]:     </video>
Oct 20 09:15:09 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:15:09 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:15:09 user nova-compute[74039]:     </rng>
Oct 20 09:15:09 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:15:09 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:15:09 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:15:09 user nova-compute[74039]:     </memballoon>
Oct 20 09:15:09 user nova-compute[74039]:   </devices>
Oct 20 09:15:09 user nova-compute[74039]: </domain>
Oct 20 09:15:09 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:15:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1436094920',display_name='tempest-ServersNegativeTestJSON-server-1436094920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1436094920',id=43,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc4517bc9ca141198f7fbc358756a880',ramdisk_id='',reservation_id='r-35tu5p8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1549503071',owner_user_name='tempest-ServersNegativeTestJSON-1549503071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:15:08Z,user_data=None,user_id='b959b678b5fb44d08c0ef8f113004e91',uuid=6ae64a71-333f-45bb-bd5c-46e6ed544afa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9848dd1a-610a-44ee-8c8a-61045bbc79e2", "address": "fa:16:3e:6e:db:a7", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9848dd1a-61", "ovs_interfaceid": "9848dd1a-610a-44ee-8c8a-61045bbc79e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Converting VIF {"id": "9848dd1a-610a-44ee-8c8a-61045bbc79e2", "address": "fa:16:3e:6e:db:a7", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9848dd1a-61", "ovs_interfaceid": "9848dd1a-610a-44ee-8c8a-61045bbc79e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:db:a7,bridge_name='br-int',has_traffic_filtering=True,id=9848dd1a-610a-44ee-8c8a-61045bbc79e2,network=Network(55f22c53-eb29-43fd-9039-5f9d4b28eff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9848dd1a-61') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG os_vif [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:db:a7,bridge_name='br-int',has_traffic_filtering=True,id=9848dd1a-610a-44ee-8c8a-61045bbc79e2,network=Network(55f22c53-eb29-43fd-9039-5f9d4b28eff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9848dd1a-61') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '922e7184-3976-519b-9c53-2ae6da1a581e', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9848dd1a-61, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9848dd1a-61, col_values=(('qos', UUID('9eae4ab7-f294-4b14-8f99-00fd6ec49a8f')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9848dd1a-61, col_values=(('external_ids', {'iface-id': '9848dd1a-610a-44ee-8c8a-61045bbc79e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:db:a7', 'vm-uuid': '6ae64a71-333f-45bb-bd5c-46e6ed544afa'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:09 user nova-compute[74039]: INFO os_vif [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:db:a7,bridge_name='br-int',has_traffic_filtering=True,id=9848dd1a-610a-44ee-8c8a-61045bbc79e2,network=Network(55f22c53-eb29-43fd-9039-5f9d4b28eff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9848dd1a-61')
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:15:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] No VIF found with MAC fa:16:3e:6e:db:a7, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:15:10 user nova-compute[74039]: DEBUG nova.network.neutron [req-1f918406-e8e4-4f81-a3bb-8d60d37254fa req-7f4a6d69-1d5a-4a8a-8e1c-7935a00cb5ea service nova] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Updated VIF entry in instance network info cache for port 9848dd1a-610a-44ee-8c8a-61045bbc79e2. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:15:10 user nova-compute[74039]: DEBUG nova.network.neutron [req-1f918406-e8e4-4f81-a3bb-8d60d37254fa req-7f4a6d69-1d5a-4a8a-8e1c-7935a00cb5ea service nova] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Updating instance_info_cache with network_info: [{"id": "9848dd1a-610a-44ee-8c8a-61045bbc79e2", "address": "fa:16:3e:6e:db:a7", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9848dd1a-61", "ovs_interfaceid": "9848dd1a-610a-44ee-8c8a-61045bbc79e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:15:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-1f918406-e8e4-4f81-a3bb-8d60d37254fa req-7f4a6d69-1d5a-4a8a-8e1c-7935a00cb5ea service nova] Releasing lock "refresh_cache-6ae64a71-333f-45bb-bd5c-46e6ed544afa" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:15:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-e3115064-90de-4dbd-8947-a23d20e1d8c6 req-a872ac72-6709-452d-a6e1-952e09405eff service nova] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Received event network-vif-plugged-9848dd1a-610a-44ee-8c8a-61045bbc79e2 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:15:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e3115064-90de-4dbd-8947-a23d20e1d8c6 req-a872ac72-6709-452d-a6e1-952e09405eff service nova] Acquiring lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e3115064-90de-4dbd-8947-a23d20e1d8c6 req-a872ac72-6709-452d-a6e1-952e09405eff service nova] Lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e3115064-90de-4dbd-8947-a23d20e1d8c6 req-a872ac72-6709-452d-a6e1-952e09405eff service nova] Lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-e3115064-90de-4dbd-8947-a23d20e1d8c6 req-a872ac72-6709-452d-a6e1-952e09405eff service nova] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] No waiting events found dispatching network-vif-plugged-9848dd1a-610a-44ee-8c8a-61045bbc79e2 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:15:11 user nova-compute[74039]: WARNING nova.compute.manager [req-e3115064-90de-4dbd-8947-a23d20e1d8c6 req-a872ac72-6709-452d-a6e1-952e09405eff service nova] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Received unexpected event network-vif-plugged-9848dd1a-610a-44ee-8c8a-61045bbc79e2 for instance with vm_state building and task_state spawning.
Oct 20 09:15:13 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:15:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:15:13 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Instance spawned successfully.
Oct 20 09:15:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:15:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:15:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:15:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:15:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:15:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:15:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:15:13 user nova-compute[74039]: INFO nova.compute.manager [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Took 5.14 seconds to spawn the instance on the hypervisor.
Oct 20 09:15:13 user nova-compute[74039]: DEBUG nova.compute.manager [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:15:13 user nova-compute[74039]: INFO nova.compute.manager [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Took 5.85 seconds to build instance.
Oct 20 09:15:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-4b7bf231-30d1-4398-bf21-85db204b5b86 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.965s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-34e43e80-d599-4f13-813d-73be5711e4bd req-399b6047-e0ea-4ffc-8757-01d25731cab6 service nova] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Received event network-vif-plugged-9848dd1a-610a-44ee-8c8a-61045bbc79e2 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:15:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-34e43e80-d599-4f13-813d-73be5711e4bd req-399b6047-e0ea-4ffc-8757-01d25731cab6 service nova] Acquiring lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-34e43e80-d599-4f13-813d-73be5711e4bd req-399b6047-e0ea-4ffc-8757-01d25731cab6 service nova] Lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:13 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-34e43e80-d599-4f13-813d-73be5711e4bd req-399b6047-e0ea-4ffc-8757-01d25731cab6 service nova] Lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:13 user nova-compute[74039]: DEBUG nova.compute.manager [req-34e43e80-d599-4f13-813d-73be5711e4bd req-399b6047-e0ea-4ffc-8757-01d25731cab6 service nova] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] No waiting events found dispatching network-vif-plugged-9848dd1a-610a-44ee-8c8a-61045bbc79e2 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:15:13 user nova-compute[74039]: WARNING nova.compute.manager [req-34e43e80-d599-4f13-813d-73be5711e4bd req-399b6047-e0ea-4ffc-8757-01d25731cab6 service nova] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Received unexpected event network-vif-plugged-9848dd1a-610a-44ee-8c8a-61045bbc79e2 for instance with vm_state active and task_state None.
Oct 20 09:15:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:16 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a638e673-3249-4b12-9520-e3b49a4ac47a is timed out.
Oct 20 09:15:16 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Successfully detached device vdb from instance a638e673-3249-4b12-9520-e3b49a4ac47a from the live domain config.
Oct 20 09:15:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'czDpbAMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:15:16 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:15:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c84078-65bf-49ce-b1f2-3f4109628190]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:15:16 user nova-compute[74039]: No targets found.
Oct 20 09:15:16 user nova-compute[74039]: iSNS:
Oct 20 09:15:16 user nova-compute[74039]: No targets found.
Oct 20 09:15:16 user nova-compute[74039]: STATIC:
Oct 20 09:15:16 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14
Oct 20 09:15:16 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:15:16 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:15:16 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56
Oct 20 09:15:16 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:15:16 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:15:16 user nova-compute[74039]: FIRMWARE:
Oct 20 09:15:16 user nova-compute[74039]: No targets found.
Oct 20 09:15:16 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:15:16 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:15:16 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[727e1fb3-5ba6-4e86-9af1-a33bda0e347b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e2ea1d-667c-4bea-b044-5d6d441d42a0]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:15:16 user nova-compute[74039]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 (non-flash)
Oct 20 09:15:16 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:15:16 user nova-compute[74039]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 (non-flash)
Oct 20 09:15:16 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae847b5e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56'): ({'sdb'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Removing single pathed devices sdb {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bcd112-b9d9-49c1-a0fa-85fc71bdbdde]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b96fef0-e66e-4093-a265-e2a3707fd4ba]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Flushing IO for device /dev/sdb {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[28472606-bede-4fcd-8047-5e124905ca0a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cbbc17-179f-40ef-a125-161fdb1c063f]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a27408-d4f5-432f-a919-21d6337e9c6e]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebf738d-dc68-426b-baec-fc2146cea650]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56, portal: 172.16.0.220,3260]
Oct 20 09:15:16 user nova-compute[74039]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56, portal: 172.16.0.220,3260] successful.
Oct 20 09:15:16 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6104eecf-1cbf-4c35-a788-65762ee5af56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[796d5ad3-eaf1-40f9-a7c9-9032eed5665a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] <== disconnect_volume: return (349ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:15:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:15:17 user nova-compute[74039]: DEBUG nova.objects.instance [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lazy-loading 'flavor' on Instance uuid a638e673-3249-4b12-9520-e3b49a4ac47a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:15:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a646e4-c059-4ece-b2d9-fbceca2b61e1 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.909s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.compute.manager [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:15:18 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Creating image(s)
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Did not create local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Ensure instance console log exists: /opt/stack/data/nova/instances/c75f37aa-657f-4076-b42b-b716ed608fac/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Start _get_guest_xml network_info=[{"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9719ce49-2011-4c0b-8dba-b9af7338f620', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfPWirVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c75f37aa-657f-4076-b42b-b716ed608fac', 'attached_at': '', 'detached_at': '', 'volume_id': 'aabc70a6-44d6-49c8-9503-04ea2a26ead2', 'serial': 'aabc70a6-44d6-49c8-9503-04ea2a26ead2'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:15:18 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:15:18 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfPWirVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:15:18 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:15:18 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:15:18 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ba15b0-4fe0-4cfe-8cb6-26a75132a11f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:15:18 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f6737c-43e3-46d3-83be-8abc48378d41]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2] added
Oct 20 09:15:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a8b8fc-97af-4c79-a657-09bd421c787e]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83b09fa-7239-4b7e-af40-f5294672f09a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MfPWirVa {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MfPWirVa" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[903c6995-7b27-403f-bcda-5f26e07d4605]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MfPWirVa'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e695d23-338f-44ba-bfa8-40c8f2c90aa4]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7356c1e-cfef-4548-ae1c-23dc81794ca8]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:15:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:15:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e10a2e-6368-4cfe-beac-1de27a57a8f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2, portal: 172.16.0.220,3260]
Oct 20 09:15:18 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2, portal: 172.16.0.220,3260] successful.
Oct 20 09:15:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb9f8d8-38bf-4a7b-a541-c8e234d07b07]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f895ff-fa72-4114-90c0-6c924562b1b9]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:15:18 user nova-compute[74039]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)
Oct 20 09:15:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:15:18 user nova-compute[74039]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)
Oct 20 09:15:18 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:18 user nova-compute[74039]: WARNING nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] While synchronizing instance power states, found 8 instances in the database and 7 instances on the hypervisor.
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid a638e673-3249-4b12-9520-e3b49a4ac47a {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid d109c52e-1d09-4ed1-9c63-97abcf37ff92 {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid bd1f0c3b-32f3-4954-b38d-b57e16259234 {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid 69541e4b-dded-4e7c-9cfa-d93f8824179f {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid c75f37aa-657f-4076-b42b-b716ed608fac {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid 6ae64a71-333f-45bb-bd5c-46e6ed544afa {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "a638e673-3249-4b12-9520-e3b49a4ac47a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "bd1f0c3b-32f3-4954-b38d-b57e16259234" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "c75f37aa-657f-4076-b42b-b716ed608fac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78fca6e-261b-4bf6-99e8-e386a392ca65]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfPWirVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23862666264636330', 'path': '/dev/sdb'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862666264636330', 'path': '/dev/sdb'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:14:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-614706847',display_name='tempest-TestShelveInstance-server-614706847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-614706847',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKP6fCWfjEUsn/M6cqzJEhygYrcpj6FXmn0D9ZhSrnVED0MGeydQ0/ihFZ6xTLs93YfmSBmg1jpySYLOPI+t2U57SJ3XAEA8NSHExjn6f/2QpPCFGG7Gxo677Op3gWA6cQ==',key_name='tempest-TestShelveInstance-1056844604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91d6aa3596714916a466942e5e43ae2e',ramdisk_id='',reservation_id='r-zp3vbwnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1029412800',owner_user_name='tempest-TestShelveInstance-1029412800-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:15:01Z,user_data=None,user_id='80e383c8e1544ecebd906c182383eb60',uuid=c75f37aa-657f-4076-b42b-b716ed608fac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Converting VIF {"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c8:18,bridge_name='br-int',has_traffic_filtering=True,id=c1e04f2d-ef5c-4de2-831e-28d7339feba3,network=Network(c6342f79-d0fd-46a8-86e4-013c32691c72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1e04f2d-ef') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG nova.objects.instance [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lazy-loading 'pci_devices' on Instance uuid c75f37aa-657f-4076-b42b-b716ed608fac {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:15:19 user nova-compute[74039]:   <uuid>c75f37aa-657f-4076-b42b-b716ed608fac</uuid>
Oct 20 09:15:19 user nova-compute[74039]:   <name>instance-0000002a</name>
Oct 20 09:15:19 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:15:19 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:15:19 user nova-compute[74039]:   <metadata>
Oct 20 09:15:19 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:15:19 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:15:19 user nova-compute[74039]:       <nova:name>tempest-TestShelveInstance-server-614706847</nova:name>
Oct 20 09:15:19 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:15:18</nova:creationTime>
Oct 20 09:15:19 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:15:19 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:15:19 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:15:19 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:15:19 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:15:19 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:15:19 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:15:19 user nova-compute[74039]:       <nova:owner>
Oct 20 09:15:19 user nova-compute[74039]:         <nova:user uuid="80e383c8e1544ecebd906c182383eb60">tempest-TestShelveInstance-1029412800-project-member</nova:user>
Oct 20 09:15:19 user nova-compute[74039]:         <nova:project uuid="91d6aa3596714916a466942e5e43ae2e">tempest-TestShelveInstance-1029412800</nova:project>
Oct 20 09:15:19 user nova-compute[74039]:       </nova:owner>
Oct 20 09:15:19 user nova-compute[74039]:       <nova:ports>
Oct 20 09:15:19 user nova-compute[74039]:         <nova:port uuid="c1e04f2d-ef5c-4de2-831e-28d7339feba3">
Oct 20 09:15:19 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 09:15:19 user nova-compute[74039]:         </nova:port>
Oct 20 09:15:19 user nova-compute[74039]:       </nova:ports>
Oct 20 09:15:19 user nova-compute[74039]:     </nova:instance>
Oct 20 09:15:19 user nova-compute[74039]:   </metadata>
Oct 20 09:15:19 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:15:19 user nova-compute[74039]:     <system>
Oct 20 09:15:19 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:15:19 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:15:19 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:15:19 user nova-compute[74039]:       <entry name="serial">c75f37aa-657f-4076-b42b-b716ed608fac</entry>
Oct 20 09:15:19 user nova-compute[74039]:       <entry name="uuid">c75f37aa-657f-4076-b42b-b716ed608fac</entry>
Oct 20 09:15:19 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:15:19 user nova-compute[74039]:     </system>
Oct 20 09:15:19 user nova-compute[74039]:   </sysinfo>
Oct 20 09:15:19 user nova-compute[74039]:   <os>
Oct 20 09:15:19 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:15:19 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:15:19 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:15:19 user nova-compute[74039]:   </os>
Oct 20 09:15:19 user nova-compute[74039]:   <features>
Oct 20 09:15:19 user nova-compute[74039]:     <acpi/>
Oct 20 09:15:19 user nova-compute[74039]:     <apic/>
Oct 20 09:15:19 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:15:19 user nova-compute[74039]:   </features>
Oct 20 09:15:19 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:15:19 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:15:19 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:15:19 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:15:19 user nova-compute[74039]:   </clock>
Oct 20 09:15:19 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:15:19 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:15:19 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:15:19 user nova-compute[74039]:   </cpu>
Oct 20 09:15:19 user nova-compute[74039]:   <devices>
Oct 20 09:15:19 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 09:15:19 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:15:19 user nova-compute[74039]:       <source dev="/dev/sdb"/>
Oct 20 09:15:19 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:15:19 user nova-compute[74039]:       <serial>aabc70a6-44d6-49c8-9503-04ea2a26ead2</serial>
Oct 20 09:15:19 user nova-compute[74039]:     </disk>
Oct 20 09:15:19 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:15:19 user nova-compute[74039]:       <mac address="fa:16:3e:e2:c8:18"/>
Oct 20 09:15:19 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:15:19 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:15:19 user nova-compute[74039]:       <target dev="tapc1e04f2d-ef"/>
Oct 20 09:15:19 user nova-compute[74039]:     </interface>
Oct 20 09:15:19 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:15:19 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/c75f37aa-657f-4076-b42b-b716ed608fac/console.log" append="off"/>
Oct 20 09:15:19 user nova-compute[74039]:     </serial>
Oct 20 09:15:19 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:15:19 user nova-compute[74039]:     <video>
Oct 20 09:15:19 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:15:19 user nova-compute[74039]:     </video>
Oct 20 09:15:19 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:15:19 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:15:19 user nova-compute[74039]:     </rng>
Oct 20 09:15:19 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:15:19 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:15:19 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:15:19 user nova-compute[74039]:     </memballoon>
Oct 20 09:15:19 user nova-compute[74039]:   </devices>
Oct 20 09:15:19 user nova-compute[74039]: </domain>
Oct 20 09:15:19 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:14:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-614706847',display_name='tempest-TestShelveInstance-server-614706847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-614706847',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKP6fCWfjEUsn/M6cqzJEhygYrcpj6FXmn0D9ZhSrnVED0MGeydQ0/ihFZ6xTLs93YfmSBmg1jpySYLOPI+t2U57SJ3XAEA8NSHExjn6f/2QpPCFGG7Gxo677Op3gWA6cQ==',key_name='tempest-TestShelveInstance-1056844604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91d6aa3596714916a466942e5e43ae2e',ramdisk_id='',reservation_id='r-zp3vbwnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1029412800',owner_user_name='tempest-TestShelveInstance-1029412800-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:15:01Z,user_data=None,user_id='80e383c8e1544ecebd906c182383eb60',uuid=c75f37aa-657f-4076-b42b-b716ed608fac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Converting VIF {"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c8:18,bridge_name='br-int',has_traffic_filtering=True,id=c1e04f2d-ef5c-4de2-831e-28d7339feba3,network=Network(c6342f79-d0fd-46a8-86e4-013c32691c72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1e04f2d-ef') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG os_vif [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c8:18,bridge_name='br-int',has_traffic_filtering=True,id=c1e04f2d-ef5c-4de2-831e-28d7339feba3,network=Network(c6342f79-d0fd-46a8-86e4-013c32691c72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1e04f2d-ef') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '78576c1b-0bd0-5c5a-8458-1f40432d8565', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1e04f2d-ef, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1e04f2d-ef, col_values=(('qos', UUID('f30797f6-8ffd-42cf-af99-164f0bf925ca')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1e04f2d-ef, col_values=(('external_ids', {'iface-id': 'c1e04f2d-ef5c-4de2-831e-28d7339feba3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:c8:18', 'vm-uuid': 'c75f37aa-657f-4076-b42b-b716ed608fac'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:19 user nova-compute[74039]: INFO os_vif [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c8:18,bridge_name='br-int',has_traffic_filtering=True,id=c1e04f2d-ef5c-4de2-831e-28d7339feba3,network=Network(c6342f79-d0fd-46a8-86e4-013c32691c72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1e04f2d-ef')
Oct 20 09:15:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:15:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] No VIF found with MAC fa:16:3e:e2:c8:18, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:15:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-9824129a-b9a4-4c14-af3f-5e0adad4bcf2 req-347901c7-0dc7-4901-84dd-7f353e705bc2 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received event network-vif-plugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:15:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9824129a-b9a4-4c14-af3f-5e0adad4bcf2 req-347901c7-0dc7-4901-84dd-7f353e705bc2 service nova] Acquiring lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9824129a-b9a4-4c14-af3f-5e0adad4bcf2 req-347901c7-0dc7-4901-84dd-7f353e705bc2 service nova] Lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9824129a-b9a4-4c14-af3f-5e0adad4bcf2 req-347901c7-0dc7-4901-84dd-7f353e705bc2 service nova] Lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:21 user nova-compute[74039]: DEBUG nova.compute.manager [req-9824129a-b9a4-4c14-af3f-5e0adad4bcf2 req-347901c7-0dc7-4901-84dd-7f353e705bc2 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] No waiting events found dispatching network-vif-plugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:15:21 user nova-compute[74039]: WARNING nova.compute.manager [req-9824129a-b9a4-4c14-af3f-5e0adad4bcf2 req-347901c7-0dc7-4901-84dd-7f353e705bc2 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received unexpected event network-vif-plugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 for instance with vm_state building and task_state spawning.
Oct 20 09:15:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:15:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:15:23 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Instance spawned successfully.
Oct 20 09:15:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:15:23 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:15:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:15:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:15:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:15:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:15:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:15:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:15:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:15:23 user nova-compute[74039]: INFO nova.compute.manager [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Took 5.48 seconds to spawn the instance on the hypervisor.
Oct 20 09:15:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:15:23 user nova-compute[74039]: INFO nova.compute.manager [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Took 23.78 seconds to build instance.
Oct 20 09:15:24 user nova-compute[74039]: DEBUG nova.compute.manager [req-28076f35-2f44-468f-a361-00ade36dd60b req-e27fc8ad-ecf5-4179-9d82-f4b40c61c497 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received event network-vif-plugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:15:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-28076f35-2f44-468f-a361-00ade36dd60b req-e27fc8ad-ecf5-4179-9d82-f4b40c61c497 service nova] Acquiring lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-28076f35-2f44-468f-a361-00ade36dd60b req-e27fc8ad-ecf5-4179-9d82-f4b40c61c497 service nova] Lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-28076f35-2f44-468f-a361-00ade36dd60b req-e27fc8ad-ecf5-4179-9d82-f4b40c61c497 service nova] Lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:24 user nova-compute[74039]: DEBUG nova.compute.manager [req-28076f35-2f44-468f-a361-00ade36dd60b req-e27fc8ad-ecf5-4179-9d82-f4b40c61c497 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] No waiting events found dispatching network-vif-plugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:15:24 user nova-compute[74039]: WARNING nova.compute.manager [req-28076f35-2f44-468f-a361-00ade36dd60b req-e27fc8ad-ecf5-4179-9d82-f4b40c61c497 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received unexpected event network-vif-plugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 for instance with vm_state active and task_state None.
Oct 20 09:15:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-0199385c-2705-4f17-92fa-7b2f0db66688 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "c75f37aa-657f-4076-b42b-b716ed608fac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.932s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "c75f37aa-657f-4076-b42b-b716ed608fac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.271s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:24 user nova-compute[74039]: INFO nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 20 09:15:24 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "c75f37aa-657f-4076-b42b-b716ed608fac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:28 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:15:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:15:29 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:15:29 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Rebuilding the list of instances to heal {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 09:15:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:15:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:15:29 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:15:29 user nova-compute[74039]: DEBUG nova.objects.instance [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lazy-loading 'info_cache' on Instance uuid 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:15:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:30 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Updating instance_info_cache with network_info: [{"id": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "address": "fa:16:3e:d6:ab:b8", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e6bac4-ee", "ovs_interfaceid": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:15:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:15:30 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:15:32 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:15:33 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:15:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:34 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:15:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:35 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:15:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:40 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:15:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:44 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:15:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:44 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:15:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:45 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:15:45 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:15:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "a638e673-3249-4b12-9520-e3b49a4ac47a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "a638e673-3249-4b12-9520-e3b49a4ac47a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:45 user nova-compute[74039]: INFO nova.compute.manager [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Terminating instance
Oct 20 09:15:45 user nova-compute[74039]: DEBUG nova.compute.manager [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-a55f8cfb-ce80-4fcc-a950-1b46f6c3671d req-2b483c24-6b85-4d06-8455-d9115a297655 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Received event network-vif-unplugged-32f68736-035f-4df9-8a0a-0714ef3b5e47 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a55f8cfb-ce80-4fcc-a950-1b46f6c3671d req-2b483c24-6b85-4d06-8455-d9115a297655 service nova] Acquiring lock "a638e673-3249-4b12-9520-e3b49a4ac47a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a55f8cfb-ce80-4fcc-a950-1b46f6c3671d req-2b483c24-6b85-4d06-8455-d9115a297655 service nova] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a55f8cfb-ce80-4fcc-a950-1b46f6c3671d req-2b483c24-6b85-4d06-8455-d9115a297655 service nova] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-a55f8cfb-ce80-4fcc-a950-1b46f6c3671d req-2b483c24-6b85-4d06-8455-d9115a297655 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] No waiting events found dispatching network-vif-unplugged-32f68736-035f-4df9-8a0a-0714ef3b5e47 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-a55f8cfb-ce80-4fcc-a950-1b46f6c3671d req-2b483c24-6b85-4d06-8455-d9115a297655 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Received event network-vif-unplugged-32f68736-035f-4df9-8a0a-0714ef3b5e47 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:46 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Instance destroyed successfully.
Oct 20 09:15:46 user nova-compute[74039]: DEBUG nova.objects.instance [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lazy-loading 'resources' on Instance uuid a638e673-3249-4b12-9520-e3b49a4ac47a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1670759370',display_name='tempest-TestServerVolumeAttachmentScenario-server-1670759370',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1670759370',id=38,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA704ou196mLyDQXct0q31pQdZk9EjqsOgq4GBS1i7TOJ9zGtHfF5t+1cK5X/iweyC9faT5dtODHVHOpSv3ZQDmfAP7pqVLyEYdhlkjQM7AGywr63DSEzPcsikkfi0kZeQ==',key_name='tempest-keypair-1551606917',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:11:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41bdcdfa65d545339549280d68c725c2',ramdisk_id='',reservation_id='r-w2fhh888',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1075475771',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1075475771-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1ffed029a7d44bfaf17162b1385c667',uuid=a638e673-3249-4b12-9520-e3b49a4ac47a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "address": "fa:16:3e:f0:8b:d7", "network": {"id": "a7f821bb-906e-4142-b4d8-4d8f43e07afd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2060795733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41bdcdfa65d545339549280d68c725c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f68736-03", "ovs_interfaceid": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Converting VIF {"id": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "address": "fa:16:3e:f0:8b:d7", "network": {"id": "a7f821bb-906e-4142-b4d8-4d8f43e07afd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2060795733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41bdcdfa65d545339549280d68c725c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32f68736-03", "ovs_interfaceid": "32f68736-035f-4df9-8a0a-0714ef3b5e47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:8b:d7,bridge_name='br-int',has_traffic_filtering=True,id=32f68736-035f-4df9-8a0a-0714ef3b5e47,network=Network(a7f821bb-906e-4142-b4d8-4d8f43e07afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f68736-03') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG os_vif [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:8b:d7,bridge_name='br-int',has_traffic_filtering=True,id=32f68736-035f-4df9-8a0a-0714ef3b5e47,network=Network(a7f821bb-906e-4142-b4d8-4d8f43e07afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f68736-03') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32f68736-03, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71cb670c-96be-45ba-b5f9-e3951c9819ef) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:46 user nova-compute[74039]: INFO os_vif [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:8b:d7,bridge_name='br-int',has_traffic_filtering=True,id=32f68736-035f-4df9-8a0a-0714ef3b5e47,network=Network(a7f821bb-906e-4142-b4d8-4d8f43e07afd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32f68736-03')
Oct 20 09:15:46 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Deleting instance files /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a_del
Oct 20 09:15:46 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Deletion of /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a_del complete
Oct 20 09:15:46 user nova-compute[74039]: INFO nova.compute.manager [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 20 09:15:46 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:15:46 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:15:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json" returned: 1 in 0.210s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk --force-share --output=json' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:15:47 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000026, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/a638e673-3249-4b12-9520-e3b49a4ac47a/disk
Oct 20 09:15:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:47 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:15:47 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:15:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=7869MB free_disk=25.24994659423828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:15:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:47 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:15:47 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Took 0.86 seconds to deallocate network for instance.
Oct 20 09:15:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:15:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:15:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance a638e673-3249-4b12-9520-e3b49a4ac47a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:15:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance d109c52e-1d09-4ed1-9c63-97abcf37ff92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:15:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance bd1f0c3b-32f3-4954-b38d-b57e16259234 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:15:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 69541e4b-dded-4e7c-9cfa-d93f8824179f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:15:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c75f37aa-657f-4076-b42b-b716ed608fac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:15:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 6ae64a71-333f-45bb-bd5c-46e6ed544afa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:15:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:15:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:15:47 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing inventories for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 09:15:48 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Updating ProviderTree inventory for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 09:15:48 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Updating inventory in ProviderTree for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 09:15:48 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing aggregate associations for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb, aggregates: None {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 09:15:48 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing trait associations for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 09:15:48 user nova-compute[74039]: DEBUG nova.compute.manager [req-db0be63f-82bb-43c9-87d9-ddc09a1b0be7 req-c1535628-a7bc-4525-a29d-9d25075917d0 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Received event network-vif-plugged-32f68736-035f-4df9-8a0a-0714ef3b5e47 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:15:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-db0be63f-82bb-43c9-87d9-ddc09a1b0be7 req-c1535628-a7bc-4525-a29d-9d25075917d0 service nova] Acquiring lock "a638e673-3249-4b12-9520-e3b49a4ac47a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:15:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-db0be63f-82bb-43c9-87d9-ddc09a1b0be7 req-c1535628-a7bc-4525-a29d-9d25075917d0 service nova] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-db0be63f-82bb-43c9-87d9-ddc09a1b0be7 req-c1535628-a7bc-4525-a29d-9d25075917d0 service nova] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:48 user nova-compute[74039]: DEBUG nova.compute.manager [req-db0be63f-82bb-43c9-87d9-ddc09a1b0be7 req-c1535628-a7bc-4525-a29d-9d25075917d0 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] No waiting events found dispatching network-vif-plugged-32f68736-035f-4df9-8a0a-0714ef3b5e47 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:15:48 user nova-compute[74039]: WARNING nova.compute.manager [req-db0be63f-82bb-43c9-87d9-ddc09a1b0be7 req-c1535628-a7bc-4525-a29d-9d25075917d0 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Received unexpected event network-vif-plugged-32f68736-035f-4df9-8a0a-0714ef3b5e47 for instance with vm_state deleted and task_state None.
Oct 20 09:15:48 user nova-compute[74039]: DEBUG nova.compute.manager [req-db0be63f-82bb-43c9-87d9-ddc09a1b0be7 req-c1535628-a7bc-4525-a29d-9d25075917d0 service nova] [instance: a638e673-3249-4b12-9520-e3b49a4ac47a] Received event network-vif-deleted-32f68736-035f-4df9-8a0a-0714ef3b5e47 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:15:48 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:15:48 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:15:48 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:15:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.569s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.469s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:15:48 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:15:48 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:15:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:48 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Deleted allocations for instance a638e673-3249-4b12-9520-e3b49a4ac47a
Oct 20 09:15:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-defe5913-a59a-44b3-a5e7-848918373ba7 tempest-TestServerVolumeAttachmentScenario-1075475771 tempest-TestServerVolumeAttachmentScenario-1075475771-project-member] Lock "a638e673-3249-4b12-9520-e3b49a4ac47a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.820s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:15:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:15:57 user nova-compute[74039]: DEBUG nova.compute.manager [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:15:57 user nova-compute[74039]: INFO nova.compute.manager [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] instance snapshotting
Oct 20 09:15:57 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Beginning live snapshot process
Oct 20 09:15:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json -f qcow2 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json -f qcow2 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpogbyav8a/284ecb0101894576ba2a5873b9f2498d.delta 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:15:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpogbyav8a/284ecb0101894576ba2a5873b9f2498d.delta 1073741824" returned: 0 in 0.054s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:15:58 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 09:15:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 09:15:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74039) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 09:15:59 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 09:16:00 user nova-compute[74039]: DEBUG nova.privsep.utils [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74039) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 09:16:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpogbyav8a/284ecb0101894576ba2a5873b9f2498d.delta /opt/stack/data/nova/instances/snapshots/tmpogbyav8a/284ecb0101894576ba2a5873b9f2498d {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpogbyav8a/284ecb0101894576ba2a5873b9f2498d.delta /opt/stack/data/nova/instances/snapshots/tmpogbyav8a/284ecb0101894576ba2a5873b9f2498d" returned: 0 in 0.594s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:00 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Snapshot extracted, beginning image upload
Oct 20 09:16:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:16:02 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Snapshot image upload complete
Oct 20 09:16:02 user nova-compute[74039]: INFO nova.compute.manager [None req-77e5efc9-5fd4-4d67-8c11-2c47750b4d99 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Took 5.03 seconds to snapshot the instance on the hypervisor.
Oct 20 09:16:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:16:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:16:16 user nova-compute[74039]: DEBUG nova.compute.manager [req-8435cbde-bb1d-4c63-85f3-261ffc489c07 req-48cbba2d-9df6-4fae-8438-87dc49f9a8fb service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Received event network-changed-d5bf552c-4108-4e8e-b919-e2fc9c22963e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:16:16 user nova-compute[74039]: DEBUG nova.compute.manager [req-8435cbde-bb1d-4c63-85f3-261ffc489c07 req-48cbba2d-9df6-4fae-8438-87dc49f9a8fb service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Refreshing instance network info cache due to event network-changed-d5bf552c-4108-4e8e-b919-e2fc9c22963e. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:16:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8435cbde-bb1d-4c63-85f3-261ffc489c07 req-48cbba2d-9df6-4fae-8438-87dc49f9a8fb service nova] Acquiring lock "refresh_cache-69541e4b-dded-4e7c-9cfa-d93f8824179f" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:16:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8435cbde-bb1d-4c63-85f3-261ffc489c07 req-48cbba2d-9df6-4fae-8438-87dc49f9a8fb service nova] Acquired lock "refresh_cache-69541e4b-dded-4e7c-9cfa-d93f8824179f" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:16:16 user nova-compute[74039]: DEBUG nova.network.neutron [req-8435cbde-bb1d-4c63-85f3-261ffc489c07 req-48cbba2d-9df6-4fae-8438-87dc49f9a8fb service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Refreshing network info cache for port d5bf552c-4108-4e8e-b919-e2fc9c22963e {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:16:16 user nova-compute[74039]: DEBUG nova.network.neutron [req-8435cbde-bb1d-4c63-85f3-261ffc489c07 req-48cbba2d-9df6-4fae-8438-87dc49f9a8fb service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Updated VIF entry in instance network info cache for port d5bf552c-4108-4e8e-b919-e2fc9c22963e. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:16:16 user nova-compute[74039]: DEBUG nova.network.neutron [req-8435cbde-bb1d-4c63-85f3-261ffc489c07 req-48cbba2d-9df6-4fae-8438-87dc49f9a8fb service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Updating instance_info_cache with network_info: [{"id": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "address": "fa:16:3e:53:1c:b8", "network": {"id": "4cdbb359-74da-4e4d-a725-6f0ce82cc435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1113356046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173c1e40b30c479292dd4f96e61bb72b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bf552c-41", "ovs_interfaceid": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:16:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8435cbde-bb1d-4c63-85f3-261ffc489c07 req-48cbba2d-9df6-4fae-8438-87dc49f9a8fb service nova] Releasing lock "refresh_cache-69541e4b-dded-4e7c-9cfa-d93f8824179f" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:16:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG nova.objects.instance [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lazy-loading 'flavor' on Instance uuid 69541e4b-dded-4e7c-9cfa-d93f8824179f {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:16:22 user nova-compute[74039]: INFO nova.compute.manager [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Attaching volume 772604fa-94a0-4789-afa6-efb4e3e26970 to /dev/vdb
Oct 20 09:16:22 user nova-compute[74039]: DEBUG os_brick.utils [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3116e4ff-1b92-46c6-b618-b1fb7fc9084c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b50f1d-f84a-42cf-bd31-805a933731da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[814d3755-66db-4c0c-ab55-f596dc94a077]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e65cc4-cfe0-4432-9041-f1e6942ce544]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:16:22 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:16:22 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6443227c-14fd-4c6d-9bd9-7e5c647d6cd6]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG os_brick.utils [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:16:22 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Updating existing volume attachment record: 91d4efbc-e43d-4782-99ff-74cb17e9d90c {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:16:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:28 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:16:28 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:16:28 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:16:31 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:16:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:16:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:16:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:16:31 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:16:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:16:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:16:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:16:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:16:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:32 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Updating instance_info_cache with network_info: [{"id": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "address": "fa:16:3e:63:49:5e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc0a1c-ee", "ovs_interfaceid": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:16:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:16:32 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:16:32 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:16:33 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:16:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:35 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:16:36 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:16:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:41 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:16:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:16:44 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bvPkVidD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:16:46 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:16:46 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:16:46 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a4663d-7161-48c6-879b-a2c93b324d10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:16:46 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[016cb9bb-e8c1-4526-a28e-609759ddf27d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970] added
Oct 20 09:16:46 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c931836-1e08-4c84-b5e7-f4f6ed84f03b]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4f9306-1b88-4219-83bb-329d7940a0f5]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bvPkVidD {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bvPkVidD" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6561d07a-20e0-4fe8-b633-f8eb779e67cc]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bvPkVidD'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[667c93d9-5e08-4a0c-8a5a-79d4ef05bc9a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01b481b-28c5-4205-bf9e-d3c4bec65854]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:16:46 user nova-compute[74039]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)
Oct 20 09:16:46 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:16:46 user nova-compute[74039]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)
Oct 20 09:16:46 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87c8239-ed35-449e-bdb3-997c51747660]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970, portal: 172.16.0.220,3260]
Oct 20 09:16:46 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970, portal: 172.16.0.220,3260] successful.
Oct 20 09:16:46 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ad1e1b-c8d9-4008-83aa-abd58b078937]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8006219-47aa-4482-9729-03b19b3badd9]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:16:46 user nova-compute[74039]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)
Oct 20 09:16:46 user nova-compute[74039]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 (non-flash)
Oct 20 09:16:46 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:16:46 user nova-compute[74039]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)
Oct 20 09:16:46 user nova-compute[74039]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 (non-flash)
Oct 20 09:16:46 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:47 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5cced7-75ed-4e80-8128-573d8c30a777]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:47 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:16:47 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bvPkVidD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:16:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:16:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:16:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:16:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26436376361313334', 'path': '/dev/sdd'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:16:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436376361313334', 'path': '/dev/sdd'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:16:48 user nova-compute[74039]: DEBUG nova.objects.instance [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lazy-loading 'flavor' on Instance uuid 69541e4b-dded-4e7c-9cfa-d93f8824179f {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:16:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 09:16:48 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:16:48 user nova-compute[74039]:   <source dev="/dev/sdd"/>
Oct 20 09:16:48 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:16:48 user nova-compute[74039]:   <serial>772604fa-94a0-4789-afa6-efb4e3e26970</serial>
Oct 20 09:16:48 user nova-compute[74039]: </disk>
Oct 20 09:16:48 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 09:16:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:16:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:16:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] No VIF found with MAC fa:16:3e:53:1c:b8, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:16:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-85fdcde9-da04-4a35-bf3b-5210185d2320 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.423s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:16:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:49 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:16:49 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:16:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8256MB free_disk=25.227375030517578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:16:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:16:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:16:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:16:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:16:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance d109c52e-1d09-4ed1-9c63-97abcf37ff92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:16:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance bd1f0c3b-32f3-4954-b38d-b57e16259234 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:16:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 69541e4b-dded-4e7c-9cfa-d93f8824179f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:16:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c75f37aa-657f-4076-b42b-b716ed608fac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:16:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 6ae64a71-333f-45bb-bd5c-46e6ed544afa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:16:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:16:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:16:49 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:16:49 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:16:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:16:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:16:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:52 user nova-compute[74039]: DEBUG nova.compute.manager [req-ec596151-03b6-4885-9ceb-770cc64e0a2b req-6770e97f-1a82-4ffa-81a3-be4ee598687c service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received event network-changed-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:16:52 user nova-compute[74039]: DEBUG nova.compute.manager [req-ec596151-03b6-4885-9ceb-770cc64e0a2b req-6770e97f-1a82-4ffa-81a3-be4ee598687c service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Refreshing instance network info cache due to event network-changed-c1e04f2d-ef5c-4de2-831e-28d7339feba3. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:16:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ec596151-03b6-4885-9ceb-770cc64e0a2b req-6770e97f-1a82-4ffa-81a3-be4ee598687c service nova] Acquiring lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:16:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ec596151-03b6-4885-9ceb-770cc64e0a2b req-6770e97f-1a82-4ffa-81a3-be4ee598687c service nova] Acquired lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:16:52 user nova-compute[74039]: DEBUG nova.network.neutron [req-ec596151-03b6-4885-9ceb-770cc64e0a2b req-6770e97f-1a82-4ffa-81a3-be4ee598687c service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Refreshing network info cache for port c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:16:52 user nova-compute[74039]: DEBUG nova.network.neutron [req-ec596151-03b6-4885-9ceb-770cc64e0a2b req-6770e97f-1a82-4ffa-81a3-be4ee598687c service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Updated VIF entry in instance network info cache for port c1e04f2d-ef5c-4de2-831e-28d7339feba3. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:16:52 user nova-compute[74039]: DEBUG nova.network.neutron [req-ec596151-03b6-4885-9ceb-770cc64e0a2b req-6770e97f-1a82-4ffa-81a3-be4ee598687c service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Updating instance_info_cache with network_info: [{"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:16:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ec596151-03b6-4885-9ceb-770cc64e0a2b req-6770e97f-1a82-4ffa-81a3-be4ee598687c service nova] Releasing lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:16:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquiring lock "c75f37aa-657f-4076-b42b-b716ed608fac" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:16:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "c75f37aa-657f-4076-b42b-b716ed608fac" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:16:52 user nova-compute[74039]: INFO nova.compute.manager [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Shelve offloading
Oct 20 09:16:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:53 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Instance destroyed successfully.
Oct 20 09:16:53 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:16:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquiring lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:16:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquired lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:16:53 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:16:53 user nova-compute[74039]: DEBUG nova.network.neutron [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Updating instance_info_cache with network_info: [{"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:16:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Releasing lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-7a6fab22-1be7-4414-88b3-0270d5df295c req-d3945a59-8770-4c7e-96c0-340996a5c08c service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received event network-vif-unplugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7a6fab22-1be7-4414-88b3-0270d5df295c req-d3945a59-8770-4c7e-96c0-340996a5c08c service nova] Acquiring lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7a6fab22-1be7-4414-88b3-0270d5df295c req-d3945a59-8770-4c7e-96c0-340996a5c08c service nova] Lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7a6fab22-1be7-4414-88b3-0270d5df295c req-d3945a59-8770-4c7e-96c0-340996a5c08c service nova] Lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-7a6fab22-1be7-4414-88b3-0270d5df295c req-d3945a59-8770-4c7e-96c0-340996a5c08c service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] No waiting events found dispatching network-vif-unplugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:16:54 user nova-compute[74039]: WARNING nova.compute.manager [req-7a6fab22-1be7-4414-88b3-0270d5df295c req-d3945a59-8770-4c7e-96c0-340996a5c08c service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received unexpected event network-vif-unplugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 for instance with vm_state active and task_state shelving.
Oct 20 09:16:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-7a6fab22-1be7-4414-88b3-0270d5df295c req-d3945a59-8770-4c7e-96c0-340996a5c08c service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received event network-vif-plugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7a6fab22-1be7-4414-88b3-0270d5df295c req-d3945a59-8770-4c7e-96c0-340996a5c08c service nova] Acquiring lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7a6fab22-1be7-4414-88b3-0270d5df295c req-d3945a59-8770-4c7e-96c0-340996a5c08c service nova] Lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7a6fab22-1be7-4414-88b3-0270d5df295c req-d3945a59-8770-4c7e-96c0-340996a5c08c service nova] Lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-7a6fab22-1be7-4414-88b3-0270d5df295c req-d3945a59-8770-4c7e-96c0-340996a5c08c service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] No waiting events found dispatching network-vif-plugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:16:54 user nova-compute[74039]: WARNING nova.compute.manager [req-7a6fab22-1be7-4414-88b3-0270d5df295c req-d3945a59-8770-4c7e-96c0-340996a5c08c service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received unexpected event network-vif-plugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 for instance with vm_state active and task_state shelving.
Oct 20 09:16:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:54 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Instance destroyed successfully.
Oct 20 09:16:54 user nova-compute[74039]: DEBUG nova.objects.instance [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lazy-loading 'resources' on Instance uuid c75f37aa-657f-4076-b42b-b716ed608fac {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:14:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-614706847',display_name='tempest-TestShelveInstance-server-614706847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-614706847',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKP6fCWfjEUsn/M6cqzJEhygYrcpj6FXmn0D9ZhSrnVED0MGeydQ0/ihFZ6xTLs93YfmSBmg1jpySYLOPI+t2U57SJ3XAEA8NSHExjn6f/2QpPCFGG7Gxo677Op3gWA6cQ==',key_name='tempest-TestShelveInstance-1056844604',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:15:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91d6aa3596714916a466942e5e43ae2e',ramdisk_id='',reservation_id='r-zp3vbwnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1029412800',owner_user_name='tempest-TestShelveInstance-1029412800-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:15:24Z,user_data=None,user_id='80e383c8e1544ecebd906c182383eb60',uuid=c75f37aa-657f-4076-b42b-b716ed608fac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Converting VIF {"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c8:18,bridge_name='br-int',has_traffic_filtering=True,id=c1e04f2d-ef5c-4de2-831e-28d7339feba3,network=Network(c6342f79-d0fd-46a8-86e4-013c32691c72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1e04f2d-ef') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_vif [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c8:18,bridge_name='br-int',has_traffic_filtering=True,id=c1e04f2d-ef5c-4de2-831e-28d7339feba3,network=Network(c6342f79-d0fd-46a8-86e4-013c32691c72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1e04f2d-ef') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1e04f2d-ef, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f30797f6-8ffd-42cf-af99-164f0bf925ca) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:16:54 user nova-compute[74039]: INFO os_vif [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c8:18,bridge_name='br-int',has_traffic_filtering=True,id=c1e04f2d-ef5c-4de2-831e-28d7339feba3,network=Network(c6342f79-d0fd-46a8-86e4-013c32691c72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1e04f2d-ef')
Oct 20 09:16:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-76c6b726-2068-4467-bd66-60b0c6d14b5d req-5d963d3a-d81e-4919-93bc-cdcd5554aa8f service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received event network-changed-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-76c6b726-2068-4467-bd66-60b0c6d14b5d req-5d963d3a-d81e-4919-93bc-cdcd5554aa8f service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Refreshing instance network info cache due to event network-changed-c1e04f2d-ef5c-4de2-831e-28d7339feba3. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-76c6b726-2068-4467-bd66-60b0c6d14b5d req-5d963d3a-d81e-4919-93bc-cdcd5554aa8f service nova] Acquiring lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-76c6b726-2068-4467-bd66-60b0c6d14b5d req-5d963d3a-d81e-4919-93bc-cdcd5554aa8f service nova] Acquired lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG nova.network.neutron [req-76c6b726-2068-4467-bd66-60b0c6d14b5d req-5d963d3a-d81e-4919-93bc-cdcd5554aa8f service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Refreshing network info cache for port c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfPWirVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:16:54 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a9817e-3029-426d-95f2-e31d7c51864a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:16:54 user nova-compute[74039]: No targets found.
Oct 20 09:16:54 user nova-compute[74039]: iSNS:
Oct 20 09:16:54 user nova-compute[74039]: No targets found.
Oct 20 09:16:54 user nova-compute[74039]: STATIC:
Oct 20 09:16:54 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14
Oct 20 09:16:54 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:16:54 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:16:54 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970
Oct 20 09:16:54 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:16:54 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:16:54 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2
Oct 20 09:16:54 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:16:54 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:16:54 user nova-compute[74039]: FIRMWARE:
Oct 20 09:16:54 user nova-compute[74039]: No targets found.
Oct 20 09:16:54 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:16:54 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:16:54 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94beec5-06a1-40c9-8cce-40f8ce097ce8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf10f41c-c81f-4d90-b788-e90741effa92]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:16:54 user nova-compute[74039]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)
Oct 20 09:16:54 user nova-compute[74039]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 (non-flash)
Oct 20 09:16:54 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:16:54 user nova-compute[74039]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)
Oct 20 09:16:54 user nova-compute[74039]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 (non-flash)
Oct 20 09:16:54 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae6c4c0a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2'): ({'sdb'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Removing single pathed devices sdb {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[444321c2-61e6-4e63-97e3-e07093d8eaf3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0e5d6a-0cff-4e8d-a2a5-90558c185c56]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Flushing IO for device /dev/sdb {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d735823e-c5e5-4033-a986-71e9a13cccd1]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0c0a54-fc42-458c-9053-b30bc2376c52]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e94cd1-6de7-411a-b519-eb9256915441]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e8d309-bdc4-4fbe-bd35-b71826fcf075]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2, portal: 172.16.0.220,3260]
Oct 20 09:16:54 user nova-compute[74039]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2, portal: 172.16.0.220,3260] successful.
Oct 20 09:16:54 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[80405aa2-2504-42d6-814b-131bda340318]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] <== disconnect_volume: return (344ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:16:54 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Deleting instance files /opt/stack/data/nova/instances/c75f37aa-657f-4076-b42b-b716ed608fac_del
Oct 20 09:16:54 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Deletion of /opt/stack/data/nova/instances/c75f37aa-657f-4076-b42b-b716ed608fac_del complete
Oct 20 09:16:54 user nova-compute[74039]: DEBUG nova.network.neutron [req-76c6b726-2068-4467-bd66-60b0c6d14b5d req-5d963d3a-d81e-4919-93bc-cdcd5554aa8f service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Updated VIF entry in instance network info cache for port c1e04f2d-ef5c-4de2-831e-28d7339feba3. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG nova.network.neutron [req-76c6b726-2068-4467-bd66-60b0c6d14b5d req-5d963d3a-d81e-4919-93bc-cdcd5554aa8f service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Updating instance_info_cache with network_info: [{"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": null, "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:16:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-76c6b726-2068-4467-bd66-60b0c6d14b5d req-5d963d3a-d81e-4919-93bc-cdcd5554aa8f service nova] Releasing lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:16:55 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Deleted allocations for instance c75f37aa-657f-4076-b42b-b716ed608fac
Oct 20 09:16:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:16:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:16:56 user nova-compute[74039]: DEBUG nova.objects.instance [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lazy-loading 'numa_topology' on Instance uuid c75f37aa-657f-4076-b42b-b716ed608fac {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:16:56 user nova-compute[74039]: DEBUG nova.objects.base [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Object Instance<c75f37aa-657f-4076-b42b-b716ed608fac> lazy-loaded attributes: resources,numa_topology {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:16:56 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:16:56 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:16:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:16:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d0f96aa9-63fb-4739-bf96-e7290ce79b25 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "c75f37aa-657f-4076-b42b-b716ed608fac" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.706s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:16:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Acquiring lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:16:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:16:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Acquiring lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:16:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:16:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:16:57 user nova-compute[74039]: INFO nova.compute.manager [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Terminating instance
Oct 20 09:16:57 user nova-compute[74039]: DEBUG nova.compute.manager [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:16:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:57 user nova-compute[74039]: DEBUG nova.compute.manager [req-fcf788fa-ef31-4ae6-bfab-5209b01999ec req-d76637ec-5dd3-4bb7-acc1-c5d5445fcafd service nova] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Received event network-vif-unplugged-9848dd1a-610a-44ee-8c8a-61045bbc79e2 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:16:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-fcf788fa-ef31-4ae6-bfab-5209b01999ec req-d76637ec-5dd3-4bb7-acc1-c5d5445fcafd service nova] Acquiring lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:16:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-fcf788fa-ef31-4ae6-bfab-5209b01999ec req-d76637ec-5dd3-4bb7-acc1-c5d5445fcafd service nova] Lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:16:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-fcf788fa-ef31-4ae6-bfab-5209b01999ec req-d76637ec-5dd3-4bb7-acc1-c5d5445fcafd service nova] Lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:16:57 user nova-compute[74039]: DEBUG nova.compute.manager [req-fcf788fa-ef31-4ae6-bfab-5209b01999ec req-d76637ec-5dd3-4bb7-acc1-c5d5445fcafd service nova] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] No waiting events found dispatching network-vif-unplugged-9848dd1a-610a-44ee-8c8a-61045bbc79e2 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:16:57 user nova-compute[74039]: DEBUG nova.compute.manager [req-fcf788fa-ef31-4ae6-bfab-5209b01999ec req-d76637ec-5dd3-4bb7-acc1-c5d5445fcafd service nova] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Received event network-vif-unplugged-9848dd1a-610a-44ee-8c8a-61045bbc79e2 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:16:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:58 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Instance destroyed successfully.
Oct 20 09:16:58 user nova-compute[74039]: DEBUG nova.objects.instance [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lazy-loading 'resources' on Instance uuid 6ae64a71-333f-45bb-bd5c-46e6ed544afa {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:16:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:15:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1436094920',display_name='tempest-ServersNegativeTestJSON-server-1436094920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1436094920',id=43,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:15:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc4517bc9ca141198f7fbc358756a880',ramdisk_id='',reservation_id='r-35tu5p8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1549503071',owner_user_name='tempest-ServersNegativeTestJSON-1549503071-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:15:14Z,user_data=None,user_id='b959b678b5fb44d08c0ef8f113004e91',uuid=6ae64a71-333f-45bb-bd5c-46e6ed544afa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9848dd1a-610a-44ee-8c8a-61045bbc79e2", "address": "fa:16:3e:6e:db:a7", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9848dd1a-61", "ovs_interfaceid": "9848dd1a-610a-44ee-8c8a-61045bbc79e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:16:58 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Converting VIF {"id": "9848dd1a-610a-44ee-8c8a-61045bbc79e2", "address": "fa:16:3e:6e:db:a7", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9848dd1a-61", "ovs_interfaceid": "9848dd1a-610a-44ee-8c8a-61045bbc79e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:16:58 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:db:a7,bridge_name='br-int',has_traffic_filtering=True,id=9848dd1a-610a-44ee-8c8a-61045bbc79e2,network=Network(55f22c53-eb29-43fd-9039-5f9d4b28eff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9848dd1a-61') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:16:58 user nova-compute[74039]: DEBUG os_vif [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:db:a7,bridge_name='br-int',has_traffic_filtering=True,id=9848dd1a-610a-44ee-8c8a-61045bbc79e2,network=Network(55f22c53-eb29-43fd-9039-5f9d4b28eff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9848dd1a-61') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:16:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9848dd1a-61, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:16:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:16:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9eae4ab7-f294-4b14-8f99-00fd6ec49a8f) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:16:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:16:58 user nova-compute[74039]: INFO os_vif [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:db:a7,bridge_name='br-int',has_traffic_filtering=True,id=9848dd1a-610a-44ee-8c8a-61045bbc79e2,network=Network(55f22c53-eb29-43fd-9039-5f9d4b28eff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9848dd1a-61')
Oct 20 09:16:58 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Deleting instance files /opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa_del
Oct 20 09:16:58 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Deletion of /opt/stack/data/nova/instances/6ae64a71-333f-45bb-bd5c-46e6ed544afa_del complete
Oct 20 09:16:58 user nova-compute[74039]: INFO nova.compute.manager [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Took 0.71 seconds to destroy the instance on the hypervisor.
Oct 20 09:16:58 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:16:58 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:16:58 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:16:59 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:16:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:16:59 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Took 0.77 seconds to deallocate network for instance.
Oct 20 09:16:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:16:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:16:59 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:16:59 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:16:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:16:59 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Deleted allocations for instance 6ae64a71-333f-45bb-bd5c-46e6ed544afa
Oct 20 09:16:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d36f3726-6015-47c2-8651-a55cbe31e38e tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.985s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:17:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-0ada3135-6e9c-4a16-a6b6-b9e334dad719 req-37a371ce-626c-42a6-bb1a-610dbff78c2e service nova] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Received event network-vif-plugged-9848dd1a-610a-44ee-8c8a-61045bbc79e2 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:17:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0ada3135-6e9c-4a16-a6b6-b9e334dad719 req-37a371ce-626c-42a6-bb1a-610dbff78c2e service nova] Acquiring lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:17:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0ada3135-6e9c-4a16-a6b6-b9e334dad719 req-37a371ce-626c-42a6-bb1a-610dbff78c2e service nova] Lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:17:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-0ada3135-6e9c-4a16-a6b6-b9e334dad719 req-37a371ce-626c-42a6-bb1a-610dbff78c2e service nova] Lock "6ae64a71-333f-45bb-bd5c-46e6ed544afa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:17:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-0ada3135-6e9c-4a16-a6b6-b9e334dad719 req-37a371ce-626c-42a6-bb1a-610dbff78c2e service nova] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] No waiting events found dispatching network-vif-plugged-9848dd1a-610a-44ee-8c8a-61045bbc79e2 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:17:00 user nova-compute[74039]: WARNING nova.compute.manager [req-0ada3135-6e9c-4a16-a6b6-b9e334dad719 req-37a371ce-626c-42a6-bb1a-610dbff78c2e service nova] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Received unexpected event network-vif-plugged-9848dd1a-610a-44ee-8c8a-61045bbc79e2 for instance with vm_state deleted and task_state None.
Oct 20 09:17:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-0ada3135-6e9c-4a16-a6b6-b9e334dad719 req-37a371ce-626c-42a6-bb1a-610dbff78c2e service nova] [instance: 6ae64a71-333f-45bb-bd5c-46e6ed544afa] Received event network-vif-deleted-9848dd1a-610a-44ee-8c8a-61045bbc79e2 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:17:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:17:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:17:04 user nova-compute[74039]: DEBUG nova.compute.manager [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:17:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:17:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:17:04 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:17:04 user nova-compute[74039]: INFO nova.compute.claims [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Claim successful on node user
Oct 20 09:17:05 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:17:05 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:17:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:17:05 user nova-compute[74039]: DEBUG nova.compute.manager [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:17:05 user nova-compute[74039]: DEBUG nova.compute.manager [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:17:05 user nova-compute[74039]: DEBUG nova.network.neutron [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:17:05 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:17:05 user nova-compute[74039]: DEBUG nova.compute.manager [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:17:05 user nova-compute[74039]: INFO nova.virt.block_device [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Booting with volume-backed-image f58b9629-4790-4951-9492-6447e1485638 at /dev/vda
Oct 20 09:17:05 user nova-compute[74039]: DEBUG nova.policy [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e07a52b4e3b4a65b34f71fb2cca8de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ed96a82048434fb0d79a55838184e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:17:05 user nova-compute[74039]: DEBUG nova.network.neutron [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Successfully created port: 90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:17:06 user nova-compute[74039]: DEBUG nova.network.neutron [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Successfully updated port: 90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:17:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "refresh_cache-bf598ec2-bd4c-4bd6-b20e-b11617907c77" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:17:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquired lock "refresh_cache-bf598ec2-bd4c-4bd6-b20e-b11617907c77" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:17:06 user nova-compute[74039]: DEBUG nova.network.neutron [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:17:06 user nova-compute[74039]: DEBUG nova.compute.manager [req-2a1202c1-4880-4ae4-ae86-917a98e7a0d5 req-a641892c-08a8-4722-93cf-7ca6cc404e33 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received event network-changed-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:17:06 user nova-compute[74039]: DEBUG nova.compute.manager [req-2a1202c1-4880-4ae4-ae86-917a98e7a0d5 req-a641892c-08a8-4722-93cf-7ca6cc404e33 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Refreshing instance network info cache due to event network-changed-90bb89e6-7b81-4665-8eac-8979ab44e9d5. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:17:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2a1202c1-4880-4ae4-ae86-917a98e7a0d5 req-a641892c-08a8-4722-93cf-7ca6cc404e33 service nova] Acquiring lock "refresh_cache-bf598ec2-bd4c-4bd6-b20e-b11617907c77" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:17:06 user nova-compute[74039]: DEBUG nova.network.neutron [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:17:07 user nova-compute[74039]: DEBUG nova.network.neutron [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Updating instance_info_cache with network_info: [{"id": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "address": "fa:16:3e:36:1e:50", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb89e6-7b", "ovs_interfaceid": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:17:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Releasing lock "refresh_cache-bf598ec2-bd4c-4bd6-b20e-b11617907c77" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:17:07 user nova-compute[74039]: DEBUG nova.compute.manager [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Instance network_info: |[{"id": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "address": "fa:16:3e:36:1e:50", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb89e6-7b", "ovs_interfaceid": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:17:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2a1202c1-4880-4ae4-ae86-917a98e7a0d5 req-a641892c-08a8-4722-93cf-7ca6cc404e33 service nova] Acquired lock "refresh_cache-bf598ec2-bd4c-4bd6-b20e-b11617907c77" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:17:07 user nova-compute[74039]: DEBUG nova.network.neutron [req-2a1202c1-4880-4ae4-ae86-917a98e7a0d5 req-a641892c-08a8-4722-93cf-7ca6cc404e33 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Refreshing network info cache for port 90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:17:07 user nova-compute[74039]: DEBUG nova.network.neutron [req-2a1202c1-4880-4ae4-ae86-917a98e7a0d5 req-a641892c-08a8-4722-93cf-7ca6cc404e33 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Updated VIF entry in instance network info cache for port 90bb89e6-7b81-4665-8eac-8979ab44e9d5. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:17:07 user nova-compute[74039]: DEBUG nova.network.neutron [req-2a1202c1-4880-4ae4-ae86-917a98e7a0d5 req-a641892c-08a8-4722-93cf-7ca6cc404e33 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Updating instance_info_cache with network_info: [{"id": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "address": "fa:16:3e:36:1e:50", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb89e6-7b", "ovs_interfaceid": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:17:07 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2a1202c1-4880-4ae4-ae86-917a98e7a0d5 req-a641892c-08a8-4722-93cf-7ca6cc404e33 service nova] Releasing lock "refresh_cache-bf598ec2-bd4c-4bd6-b20e-b11617907c77" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:17:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG os_brick.utils [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0726c1-9c68-4d7a-ace0-506e3500aba7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[507e00d1-73e9-45c0-b368-d82ab50070bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[02642af8-a4c3-493e-9d3c-15f5a2cd000d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b619816-2569-44fa-bc19-055b3bd224d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:17:21 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:17:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a9349d-d273-4fe9-b6c1-c06fa0c5c1da]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG os_brick.utils [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:17:21 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Updating existing volume attachment record: d46e07f0-f6f8-4870-9cb0-7efa5eb4f484 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:17:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:17:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:17:27 user nova-compute[74039]: INFO nova.compute.manager [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Detaching volume 772604fa-94a0-4789-afa6-efb4e3e26970
Oct 20 09:17:27 user nova-compute[74039]: INFO nova.virt.block_device [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Attempting to driver detach volume 772604fa-94a0-4789-afa6-efb4e3e26970 from mountpoint /dev/vdb
Oct 20 09:17:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Attempting to detach device vdb from instance 69541e4b-dded-4e7c-9cfa-d93f8824179f from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 09:17:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:17:27 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:17:27 user nova-compute[74039]:   <source dev="/dev/sdd"/>
Oct 20 09:17:27 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:17:27 user nova-compute[74039]:   <serial>772604fa-94a0-4789-afa6-efb4e3e26970</serial>
Oct 20 09:17:27 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:17:27 user nova-compute[74039]: </disk>
Oct 20 09:17:27 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:17:27 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Successfully detached device vdb from instance 69541e4b-dded-4e7c-9cfa-d93f8824179f from the persistent domain config.
Oct 20 09:17:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 69541e4b-dded-4e7c-9cfa-d93f8824179f from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 09:17:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:17:27 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:17:27 user nova-compute[74039]:   <source dev="/dev/sdd"/>
Oct 20 09:17:27 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:17:27 user nova-compute[74039]:   <serial>772604fa-94a0-4789-afa6-efb4e3e26970</serial>
Oct 20 09:17:27 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:17:27 user nova-compute[74039]: </disk>
Oct 20 09:17:27 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:17:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 69541e4b-dded-4e7c-9cfa-d93f8824179f {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 09:17:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:17:29 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:17:29 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:17:31 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:17:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:17:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-d109c52e-1d09-4ed1-9c63-97abcf37ff92" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:17:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-d109c52e-1d09-4ed1-9c63-97abcf37ff92" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:17:31 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:17:32 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Updating instance_info_cache with network_info: [{"id": "eb611398-f36f-449f-8a0f-d2028c761079", "address": "fa:16:3e:a6:40:db", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb611398-f3", "ovs_interfaceid": "eb611398-f36f-449f-8a0f-d2028c761079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:17:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-d109c52e-1d09-4ed1-9c63-97abcf37ff92" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:17:32 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:17:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:33 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:17:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:34 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:17:36 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:17:36 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.compute.manager [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:17:38 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Creating image(s)
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Did not create local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Ensure instance console log exists: /opt/stack/data/nova/instances/bf598ec2-bd4c-4bd6-b20e-b11617907c77/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Start _get_guest_xml network_info=[{"id": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "address": "fa:16:3e:36:1e:50", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb89e6-7b", "ovs_interfaceid": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd46e07f0-f6f8-4870-9cb0-7efa5eb4f484', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqRfFSvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bf598ec2-bd4c-4bd6-b20e-b11617907c77', 'attached_at': '', 'detached_at': '', 'volume_id': '0e1aebe0-9d2e-47de-b29b-037e176f3dd9', 'serial': '0e1aebe0-9d2e-47de-b29b-037e176f3dd9'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:17:38 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:17:38 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqRfFSvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:17:38 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:17:38 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:17:38 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260" returned: 21 in 0.038s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edfd102-dff6-47e4-a745-381075d85776]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:17:38 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d45176-12f3-4ece-9cc1-94882fc61c1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9] added
Oct 20 09:17:38 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[031727ca-f77e-4019-8602-7ec336c6c69e]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f4320c-d33f-4a70-b456-174a01a560d3]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YqRfFSvd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YqRfFSvd" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fa9184-0bca-452e-91a6-236ef14b8758]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YqRfFSvd'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd6aaff-412e-4e85-aa19-1776b6f94c14]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef929cda-b223-4e60-9dd1-bb5aef7a35e3]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:17:38 user nova-compute[74039]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 (non-flash)
Oct 20 09:17:38 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:17:38 user nova-compute[74039]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 (non-flash)
Oct 20 09:17:38 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6229de3d-d3df-4bc9-9edc-b2e6b6e7e8a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9, portal: 172.16.0.220,3260]
Oct 20 09:17:38 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9, portal: 172.16.0.220,3260] successful.
Oct 20 09:17:38 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05128ee-3986-4d1c-9b48-9fbeed5a7d3e]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9978e1-0d60-4526-8b81-2bb3d99107b0]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:17:38 user nova-compute[74039]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 (non-flash)
Oct 20 09:17:38 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:17:38 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:17:38 user nova-compute[74039]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 (non-flash)
Oct 20 09:17:38 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:17:38 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e2b73e-8550-44a7-9346-81ec17f45350]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:38 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqRfFSvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26162666139383537', 'path': '/dev/sdb'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162666139383537', 'path': '/dev/sdb'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:17:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-120225547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-120225547',id=44,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7ed96a82048434fb0d79a55838184e4',ramdisk_id='',reservation_id='r-wsf27t04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:17:05Z,user_data=None,user_id='1e07a52b4e3b4a65b34f71fb2cca8de3',uuid=bf598ec2-bd4c-4bd6-b20e-b11617907c77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "address": "fa:16:3e:36:1e:50", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb89e6-7b", "ovs_interfaceid": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converting VIF {"id": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "address": "fa:16:3e:36:1e:50", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb89e6-7b", "ovs_interfaceid": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:1e:50,bridge_name='br-int',has_traffic_filtering=True,id=90bb89e6-7b81-4665-8eac-8979ab44e9d5,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bb89e6-7b') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG nova.objects.instance [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'pci_devices' on Instance uuid bf598ec2-bd4c-4bd6-b20e-b11617907c77 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:17:39 user nova-compute[74039]:   <uuid>bf598ec2-bd4c-4bd6-b20e-b11617907c77</uuid>
Oct 20 09:17:39 user nova-compute[74039]:   <name>instance-0000002c</name>
Oct 20 09:17:39 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:17:39 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:17:39 user nova-compute[74039]:   <metadata>
Oct 20 09:17:39 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:17:39 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:17:39 user nova-compute[74039]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-120225547</nova:name>
Oct 20 09:17:39 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:17:38</nova:creationTime>
Oct 20 09:17:39 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:17:39 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:17:39 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:17:39 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:17:39 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:17:39 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:17:39 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:17:39 user nova-compute[74039]:       <nova:owner>
Oct 20 09:17:39 user nova-compute[74039]:         <nova:user uuid="1e07a52b4e3b4a65b34f71fb2cca8de3">tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member</nova:user>
Oct 20 09:17:39 user nova-compute[74039]:         <nova:project uuid="d7ed96a82048434fb0d79a55838184e4">tempest-ServerBootFromVolumeStableRescueTest-1728924155</nova:project>
Oct 20 09:17:39 user nova-compute[74039]:       </nova:owner>
Oct 20 09:17:39 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:17:39 user nova-compute[74039]:       <nova:ports>
Oct 20 09:17:39 user nova-compute[74039]:         <nova:port uuid="90bb89e6-7b81-4665-8eac-8979ab44e9d5">
Oct 20 09:17:39 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 09:17:39 user nova-compute[74039]:         </nova:port>
Oct 20 09:17:39 user nova-compute[74039]:       </nova:ports>
Oct 20 09:17:39 user nova-compute[74039]:     </nova:instance>
Oct 20 09:17:39 user nova-compute[74039]:   </metadata>
Oct 20 09:17:39 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:17:39 user nova-compute[74039]:     <system>
Oct 20 09:17:39 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:17:39 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:17:39 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:17:39 user nova-compute[74039]:       <entry name="serial">bf598ec2-bd4c-4bd6-b20e-b11617907c77</entry>
Oct 20 09:17:39 user nova-compute[74039]:       <entry name="uuid">bf598ec2-bd4c-4bd6-b20e-b11617907c77</entry>
Oct 20 09:17:39 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:17:39 user nova-compute[74039]:     </system>
Oct 20 09:17:39 user nova-compute[74039]:   </sysinfo>
Oct 20 09:17:39 user nova-compute[74039]:   <os>
Oct 20 09:17:39 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:17:39 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:17:39 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:17:39 user nova-compute[74039]:   </os>
Oct 20 09:17:39 user nova-compute[74039]:   <features>
Oct 20 09:17:39 user nova-compute[74039]:     <acpi/>
Oct 20 09:17:39 user nova-compute[74039]:     <apic/>
Oct 20 09:17:39 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:17:39 user nova-compute[74039]:   </features>
Oct 20 09:17:39 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:17:39 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:17:39 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:17:39 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:17:39 user nova-compute[74039]:   </clock>
Oct 20 09:17:39 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:17:39 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:17:39 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:17:39 user nova-compute[74039]:   </cpu>
Oct 20 09:17:39 user nova-compute[74039]:   <devices>
Oct 20 09:17:39 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 09:17:39 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:17:39 user nova-compute[74039]:       <source dev="/dev/sdb"/>
Oct 20 09:17:39 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:17:39 user nova-compute[74039]:       <serial>0e1aebe0-9d2e-47de-b29b-037e176f3dd9</serial>
Oct 20 09:17:39 user nova-compute[74039]:     </disk>
Oct 20 09:17:39 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:17:39 user nova-compute[74039]:       <mac address="fa:16:3e:36:1e:50"/>
Oct 20 09:17:39 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:17:39 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:17:39 user nova-compute[74039]:       <target dev="tap90bb89e6-7b"/>
Oct 20 09:17:39 user nova-compute[74039]:     </interface>
Oct 20 09:17:39 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:17:39 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/bf598ec2-bd4c-4bd6-b20e-b11617907c77/console.log" append="off"/>
Oct 20 09:17:39 user nova-compute[74039]:     </serial>
Oct 20 09:17:39 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:17:39 user nova-compute[74039]:     <video>
Oct 20 09:17:39 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:17:39 user nova-compute[74039]:     </video>
Oct 20 09:17:39 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:17:39 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:17:39 user nova-compute[74039]:     </rng>
Oct 20 09:17:39 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:17:39 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:17:39 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:17:39 user nova-compute[74039]:     </memballoon>
Oct 20 09:17:39 user nova-compute[74039]:   </devices>
Oct 20 09:17:39 user nova-compute[74039]: </domain>
Oct 20 09:17:39 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:17:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-120225547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-120225547',id=44,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7ed96a82048434fb0d79a55838184e4',ramdisk_id='',reservation_id='r-wsf27t04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:17:05Z,user_data=None,user_id='1e07a52b4e3b4a65b34f71fb2cca8de3',uuid=bf598ec2-bd4c-4bd6-b20e-b11617907c77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "address": "fa:16:3e:36:1e:50", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb89e6-7b", "ovs_interfaceid": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converting VIF {"id": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "address": "fa:16:3e:36:1e:50", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb89e6-7b", "ovs_interfaceid": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:1e:50,bridge_name='br-int',has_traffic_filtering=True,id=90bb89e6-7b81-4665-8eac-8979ab44e9d5,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bb89e6-7b') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG os_vif [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:1e:50,bridge_name='br-int',has_traffic_filtering=True,id=90bb89e6-7b81-4665-8eac-8979ab44e9d5,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bb89e6-7b') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f01a39a-8dd6-592f-a587-0b03441eed1a', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90bb89e6-7b, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90bb89e6-7b, col_values=(('qos', UUID('70bc9a9e-c390-4ea9-a977-196d204f2a81')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90bb89e6-7b, col_values=(('external_ids', {'iface-id': '90bb89e6-7b81-4665-8eac-8979ab44e9d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:1e:50', 'vm-uuid': 'bf598ec2-bd4c-4bd6-b20e-b11617907c77'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:39 user nova-compute[74039]: INFO os_vif [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:1e:50,bridge_name='br-int',has_traffic_filtering=True,id=90bb89e6-7b81-4665-8eac-8979ab44e9d5,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bb89e6-7b')
Oct 20 09:17:39 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:17:39 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] No VIF found with MAC fa:16:3e:36:1e:50, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:17:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:41 user nova-compute[74039]: DEBUG nova.compute.manager [req-cb4c6098-04cf-4c69-a89e-ff9d5d18ec18 req-28fe9f09-1c8f-4a36-9efa-5b64b0b90820 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received event network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:17:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-cb4c6098-04cf-4c69-a89e-ff9d5d18ec18 req-28fe9f09-1c8f-4a36-9efa-5b64b0b90820 service nova] Acquiring lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:17:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-cb4c6098-04cf-4c69-a89e-ff9d5d18ec18 req-28fe9f09-1c8f-4a36-9efa-5b64b0b90820 service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:17:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-cb4c6098-04cf-4c69-a89e-ff9d5d18ec18 req-28fe9f09-1c8f-4a36-9efa-5b64b0b90820 service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:17:41 user nova-compute[74039]: DEBUG nova.compute.manager [req-cb4c6098-04cf-4c69-a89e-ff9d5d18ec18 req-28fe9f09-1c8f-4a36-9efa-5b64b0b90820 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] No waiting events found dispatching network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:17:41 user nova-compute[74039]: WARNING nova.compute.manager [req-cb4c6098-04cf-4c69-a89e-ff9d5d18ec18 req-28fe9f09-1c8f-4a36-9efa-5b64b0b90820 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received unexpected event network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 for instance with vm_state building and task_state spawning.
Oct 20 09:17:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:17:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:17:42 user nova-compute[74039]: DEBUG nova.compute.manager [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:17:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:17:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:17:42 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:17:42 user nova-compute[74039]: INFO nova.compute.claims [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Claim successful on node user
Oct 20 09:17:42 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:17:42 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:17:42 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:17:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:17:42 user nova-compute[74039]: DEBUG nova.compute.manager [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:17:42 user nova-compute[74039]: DEBUG nova.compute.manager [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:17:42 user nova-compute[74039]: DEBUG nova.network.neutron [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:17:42 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:17:42 user nova-compute[74039]: DEBUG nova.compute.manager [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:17:42 user nova-compute[74039]: DEBUG nova.policy [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d68ed2131b34e57a5f10a01409fee62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367334c57f8f47b696a477460afba369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:17:42 user nova-compute[74039]: INFO nova.virt.block_device [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Booting with volume snapshot df2b6784-62e2-41a7-9e2b-a7497cc23f35 at /dev/vda
Oct 20 09:17:43 user nova-compute[74039]: DEBUG nova.compute.manager [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:17:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:17:43 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Instance spawned successfully.
Oct 20 09:17:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:17:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:17:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:17:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:17:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:17:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:17:43 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:17:43 user nova-compute[74039]: INFO nova.compute.manager [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Took 5.03 seconds to spawn the instance on the hypervisor.
Oct 20 09:17:43 user nova-compute[74039]: DEBUG nova.compute.manager [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:17:43 user nova-compute[74039]: DEBUG nova.compute.manager [req-a2684cac-bbb3-4ee3-9a22-8c27af1e7648 req-ce16058e-a1a4-4a16-89c6-56cd7e84ccdd service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received event network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:17:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a2684cac-bbb3-4ee3-9a22-8c27af1e7648 req-ce16058e-a1a4-4a16-89c6-56cd7e84ccdd service nova] Acquiring lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:17:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a2684cac-bbb3-4ee3-9a22-8c27af1e7648 req-ce16058e-a1a4-4a16-89c6-56cd7e84ccdd service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:17:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-a2684cac-bbb3-4ee3-9a22-8c27af1e7648 req-ce16058e-a1a4-4a16-89c6-56cd7e84ccdd service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:17:43 user nova-compute[74039]: DEBUG nova.compute.manager [req-a2684cac-bbb3-4ee3-9a22-8c27af1e7648 req-ce16058e-a1a4-4a16-89c6-56cd7e84ccdd service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] No waiting events found dispatching network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:17:43 user nova-compute[74039]: WARNING nova.compute.manager [req-a2684cac-bbb3-4ee3-9a22-8c27af1e7648 req-ce16058e-a1a4-4a16-89c6-56cd7e84ccdd service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received unexpected event network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 for instance with vm_state building and task_state spawning.
Oct 20 09:17:43 user nova-compute[74039]: INFO nova.compute.manager [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Took 38.60 seconds to build instance.
Oct 20 09:17:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c9d56a20-97bb-429f-b1ee-fb464b582576 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.709s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:17:43 user nova-compute[74039]: DEBUG nova.network.neutron [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Successfully created port: 60c06649-bdef-4530-9b11-75cf36406563 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:17:44 user nova-compute[74039]: DEBUG nova.network.neutron [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Successfully updated port: 60c06649-bdef-4530-9b11-75cf36406563 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:17:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "refresh_cache-3d5cd514-9b82-4a1a-8bc9-570b2f7cf822" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:17:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquired lock "refresh_cache-3d5cd514-9b82-4a1a-8bc9-570b2f7cf822" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:17:44 user nova-compute[74039]: DEBUG nova.network.neutron [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:17:44 user nova-compute[74039]: DEBUG nova.compute.manager [req-be5703c9-a459-474b-a6f9-e835bba394bf req-5917cf84-eced-4677-b58f-30c46ad774bc service nova] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Received event network-changed-60c06649-bdef-4530-9b11-75cf36406563 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:17:44 user nova-compute[74039]: DEBUG nova.compute.manager [req-be5703c9-a459-474b-a6f9-e835bba394bf req-5917cf84-eced-4677-b58f-30c46ad774bc service nova] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Refreshing instance network info cache due to event network-changed-60c06649-bdef-4530-9b11-75cf36406563. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:17:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-be5703c9-a459-474b-a6f9-e835bba394bf req-5917cf84-eced-4677-b58f-30c46ad774bc service nova] Acquiring lock "refresh_cache-3d5cd514-9b82-4a1a-8bc9-570b2f7cf822" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:17:44 user nova-compute[74039]: DEBUG nova.network.neutron [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:17:44 user nova-compute[74039]: DEBUG nova.network.neutron [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Updating instance_info_cache with network_info: [{"id": "60c06649-bdef-4530-9b11-75cf36406563", "address": "fa:16:3e:e2:4e:8c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c06649-bd", "ovs_interfaceid": "60c06649-bdef-4530-9b11-75cf36406563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:17:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Releasing lock "refresh_cache-3d5cd514-9b82-4a1a-8bc9-570b2f7cf822" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:17:44 user nova-compute[74039]: DEBUG nova.compute.manager [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Instance network_info: |[{"id": "60c06649-bdef-4530-9b11-75cf36406563", "address": "fa:16:3e:e2:4e:8c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c06649-bd", "ovs_interfaceid": "60c06649-bdef-4530-9b11-75cf36406563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:17:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-be5703c9-a459-474b-a6f9-e835bba394bf req-5917cf84-eced-4677-b58f-30c46ad774bc service nova] Acquired lock "refresh_cache-3d5cd514-9b82-4a1a-8bc9-570b2f7cf822" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:17:44 user nova-compute[74039]: DEBUG nova.network.neutron [req-be5703c9-a459-474b-a6f9-e835bba394bf req-5917cf84-eced-4677-b58f-30c46ad774bc service nova] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Refreshing network info cache for port 60c06649-bdef-4530-9b11-75cf36406563 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:17:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:44 user nova-compute[74039]: DEBUG nova.network.neutron [req-be5703c9-a459-474b-a6f9-e835bba394bf req-5917cf84-eced-4677-b58f-30c46ad774bc service nova] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Updated VIF entry in instance network info cache for port 60c06649-bdef-4530-9b11-75cf36406563. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:17:44 user nova-compute[74039]: DEBUG nova.network.neutron [req-be5703c9-a459-474b-a6f9-e835bba394bf req-5917cf84-eced-4677-b58f-30c46ad774bc service nova] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Updating instance_info_cache with network_info: [{"id": "60c06649-bdef-4530-9b11-75cf36406563", "address": "fa:16:3e:e2:4e:8c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c06649-bd", "ovs_interfaceid": "60c06649-bdef-4530-9b11-75cf36406563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:17:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-be5703c9-a459-474b-a6f9-e835bba394bf req-5917cf84-eced-4677-b58f-30c46ad774bc service nova] Releasing lock "refresh_cache-3d5cd514-9b82-4a1a-8bc9-570b2f7cf822" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:17:46 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:17:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:17:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:17:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:17:46 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:17:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:17:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:47 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 69541e4b-dded-4e7c-9cfa-d93f8824179f is timed out.
Oct 20 09:17:47 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Successfully detached device vdb from instance 69541e4b-dded-4e7c-9cfa-d93f8824179f from the live domain config.
Oct 20 09:17:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:17:47 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bvPkVidD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:17:47 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:17:47 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:17:47 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:17:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:47 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bba3ef9-cfde-4c90-b7f9-e76ab79eb740]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:47 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:17:47 user nova-compute[74039]: No targets found.
Oct 20 09:17:47 user nova-compute[74039]: iSNS:
Oct 20 09:17:47 user nova-compute[74039]: No targets found.
Oct 20 09:17:47 user nova-compute[74039]: STATIC:
Oct 20 09:17:47 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14
Oct 20 09:17:47 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:17:47 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:17:47 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970
Oct 20 09:17:47 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:17:47 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:17:47 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9
Oct 20 09:17:47 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:17:47 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:17:47 user nova-compute[74039]: FIRMWARE:
Oct 20 09:17:47 user nova-compute[74039]: No targets found.
Oct 20 09:17:47 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:17:47 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:17:47 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:17:47 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:17:47 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:17:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fa1ee5-e1ac-4cd2-b1ae-d87201f6d2b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[102e06d8-0aec-4980-83b2-32963618178c]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:17:48 user nova-compute[74039]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 (non-flash)
Oct 20 09:17:48 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:17:48 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:17:48 user nova-compute[74039]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 (non-flash)
Oct 20 09:17:48 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:17:48 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae6c330af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970'): ({'sdd'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Removing single pathed devices sdd {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be8db83-37a0-44e4-bc55-7b4f3d22b147]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2195fc72-4fc5-4c4c-93a9-96945ecea8c2]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Flushing IO for device /dev/sdd {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7e0eab-5515-4600-b812-e387701d0ab7]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc952439-1752-456e-88d2-c1d3b1158939]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c353a7-6167-4e5c-b314-bea34c3097b6]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa91b20-46af-4713-8491-638df96cbfeb]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970, portal: 172.16.0.220,3260]
Oct 20 09:17:48 user nova-compute[74039]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970, portal: 172.16.0.220,3260] successful.
Oct 20 09:17:48 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772604fa-94a0-4789-afa6-efb4e3e26970 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07f9e31-8da5-4b5e-a572-c5b206e81c27]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] <== disconnect_volume: return (365ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:17:49 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:17:49 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:17:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8416MB free_disk=25.242748260498047GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG os_brick.utils [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d9e4a9-aec8-4d42-801d-d1547c2bd2d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f45b94-f8df-4ce6-837e-b1f41d2f34cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance d109c52e-1d09-4ed1-9c63-97abcf37ff92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance bd1f0c3b-32f3-4954-b38d-b57e16259234 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 69541e4b-dded-4e7c-9cfa-d93f8824179f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance bf598ec2-bd4c-4bd6-b20e-b11617907c77 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e405b77-09b6-4ed4-a49f-b546b7e94696]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[668e1d95-3fd9-4d70-874c-5874973c23ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG nova.objects.instance [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lazy-loading 'flavor' on Instance uuid 69541e4b-dded-4e7c-9cfa-d93f8824179f {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:17:49 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:17:49 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[391adcf4-6391-45e3-8e13-6e2098dbf630]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG os_brick.utils [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Updating existing volume attachment record: c2a7c5cb-646c-4cab-adae-6bbc431a7e1d {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ec89f845-3ea8-4113-96cc-1c764fc80b9c tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.906s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:17:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:17:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:17:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.compute.manager [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:18:06 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Creating image(s)
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Did not create local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Ensure instance console log exists: /opt/stack/data/nova/instances/3d5cd514-9b82-4a1a-8bc9-570b2f7cf822/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Start _get_guest_xml network_info=[{"id": "60c06649-bdef-4530-9b11-75cf36406563", "address": "fa:16:3e:e2:4e:8c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c06649-bd", "ovs_interfaceid": "60c06649-bdef-4530-9b11-75cf36406563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c2a7c5cb-646c-4cab-adae-6bbc431a7e1d', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HIfZcPVk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3d5cd514-9b82-4a1a-8bc9-570b2f7cf822', 'attached_at': '', 'detached_at': '', 'volume_id': '8bc9e2c5-a0d3-4640-8e04-84d86d8b5735', 'serial': '8bc9e2c5-a0d3-4640-8e04-84d86d8b5735'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:18:06 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:18:06 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HIfZcPVk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:18:06 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:18:06 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:18:06 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[732328e9-725d-42d9-b70e-d3d17a83cab1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:18:06 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.080s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5222c2e3-781d-41b5-9346-ec0040294bf4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735] added
Oct 20 09:18:06 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.080s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9838e2-f7be-4800-8b70-78d42ab6c8ca]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8742c1d8-8177-4520-8887-89b0ee12e2b0]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HIfZcPVk {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HIfZcPVk" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[191260b1-f5c3-4b95-b2df-c19d88cee790]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HIfZcPVk'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd34a102-9b35-4b08-bfa8-1575fa8445b2]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c445ec-6e76-4000-ba2d-c5ad7274e89a]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:18:06 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:18:06 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:18:06 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:18:06 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[79189d1f-7a42-4516-856c-9dc7838213d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735, portal: 172.16.0.220,3260]
Oct 20 09:18:06 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735, portal: 172.16.0.220,3260] successful.
Oct 20 09:18:06 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d813e2b-37bc-42c7-9041-d1a416ea0157]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b778e8-520f-45aa-a515-354b43573429]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:18:06 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:18:06 user nova-compute[74039]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)
Oct 20 09:18:06 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:18:06 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:18:06 user nova-compute[74039]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)
Oct 20 09:18:06 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f74e75-4968-4098-979e-b87902252790]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:18:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HIfZcPVk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23634656433626165', 'path': '/dev/sdd'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634656433626165', 'path': '/dev/sdd'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:17:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1265792638',display_name='tempest-TestVolumeBootPattern-server-1265792638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1265792638',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='367334c57f8f47b696a477460afba369',ramdisk_id='',reservation_id='r-rqc6ge82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725287482',owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:17:43Z,user_data=None,user_id='8d68ed2131b34e57a5f10a01409fee62',uuid=3d5cd514-9b82-4a1a-8bc9-570b2f7cf822,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60c06649-bdef-4530-9b11-75cf36406563", "address": "fa:16:3e:e2:4e:8c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c06649-bd", "ovs_interfaceid": "60c06649-bdef-4530-9b11-75cf36406563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converting VIF {"id": "60c06649-bdef-4530-9b11-75cf36406563", "address": "fa:16:3e:e2:4e:8c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c06649-bd", "ovs_interfaceid": "60c06649-bdef-4530-9b11-75cf36406563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4e:8c,bridge_name='br-int',has_traffic_filtering=True,id=60c06649-bdef-4530-9b11-75cf36406563,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c06649-bd') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG nova.objects.instance [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:18:07 user nova-compute[74039]:   <uuid>3d5cd514-9b82-4a1a-8bc9-570b2f7cf822</uuid>
Oct 20 09:18:07 user nova-compute[74039]:   <name>instance-0000002d</name>
Oct 20 09:18:07 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:18:07 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:18:07 user nova-compute[74039]:   <metadata>
Oct 20 09:18:07 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:18:07 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:18:07 user nova-compute[74039]:       <nova:name>tempest-TestVolumeBootPattern-server-1265792638</nova:name>
Oct 20 09:18:07 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:18:06</nova:creationTime>
Oct 20 09:18:07 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:18:07 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:18:07 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:18:07 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:18:07 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:18:07 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:18:07 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:18:07 user nova-compute[74039]:       <nova:owner>
Oct 20 09:18:07 user nova-compute[74039]:         <nova:user uuid="8d68ed2131b34e57a5f10a01409fee62">tempest-TestVolumeBootPattern-1725287482-project-member</nova:user>
Oct 20 09:18:07 user nova-compute[74039]:         <nova:project uuid="367334c57f8f47b696a477460afba369">tempest-TestVolumeBootPattern-1725287482</nova:project>
Oct 20 09:18:07 user nova-compute[74039]:       </nova:owner>
Oct 20 09:18:07 user nova-compute[74039]:       <nova:ports>
Oct 20 09:18:07 user nova-compute[74039]:         <nova:port uuid="60c06649-bdef-4530-9b11-75cf36406563">
Oct 20 09:18:07 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 09:18:07 user nova-compute[74039]:         </nova:port>
Oct 20 09:18:07 user nova-compute[74039]:       </nova:ports>
Oct 20 09:18:07 user nova-compute[74039]:     </nova:instance>
Oct 20 09:18:07 user nova-compute[74039]:   </metadata>
Oct 20 09:18:07 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:18:07 user nova-compute[74039]:     <system>
Oct 20 09:18:07 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:18:07 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:18:07 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:18:07 user nova-compute[74039]:       <entry name="serial">3d5cd514-9b82-4a1a-8bc9-570b2f7cf822</entry>
Oct 20 09:18:07 user nova-compute[74039]:       <entry name="uuid">3d5cd514-9b82-4a1a-8bc9-570b2f7cf822</entry>
Oct 20 09:18:07 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:18:07 user nova-compute[74039]:     </system>
Oct 20 09:18:07 user nova-compute[74039]:   </sysinfo>
Oct 20 09:18:07 user nova-compute[74039]:   <os>
Oct 20 09:18:07 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:18:07 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:18:07 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:18:07 user nova-compute[74039]:   </os>
Oct 20 09:18:07 user nova-compute[74039]:   <features>
Oct 20 09:18:07 user nova-compute[74039]:     <acpi/>
Oct 20 09:18:07 user nova-compute[74039]:     <apic/>
Oct 20 09:18:07 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:18:07 user nova-compute[74039]:   </features>
Oct 20 09:18:07 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:18:07 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:18:07 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:18:07 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:18:07 user nova-compute[74039]:   </clock>
Oct 20 09:18:07 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:18:07 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:18:07 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:18:07 user nova-compute[74039]:   </cpu>
Oct 20 09:18:07 user nova-compute[74039]:   <devices>
Oct 20 09:18:07 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 09:18:07 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:18:07 user nova-compute[74039]:       <source dev="/dev/sdd"/>
Oct 20 09:18:07 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:18:07 user nova-compute[74039]:       <serial>8bc9e2c5-a0d3-4640-8e04-84d86d8b5735</serial>
Oct 20 09:18:07 user nova-compute[74039]:     </disk>
Oct 20 09:18:07 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:18:07 user nova-compute[74039]:       <mac address="fa:16:3e:e2:4e:8c"/>
Oct 20 09:18:07 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:18:07 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:18:07 user nova-compute[74039]:       <target dev="tap60c06649-bd"/>
Oct 20 09:18:07 user nova-compute[74039]:     </interface>
Oct 20 09:18:07 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:18:07 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/3d5cd514-9b82-4a1a-8bc9-570b2f7cf822/console.log" append="off"/>
Oct 20 09:18:07 user nova-compute[74039]:     </serial>
Oct 20 09:18:07 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:18:07 user nova-compute[74039]:     <video>
Oct 20 09:18:07 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:18:07 user nova-compute[74039]:     </video>
Oct 20 09:18:07 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:18:07 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:18:07 user nova-compute[74039]:     </rng>
Oct 20 09:18:07 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:18:07 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:18:07 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:18:07 user nova-compute[74039]:     </memballoon>
Oct 20 09:18:07 user nova-compute[74039]:   </devices>
Oct 20 09:18:07 user nova-compute[74039]: </domain>
Oct 20 09:18:07 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:17:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1265792638',display_name='tempest-TestVolumeBootPattern-server-1265792638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1265792638',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='367334c57f8f47b696a477460afba369',ramdisk_id='',reservation_id='r-rqc6ge82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725287482',owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:17:43Z,user_data=None,user_id='8d68ed2131b34e57a5f10a01409fee62',uuid=3d5cd514-9b82-4a1a-8bc9-570b2f7cf822,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60c06649-bdef-4530-9b11-75cf36406563", "address": "fa:16:3e:e2:4e:8c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c06649-bd", "ovs_interfaceid": "60c06649-bdef-4530-9b11-75cf36406563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converting VIF {"id": "60c06649-bdef-4530-9b11-75cf36406563", "address": "fa:16:3e:e2:4e:8c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c06649-bd", "ovs_interfaceid": "60c06649-bdef-4530-9b11-75cf36406563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4e:8c,bridge_name='br-int',has_traffic_filtering=True,id=60c06649-bdef-4530-9b11-75cf36406563,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c06649-bd') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG os_vif [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4e:8c,bridge_name='br-int',has_traffic_filtering=True,id=60c06649-bdef-4530-9b11-75cf36406563,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c06649-bd') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '318f92de-7c63-5438-bcba-d87c546327d8', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60c06649-bd, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60c06649-bd, col_values=(('qos', UUID('4ce830d7-a83f-4127-8491-713c8213bea5')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60c06649-bd, col_values=(('external_ids', {'iface-id': '60c06649-bdef-4530-9b11-75cf36406563', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:4e:8c', 'vm-uuid': '3d5cd514-9b82-4a1a-8bc9-570b2f7cf822'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:07 user nova-compute[74039]: INFO os_vif [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4e:8c,bridge_name='br-int',has_traffic_filtering=True,id=60c06649-bdef-4530-9b11-75cf36406563,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c06649-bd')
Oct 20 09:18:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:18:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] No VIF found with MAC fa:16:3e:e2:4e:8c, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:18:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-ea10a4ba-f3c2-4062-aa29-cdb3d51616ba req-4cbda378-03a9-4a47-b185-58bd0a79929e service nova] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Received event network-vif-plugged-60c06649-bdef-4530-9b11-75cf36406563 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:18:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ea10a4ba-f3c2-4062-aa29-cdb3d51616ba req-4cbda378-03a9-4a47-b185-58bd0a79929e service nova] Acquiring lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:18:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ea10a4ba-f3c2-4062-aa29-cdb3d51616ba req-4cbda378-03a9-4a47-b185-58bd0a79929e service nova] Lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:18:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ea10a4ba-f3c2-4062-aa29-cdb3d51616ba req-4cbda378-03a9-4a47-b185-58bd0a79929e service nova] Lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:18:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-ea10a4ba-f3c2-4062-aa29-cdb3d51616ba req-4cbda378-03a9-4a47-b185-58bd0a79929e service nova] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] No waiting events found dispatching network-vif-plugged-60c06649-bdef-4530-9b11-75cf36406563 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:18:09 user nova-compute[74039]: WARNING nova.compute.manager [req-ea10a4ba-f3c2-4062-aa29-cdb3d51616ba req-4cbda378-03a9-4a47-b185-58bd0a79929e service nova] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Received unexpected event network-vif-plugged-60c06649-bdef-4530-9b11-75cf36406563 for instance with vm_state building and task_state spawning.
Oct 20 09:18:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:11 user nova-compute[74039]: DEBUG nova.compute.manager [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:18:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:18:11 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Instance spawned successfully.
Oct 20 09:18:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:18:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:18:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:18:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:18:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:18:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:18:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:18:11 user nova-compute[74039]: INFO nova.compute.manager [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Took 5.15 seconds to spawn the instance on the hypervisor.
Oct 20 09:18:11 user nova-compute[74039]: DEBUG nova.compute.manager [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:18:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-b0d7eb4a-3997-4ba1-8312-0b21a5db4e06 req-eeb2d8c9-f9fb-4e69-83ac-d5598b97c7e0 service nova] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Received event network-vif-plugged-60c06649-bdef-4530-9b11-75cf36406563 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:18:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b0d7eb4a-3997-4ba1-8312-0b21a5db4e06 req-eeb2d8c9-f9fb-4e69-83ac-d5598b97c7e0 service nova] Acquiring lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:18:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b0d7eb4a-3997-4ba1-8312-0b21a5db4e06 req-eeb2d8c9-f9fb-4e69-83ac-d5598b97c7e0 service nova] Lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:18:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b0d7eb4a-3997-4ba1-8312-0b21a5db4e06 req-eeb2d8c9-f9fb-4e69-83ac-d5598b97c7e0 service nova] Lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:18:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-b0d7eb4a-3997-4ba1-8312-0b21a5db4e06 req-eeb2d8c9-f9fb-4e69-83ac-d5598b97c7e0 service nova] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] No waiting events found dispatching network-vif-plugged-60c06649-bdef-4530-9b11-75cf36406563 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:18:11 user nova-compute[74039]: WARNING nova.compute.manager [req-b0d7eb4a-3997-4ba1-8312-0b21a5db4e06 req-eeb2d8c9-f9fb-4e69-83ac-d5598b97c7e0 service nova] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Received unexpected event network-vif-plugged-60c06649-bdef-4530-9b11-75cf36406563 for instance with vm_state building and task_state spawning.
Oct 20 09:18:11 user nova-compute[74039]: INFO nova.compute.manager [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Took 29.00 seconds to build instance.
Oct 20 09:18:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-98ebce05-596d-418c-b66f-00f88e162557 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.089s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:18:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:18:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:18:23 user nova-compute[74039]: DEBUG nova.objects.instance [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lazy-loading 'flavor' on Instance uuid 69541e4b-dded-4e7c-9cfa-d93f8824179f {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:18:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:18:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:18:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:18:23 user nova-compute[74039]: INFO nova.compute.manager [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Attaching volume edb55988-fb66-491b-8f05-f4a09a6c85c5 to /dev/vdb
Oct 20 09:18:23 user nova-compute[74039]: DEBUG os_brick.utils [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:18:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ef182a-eb73-45fe-9ca8-2127ea3d2ab1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7069767-3bfc-4353-9475-705a2b85141f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[16826f46-0aae-44aa-88f6-05c6fc5c9c31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:23 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3833bed-3e82-4ed6-ad15-3f76e6d5c73c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:18:23 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:18:23 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:24 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:18:24 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:18:24 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d939e32-333e-404c-9bde-d01e3de0fdb2]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:24 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:18:24 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:18:24 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:18:24 user nova-compute[74039]: DEBUG os_brick.utils [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:18:24 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Updating existing volume attachment record: e2698aa0-f240-43dc-ac2f-1c083736ab37 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:18:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:31 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:18:31 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:18:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:18:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:33 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:18:33 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:18:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-bd1f0c3b-32f3-4954-b38d-b57e16259234" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:18:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-bd1f0c3b-32f3-4954-b38d-b57e16259234" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:18:33 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:18:34 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Updating instance_info_cache with network_info: [{"id": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "address": "fa:16:3e:b2:6d:1e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fed849-1f", "ovs_interfaceid": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:18:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-bd1f0c3b-32f3-4954-b38d-b57e16259234" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:18:34 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:18:34 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:18:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:34 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:18:36 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:18:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:37 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:18:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:40 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:18:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hMiFpRAo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:18:40 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:18:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:18:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:18:40 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:18:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:18:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:18:40 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:18:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fd5ef0-ac38-415f-8e3b-8969b529340e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:18:40 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fe197e-d7ab-4387-826f-f8982dfadf76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5] added
Oct 20 09:18:40 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[29eccf9d-5c30-4f9e-a058-9e43dd94cbda]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b706eeeb-86b0-471b-869a-63845332b8f6]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hMiFpRAo {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hMiFpRAo" returned: 0 in 0.032s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf1e8b6-167a-4552-9edd-2d921d8224c3]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hMiFpRAo'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dc01e3-36e4-497a-8542-49f0adb91501]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ce591f-66b0-441c-acec-19f7020f2fd0]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:18:41 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:18:41 user nova-compute[74039]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)
Oct 20 09:18:41 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:18:41 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:18:41 user nova-compute[74039]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)
Oct 20 09:18:41 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40973dd-b647-4414-8b36-e7bd8629f4f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5, portal: 172.16.0.220,3260]
Oct 20 09:18:41 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5, portal: 172.16.0.220,3260] successful.
Oct 20 09:18:41 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e08f09-9d18-4f06-8e02-c990e158eeba]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8302bf-9c88-453f-8200-5ea10f6e172a]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:18:41 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:18:41 user nova-compute[74039]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)
Oct 20 09:18:41 user nova-compute[74039]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 (non-flash)
Oct 20 09:18:41 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:18:41 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:18:41 user nova-compute[74039]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)
Oct 20 09:18:41 user nova-compute[74039]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 (non-flash)
Oct 20 09:18:41 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eebffe-1401-4e84-b57b-34317f8cb1cb]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:18:41 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hMiFpRAo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:18:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:18:42 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23131353637646665', 'path': '/dev/sde'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:18:42 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131353637646665', 'path': '/dev/sde'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:18:42 user nova-compute[74039]: DEBUG nova.objects.instance [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lazy-loading 'flavor' on Instance uuid 69541e4b-dded-4e7c-9cfa-d93f8824179f {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:18:42 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 09:18:42 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:18:42 user nova-compute[74039]:   <source dev="/dev/sde"/>
Oct 20 09:18:42 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:18:42 user nova-compute[74039]:   <serial>edb55988-fb66-491b-8f05-f4a09a6c85c5</serial>
Oct 20 09:18:42 user nova-compute[74039]: </disk>
Oct 20 09:18:42 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 09:18:42 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:18:42 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:18:42 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] No VIF found with MAC fa:16:3e:53:1c:b8, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:18:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:42 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:18:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-86f823f2-37fa-43f6-8f6e-e75c89ca480e tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.116s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquiring lock "c75f37aa-657f-4076-b42b-b716ed608fac" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "c75f37aa-657f-4076-b42b-b716ed608fac" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:18:44 user nova-compute[74039]: INFO nova.compute.manager [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Unshelving
Oct 20 09:18:44 user nova-compute[74039]: INFO nova.virt.block_device [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Booting with volume aabc70a6-44d6-49c8-9503-04ea2a26ead2 at /dev/vda
Oct 20 09:18:44 user nova-compute[74039]: DEBUG os_brick.utils [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c531956d-702b-4216-b005-a50672baa3f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2432ef70-e8f9-4f83-bf0b-32f8dcbf4b86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f17e4e-c4a9-44d4-b90d-737bda31ccf3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be04dbb-3d5d-420e-93dd-88de2316cfd8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:18:44 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:18:44 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[520eaeac-cde5-404a-abbf-9b00e2de6cfa]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG os_brick.utils [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Updating existing volume attachment record: 31bd1b0a-98ba-4be2-9645-9acce4016edd {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:18:44 user nova-compute[74039]: INFO nova.compute.manager [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Detaching volume edb55988-fb66-491b-8f05-f4a09a6c85c5
Oct 20 09:18:44 user nova-compute[74039]: INFO nova.virt.block_device [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Attempting to driver detach volume edb55988-fb66-491b-8f05-f4a09a6c85c5 from mountpoint /dev/vdb
Oct 20 09:18:44 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Attempting to detach device vdb from instance 69541e4b-dded-4e7c-9cfa-d93f8824179f from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:18:44 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:18:44 user nova-compute[74039]:   <source dev="/dev/sde"/>
Oct 20 09:18:44 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:18:44 user nova-compute[74039]:   <serial>edb55988-fb66-491b-8f05-f4a09a6c85c5</serial>
Oct 20 09:18:44 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:18:44 user nova-compute[74039]: </disk>
Oct 20 09:18:44 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:18:44 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Successfully detached device vdb from instance 69541e4b-dded-4e7c-9cfa-d93f8824179f from the persistent domain config.
Oct 20 09:18:44 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 69541e4b-dded-4e7c-9cfa-d93f8824179f from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 09:18:44 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:18:44 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:18:44 user nova-compute[74039]:   <source dev="/dev/sde"/>
Oct 20 09:18:44 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:18:44 user nova-compute[74039]:   <serial>edb55988-fb66-491b-8f05-f4a09a6c85c5</serial>
Oct 20 09:18:44 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:18:44 user nova-compute[74039]: </disk>
Oct 20 09:18:44 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:18:45 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 69541e4b-dded-4e7c-9cfa-d93f8824179f {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 09:18:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:47 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:18:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:18:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:18:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:18:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:18:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:18:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:18:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:18:49 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:18:49 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:18:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8157MB free_disk=25.24042510986328GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:18:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:18:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:18:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:18:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:18:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance d109c52e-1d09-4ed1-9c63-97abcf37ff92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:18:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance bd1f0c3b-32f3-4954-b38d-b57e16259234 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:18:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 69541e4b-dded-4e7c-9cfa-d93f8824179f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:18:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance bf598ec2-bd4c-4bd6-b20e-b11617907c77 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:18:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:18:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c75f37aa-657f-4076-b42b-b716ed608fac has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 09:18:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:18:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:18:50 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:18:50 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:18:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:18:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:18:52 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:18:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:55 user nova-compute[74039]: INFO nova.compute.manager [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Rescuing
Oct 20 09:18:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "refresh_cache-bf598ec2-bd4c-4bd6-b20e-b11617907c77" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:18:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquired lock "refresh_cache-bf598ec2-bd4c-4bd6-b20e-b11617907c77" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:18:55 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:18:55 user nova-compute[74039]: DEBUG nova.network.neutron [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Updating instance_info_cache with network_info: [{"id": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "address": "fa:16:3e:36:1e:50", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb89e6-7b", "ovs_interfaceid": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:18:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Releasing lock "refresh_cache-bf598ec2-bd4c-4bd6-b20e-b11617907c77" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:18:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:56 user nova-compute[74039]: DEBUG nova.compute.manager [req-b2f2041b-0b36-4437-91d0-989c32d82fef req-7f54be1f-ee5f-42bd-85d4-a0977f0e30ee service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received event network-vif-unplugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:18:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b2f2041b-0b36-4437-91d0-989c32d82fef req-7f54be1f-ee5f-42bd-85d4-a0977f0e30ee service nova] Acquiring lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:18:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b2f2041b-0b36-4437-91d0-989c32d82fef req-7f54be1f-ee5f-42bd-85d4-a0977f0e30ee service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:18:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b2f2041b-0b36-4437-91d0-989c32d82fef req-7f54be1f-ee5f-42bd-85d4-a0977f0e30ee service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:18:56 user nova-compute[74039]: DEBUG nova.compute.manager [req-b2f2041b-0b36-4437-91d0-989c32d82fef req-7f54be1f-ee5f-42bd-85d4-a0977f0e30ee service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] No waiting events found dispatching network-vif-unplugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:18:56 user nova-compute[74039]: WARNING nova.compute.manager [req-b2f2041b-0b36-4437-91d0-989c32d82fef req-7f54be1f-ee5f-42bd-85d4-a0977f0e30ee service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received unexpected event network-vif-unplugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 for instance with vm_state active and task_state rescuing.
Oct 20 09:18:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:56 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Instance destroyed successfully.
Oct 20 09:18:56 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Attempting a stable device rescue
Oct 20 09:18:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74039) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 09:18:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Instance directory exists: not creating {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 09:18:56 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Creating image(s)
Oct 20 09:18:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf598ec2-bd4c-4bd6-b20e-b11617907c77/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:18:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "/opt/stack/data/nova/instances/bf598ec2-bd4c-4bd6-b20e-b11617907c77/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:18:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "/opt/stack/data/nova/instances/bf598ec2-bd4c-4bd6-b20e-b11617907c77/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:18:56 user nova-compute[74039]: DEBUG nova.objects.instance [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'trusted_certs' on Instance uuid bf598ec2-bd4c-4bd6-b20e-b11617907c77 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:18:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "30e5f00631d5bb7c68797337b3f0d4a3d83582d8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:18:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "30e5f00631d5bb7c68797337b3f0d4a3d83582d8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:18:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30e5f00631d5bb7c68797337b3f0d4a3d83582d8.part --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:18:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30e5f00631d5bb7c68797337b3f0d4a3d83582d8.part --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:57 user nova-compute[74039]: DEBUG nova.virt.images [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] 41e4f915-005c-4711-91db-a24289bc64c5 was qcow2, converting to raw {{(pid=74039) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 09:18:57 user nova-compute[74039]: DEBUG nova.privsep.utils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74039) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 09:18:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/30e5f00631d5bb7c68797337b3f0d4a3d83582d8.part /opt/stack/data/nova/instances/_base/30e5f00631d5bb7c68797337b3f0d4a3d83582d8.converted {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.compute.manager [req-95b1d77e-82a7-4007-85c4-c7f591243e9a req-6d63b676-d501-42a8-8650-6439e68d0bd1 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received event network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-95b1d77e-82a7-4007-85c4-c7f591243e9a req-6d63b676-d501-42a8-8650-6439e68d0bd1 service nova] Acquiring lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-95b1d77e-82a7-4007-85c4-c7f591243e9a req-6d63b676-d501-42a8-8650-6439e68d0bd1 service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-95b1d77e-82a7-4007-85c4-c7f591243e9a req-6d63b676-d501-42a8-8650-6439e68d0bd1 service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.compute.manager [req-95b1d77e-82a7-4007-85c4-c7f591243e9a req-6d63b676-d501-42a8-8650-6439e68d0bd1 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] No waiting events found dispatching network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:18:58 user nova-compute[74039]: WARNING nova.compute.manager [req-95b1d77e-82a7-4007-85c4-c7f591243e9a req-6d63b676-d501-42a8-8650-6439e68d0bd1 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received unexpected event network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 for instance with vm_state active and task_state rescuing.
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/30e5f00631d5bb7c68797337b3f0d4a3d83582d8.part /opt/stack/data/nova/instances/_base/30e5f00631d5bb7c68797337b3f0d4a3d83582d8.converted" returned: 0 in 0.490s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30e5f00631d5bb7c68797337b3f0d4a3d83582d8.converted --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30e5f00631d5bb7c68797337b3f0d4a3d83582d8.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "30e5f00631d5bb7c68797337b3f0d4a3d83582d8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.009s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "30e5f00631d5bb7c68797337b3f0d4a3d83582d8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "30e5f00631d5bb7c68797337b3f0d4a3d83582d8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30e5f00631d5bb7c68797337b3f0d4a3d83582d8 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/30e5f00631d5bb7c68797337b3f0d4a3d83582d8 --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/30e5f00631d5bb7c68797337b3f0d4a3d83582d8,backing_fmt=raw /opt/stack/data/nova/instances/bf598ec2-bd4c-4bd6-b20e-b11617907c77/disk.rescue {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/30e5f00631d5bb7c68797337b3f0d4a3d83582d8,backing_fmt=raw /opt/stack/data/nova/instances/bf598ec2-bd4c-4bd6-b20e-b11617907c77/disk.rescue" returned: 0 in 0.049s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "30e5f00631d5bb7c68797337b3f0d4a3d83582d8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.objects.instance [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'migration_context' on Instance uuid bf598ec2-bd4c-4bd6-b20e-b11617907c77 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.objects.base [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Object Instance<bf598ec2-bd4c-4bd6-b20e-b11617907c77> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Start _get_guest_xml network_info=[{"id": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "address": "fa:16:3e:36:1e:50", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "vif_mac": "fa:16:3e:36:1e:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb89e6-7b", "ovs_interfaceid": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '41e4f915-005c-4711-91db-a24289bc64c5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd46e07f0-f6f8-4870-9cb0-7efa5eb4f484', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqRfFSvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'bf598ec2-bd4c-4bd6-b20e-b11617907c77', 'attached_at': '', 'detached_at': '', 'volume_id': '0e1aebe0-9d2e-47de-b29b-037e176f3dd9', 'serial': '0e1aebe0-9d2e-47de-b29b-037e176f3dd9'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.objects.instance [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'resources' on Instance uuid bf598ec2-bd4c-4bd6-b20e-b11617907c77 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.objects.base [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Object Instance<bf598ec2-bd4c-4bd6-b20e-b11617907c77> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.objects.instance [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'numa_topology' on Instance uuid bf598ec2-bd4c-4bd6-b20e-b11617907c77 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.objects.base [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Object Instance<bf598ec2-bd4c-4bd6-b20e-b11617907c77> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:18:58 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:18:58 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.objects.instance [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'vcpu_model' on Instance uuid bf598ec2-bd4c-4bd6-b20e-b11617907c77 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.objects.base [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Object Instance<bf598ec2-bd4c-4bd6-b20e-b11617907c77> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqRfFSvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:18:58 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:18:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:18:58 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:18:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:18:58 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d98b45-cf7f-4397-9676-703a28a1ddb3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = YqRfFSvd\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 09:18:58 user nova-compute[74039]: node.name = iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9
Oct 20 09:18:58 user nova-compute[74039]: node.tpgt = -1
Oct 20 09:18:58 user nova-compute[74039]: node.startup = automatic
Oct 20 09:18:58 user nova-compute[74039]: node.leading_login = No
Oct 20 09:18:58 user nova-compute[74039]: iface.iscsi_ifacename = default
Oct 20 09:18:58 user nova-compute[74039]: iface.net_ifacename = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.ipaddress = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.prefix_len = 0
Oct 20 09:18:58 user nova-compute[74039]: iface.hwaddress = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.transport_name = tcp
Oct 20 09:18:58 user nova-compute[74039]: iface.initiatorname = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.state = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.vlan_id = 0
Oct 20 09:18:58 user nova-compute[74039]: iface.vlan_priority = 0
Oct 20 09:18:58 user nova-compute[74039]: iface.vlan_state = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.iface_num = 0
Oct 20 09:18:58 user nova-compute[74039]: iface.mtu = 0
Oct 20 09:18:58 user nova-compute[74039]: iface.port = 0
Oct 20 09:18:58 user nova-compute[74039]: iface.bootproto = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.subnet_mask = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.gateway = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.dhcp_alt_client_id = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.dhcp_dns = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.dhcp_learn_iqn = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.dhcp_vendor_id_state = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.dhcp_vendor_id = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.dhcp_slp_da = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.fragmentation = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.gratuitous_arp = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.incoming_forwarding = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.tos_state = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.tos = 0
Oct 20 09:18:58 user nova-compute[74039]: iface.ttl = 0
Oct 20 09:18:58 user nova-compute[74039]: iface.delayed_ack = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.tcp_nagle = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.tcp_wsf_state = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.tcp_wsf = 0
Oct 20 09:18:58 user nova-compute[74039]: iface.tcp_timer_scale = 0
Oct 20 09:18:58 user nova-compute[74039]: iface.tcp_timestamp = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.redirect = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.def_task_mgmt_timeout = 0
Oct 20 09:18:58 user nova-compute[74039]: iface.header_digest = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.data_digest = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.immediate_data = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.initial_r2t = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.data_seq_inorder = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.data_pdu_inorder = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.erl = 0
Oct 20 09:18:58 user nova-compute[74039]: iface.max_receive_data_len = 0
Oct 20 09:18:58 user nova-compute[74039]: iface.first_burst_len = 0
Oct 20 09:18:58 user nova-compute[74039]: iface.max_outstanding_r2t = 0
Oct 20 09:18:58 user nova-compute[74039]: iface.max_burst_len = 0
Oct 20 09:18:58 user nova-compute[74039]: iface.chap_auth = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.bidi_chap = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.strict_login_compliance = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.discovery_auth = <empty>
Oct 20 09:18:58 user nova-compute[74039]: iface.discovery_logout = <empty>
Oct 20 09:18:58 user nova-compute[74039]: node.discovery_address = <empty>
Oct 20 09:18:58 user nova-compute[74039]: node.discovery_port = 0
Oct 20 09:18:58 user nova-compute[74039]: node.discovery_type = static
Oct 20 09:18:58 user nova-compute[74039]: node.session.initial_cmdsn = 0
Oct 20 09:18:58 user nova-compute[74039]: node.session.initial_login_retry_max = 8
Oct 20 09:18:58 user nova-compute[74039]: node.session.xmit_thread_priority = -20
Oct 20 09:18:58 user nova-compute[74039]: node.session.cmds_max = 128
Oct 20 09:18:58 user nova-compute[74039]: node.session.queue_depth = 32
Oct 20 09:18:58 user nova-compute[74039]: node.session.nr_sessions = 1
Oct 20 09:18:58 user nova-compute[74039]: node.session.auth.authmethod = CHAP
Oct 20 09:18:58 user nova-compute[74039]: node.session.auth.username = YqRfFSvd
Oct 20 09:18:58 user nova-compute[74039]: node.session.auth.password = ***
Oct 20 09:18:58 user nova-compute[74039]: node.session.auth.username_in = <empty>
Oct 20 09:18:58 user nova-compute[74039]: node.session.auth.password_in = <empty>
Oct 20 09:18:58 user nova-compute[74039]: node.session.auth.chap_algs = MD5
Oct 20 09:18:58 user nova-compute[74039]: node.session.timeo.replacement_timeout = 120
Oct 20 09:18:58 user nova-compute[74039]: node.session.err_timeo.abort_timeout = 15
Oct 20 09:18:58 user nova-compute[74039]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 09:18:58 user nova-compute[74039]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 09:18:58 user nova-compute[74039]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 09:18:58 user nova-compute[74039]: node.session.iscsi.FastAbort = Yes
Oct 20 09:18:58 user nova-compute[74039]: node.session.iscsi.InitialR2T = No
Oct 20 09:18:58 user nova-compute[74039]: node.session.iscsi.ImmediateData = Yes
Oct 20 09:18:58 user nova-compute[74039]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 09:18:58 user nova-compute[74039]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 09:18:58 user nova-compute[74039]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 09:18:58 user nova-compute[74039]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 09:18:58 user nova-compute[74039]: node.session.iscsi.MaxConnections = 1
Oct 20 09:18:58 user nova-compute[74039]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 09:18:58 user nova-compute[74039]: node.session.iscsi.ERL = 0
Oct 20 09:18:58 user nova-compute[74039]: node.session.scan = manual
Oct 20 09:18:58 user nova-compute[74039]: node.session.reopen_max = 0
Oct 20 09:18:58 user nova-compute[74039]: node.conn[0].address = 172.16.0.220
Oct 20 09:18:58 user nova-compute[74039]: node.conn[0].port = 3260
Oct 20 09:18:58 user nova-compute[74039]: node.conn[0].startup = manual
Oct 20 09:18:58 user nova-compute[74039]: node.conn[0].tcp.window_size = 524288
Oct 20 09:18:58 user nova-compute[74039]: node.conn[0].tcp.type_of_service = 0
Oct 20 09:18:58 user nova-compute[74039]: node.conn[0].timeo.logout_timeout = 15
Oct 20 09:18:58 user nova-compute[74039]: node.conn[0].timeo.login_timeout = 15
Oct 20 09:18:58 user nova-compute[74039]: node.conn[0].timeo.auth_timeout = 45
Oct 20 09:18:58 user nova-compute[74039]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 09:18:58 user nova-compute[74039]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 09:18:58 user nova-compute[74039]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 09:18:58 user nova-compute[74039]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 09:18:58 user nova-compute[74039]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 09:18:58 user nova-compute[74039]: node.conn[0].iscsi.DataDigest = None
Oct 20 09:18:58 user nova-compute[74039]: node.conn[0].iscsi.IFMarker = No
Oct 20 09:18:58 user nova-compute[74039]: node.conn[0].iscsi.OFMarker = No
Oct 20 09:18:58 user nova-compute[74039]: # END RECORD
Oct 20 09:18:58 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c57f01d-bbf4-4687-9b13-960f7b90f0cb]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef53947-a9af-413d-8daa-175ca087aac0]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YqRfFSvd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YqRfFSvd" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ff63a2-b0ba-48cd-869e-71de329ca62e]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YqRfFSvd'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f615d7-a3aa-4839-8ee9-c59350768a61]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc749072-6426-48fc-8926-779140cb2af5]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:18:59 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:18:59 user nova-compute[74039]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)
Oct 20 09:18:59 user nova-compute[74039]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 (non-flash)
Oct 20 09:18:59 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:18:59 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:18:59 user nova-compute[74039]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)
Oct 20 09:18:59 user nova-compute[74039]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 (non-flash)
Oct 20 09:18:59 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.153s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] HCTL ('33', '0', '0', 0) found on session 47 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[724c4f8f-7da4-440a-a1da-0fc18de25cf7]: (4, ('0 0 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Searching for a device in session 47 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqRfFSvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.178s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] <== connect_volume: return (179ms) {'type': 'block', 'scsi_wwn': '26162666139383537', 'path': '/dev/sdb'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162666139383537', 'path': '/dev/sdb'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:17:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-120225547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-120225547',id=44,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7ed96a82048434fb0d79a55838184e4',ramdisk_id='',reservation_id='r-wsf27t04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:17:43Z,user_data=None,user_id='1e07a52b4e3b4a65b34f71fb2cca8de3',uuid=bf598ec2-bd4c-4bd6-b20e-b11617907c77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "address": "fa:16:3e:36:1e:50", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "vif_mac": "fa:16:3e:36:1e:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb89e6-7b", "ovs_interfaceid": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converting VIF {"id": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "address": "fa:16:3e:36:1e:50", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "vif_mac": "fa:16:3e:36:1e:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb89e6-7b", "ovs_interfaceid": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:1e:50,bridge_name='br-int',has_traffic_filtering=True,id=90bb89e6-7b81-4665-8eac-8979ab44e9d5,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bb89e6-7b') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG nova.objects.instance [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'pci_devices' on Instance uuid bf598ec2-bd4c-4bd6-b20e-b11617907c77 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG nova.objects.base [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Object Instance<bf598ec2-bd4c-4bd6-b20e-b11617907c77> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:18:59 user nova-compute[74039]:   <uuid>bf598ec2-bd4c-4bd6-b20e-b11617907c77</uuid>
Oct 20 09:18:59 user nova-compute[74039]:   <name>instance-0000002c</name>
Oct 20 09:18:59 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:18:59 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:18:59 user nova-compute[74039]:   <metadata>
Oct 20 09:18:59 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:18:59 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:18:59 user nova-compute[74039]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-120225547</nova:name>
Oct 20 09:18:59 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:18:58</nova:creationTime>
Oct 20 09:18:59 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:18:59 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:18:59 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:18:59 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:18:59 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:18:59 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:18:59 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:18:59 user nova-compute[74039]:       <nova:owner>
Oct 20 09:18:59 user nova-compute[74039]:         <nova:user uuid="1e07a52b4e3b4a65b34f71fb2cca8de3">tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member</nova:user>
Oct 20 09:18:59 user nova-compute[74039]:         <nova:project uuid="d7ed96a82048434fb0d79a55838184e4">tempest-ServerBootFromVolumeStableRescueTest-1728924155</nova:project>
Oct 20 09:18:59 user nova-compute[74039]:       </nova:owner>
Oct 20 09:18:59 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:18:59 user nova-compute[74039]:       <nova:ports>
Oct 20 09:18:59 user nova-compute[74039]:         <nova:port uuid="90bb89e6-7b81-4665-8eac-8979ab44e9d5">
Oct 20 09:18:59 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 09:18:59 user nova-compute[74039]:         </nova:port>
Oct 20 09:18:59 user nova-compute[74039]:       </nova:ports>
Oct 20 09:18:59 user nova-compute[74039]:     </nova:instance>
Oct 20 09:18:59 user nova-compute[74039]:   </metadata>
Oct 20 09:18:59 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:18:59 user nova-compute[74039]:     <system>
Oct 20 09:18:59 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:18:59 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:18:59 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:18:59 user nova-compute[74039]:       <entry name="serial">bf598ec2-bd4c-4bd6-b20e-b11617907c77</entry>
Oct 20 09:18:59 user nova-compute[74039]:       <entry name="uuid">bf598ec2-bd4c-4bd6-b20e-b11617907c77</entry>
Oct 20 09:18:59 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:18:59 user nova-compute[74039]:     </system>
Oct 20 09:18:59 user nova-compute[74039]:   </sysinfo>
Oct 20 09:18:59 user nova-compute[74039]:   <os>
Oct 20 09:18:59 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:18:59 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:18:59 user nova-compute[74039]:   </os>
Oct 20 09:18:59 user nova-compute[74039]:   <features>
Oct 20 09:18:59 user nova-compute[74039]:     <acpi/>
Oct 20 09:18:59 user nova-compute[74039]:     <apic/>
Oct 20 09:18:59 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:18:59 user nova-compute[74039]:   </features>
Oct 20 09:18:59 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:18:59 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:18:59 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:18:59 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:18:59 user nova-compute[74039]:   </clock>
Oct 20 09:18:59 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:18:59 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:18:59 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:18:59 user nova-compute[74039]:   </cpu>
Oct 20 09:18:59 user nova-compute[74039]:   <devices>
Oct 20 09:18:59 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 09:18:59 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:18:59 user nova-compute[74039]:       <source dev="/dev/sdb"/>
Oct 20 09:18:59 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:18:59 user nova-compute[74039]:       <serial>0e1aebe0-9d2e-47de-b29b-037e176f3dd9</serial>
Oct 20 09:18:59 user nova-compute[74039]:     </disk>
Oct 20 09:18:59 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:18:59 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:18:59 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/bf598ec2-bd4c-4bd6-b20e-b11617907c77/disk.rescue"/>
Oct 20 09:18:59 user nova-compute[74039]:       <target dev="vdb" bus="virtio"/>
Oct 20 09:18:59 user nova-compute[74039]:       <boot order="1"/>
Oct 20 09:18:59 user nova-compute[74039]:     </disk>
Oct 20 09:18:59 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:18:59 user nova-compute[74039]:       <mac address="fa:16:3e:36:1e:50"/>
Oct 20 09:18:59 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:18:59 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:18:59 user nova-compute[74039]:       <target dev="tap90bb89e6-7b"/>
Oct 20 09:18:59 user nova-compute[74039]:     </interface>
Oct 20 09:18:59 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:18:59 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/bf598ec2-bd4c-4bd6-b20e-b11617907c77/console.log" append="off"/>
Oct 20 09:18:59 user nova-compute[74039]:     </serial>
Oct 20 09:18:59 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:18:59 user nova-compute[74039]:     <video>
Oct 20 09:18:59 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:18:59 user nova-compute[74039]:     </video>
Oct 20 09:18:59 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:18:59 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:18:59 user nova-compute[74039]:     </rng>
Oct 20 09:18:59 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:18:59 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:18:59 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:18:59 user nova-compute[74039]:     </memballoon>
Oct 20 09:18:59 user nova-compute[74039]:   </devices>
Oct 20 09:18:59 user nova-compute[74039]: </domain>
Oct 20 09:18:59 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:18:59 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Instance destroyed successfully.
Oct 20 09:18:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:18:59 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] No VIF found with MAC fa:16:3e:36:1e:50, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:19:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-7905594d-7e24-413d-9f7e-6e1a1b49bd43 req-46859d29-86b1-4866-8818-40b1b764ca49 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received event network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:19:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7905594d-7e24-413d-9f7e-6e1a1b49bd43 req-46859d29-86b1-4866-8818-40b1b764ca49 service nova] Acquiring lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:19:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7905594d-7e24-413d-9f7e-6e1a1b49bd43 req-46859d29-86b1-4866-8818-40b1b764ca49 service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:19:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7905594d-7e24-413d-9f7e-6e1a1b49bd43 req-46859d29-86b1-4866-8818-40b1b764ca49 service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:19:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-7905594d-7e24-413d-9f7e-6e1a1b49bd43 req-46859d29-86b1-4866-8818-40b1b764ca49 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] No waiting events found dispatching network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:19:00 user nova-compute[74039]: WARNING nova.compute.manager [req-7905594d-7e24-413d-9f7e-6e1a1b49bd43 req-46859d29-86b1-4866-8818-40b1b764ca49 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received unexpected event network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 for instance with vm_state active and task_state rescuing.
Oct 20 09:19:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:19:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:19:01 user nova-compute[74039]: DEBUG nova.objects.instance [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lazy-loading 'pci_requests' on Instance uuid c75f37aa-657f-4076-b42b-b716ed608fac {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:19:01 user nova-compute[74039]: DEBUG nova.objects.instance [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lazy-loading 'numa_topology' on Instance uuid c75f37aa-657f-4076-b42b-b716ed608fac {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:19:01 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:19:01 user nova-compute[74039]: INFO nova.compute.claims [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Claim successful on node user
Oct 20 09:19:02 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:19:02 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:19:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.610s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:19:02 user nova-compute[74039]: INFO nova.network.neutron [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Updating port c1e04f2d-ef5c-4de2-831e-28d7339feba3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 09:19:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:02 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f2a594d2-95b6-4b92-99b2-db5e52261ed8 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:19:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-76e563c5-d4ab-48c2-9885-00f500f3391f req-fe8fd54c-7a3d-452e-aad6-a0fd7d9e32a0 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received event network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:19:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-76e563c5-d4ab-48c2-9885-00f500f3391f req-fe8fd54c-7a3d-452e-aad6-a0fd7d9e32a0 service nova] Acquiring lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:19:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-76e563c5-d4ab-48c2-9885-00f500f3391f req-fe8fd54c-7a3d-452e-aad6-a0fd7d9e32a0 service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:19:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-76e563c5-d4ab-48c2-9885-00f500f3391f req-fe8fd54c-7a3d-452e-aad6-a0fd7d9e32a0 service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:19:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-76e563c5-d4ab-48c2-9885-00f500f3391f req-fe8fd54c-7a3d-452e-aad6-a0fd7d9e32a0 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] No waiting events found dispatching network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:19:02 user nova-compute[74039]: WARNING nova.compute.manager [req-76e563c5-d4ab-48c2-9885-00f500f3391f req-fe8fd54c-7a3d-452e-aad6-a0fd7d9e32a0 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received unexpected event network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 for instance with vm_state rescued and task_state None.
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquiring lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquired lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.network.neutron [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.compute.manager [req-715a7fe1-7379-4cc4-91b6-224d1c0d93ae req-b1a65f2f-fc79-4348-a0ed-ff8f99fe4395 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received event network-changed-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.compute.manager [req-715a7fe1-7379-4cc4-91b6-224d1c0d93ae req-b1a65f2f-fc79-4348-a0ed-ff8f99fe4395 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Refreshing instance network info cache due to event network-changed-c1e04f2d-ef5c-4de2-831e-28d7339feba3. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-715a7fe1-7379-4cc4-91b6-224d1c0d93ae req-b1a65f2f-fc79-4348-a0ed-ff8f99fe4395 service nova] Acquiring lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.network.neutron [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Updating instance_info_cache with network_info: [{"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Releasing lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:19:03 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Creating image(s)
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Did not create local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Ensure instance console log exists: /opt/stack/data/nova/instances/c75f37aa-657f-4076-b42b-b716ed608fac/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Start _get_guest_xml network_info=[{"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '31bd1b0a-98ba-4be2-9645-9acce4016edd', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfPWirVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c75f37aa-657f-4076-b42b-b716ed608fac', 'attached_at': '', 'detached_at': '', 'volume_id': 'aabc70a6-44d6-49c8-9503-04ea2a26ead2', 'serial': 'aabc70a6-44d6-49c8-9503-04ea2a26ead2'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-715a7fe1-7379-4cc4-91b6-224d1c0d93ae req-b1a65f2f-fc79-4348-a0ed-ff8f99fe4395 service nova] Acquired lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.network.neutron [req-715a7fe1-7379-4cc4-91b6-224d1c0d93ae req-b1a65f2f-fc79-4348-a0ed-ff8f99fe4395 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Refreshing network info cache for port c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:19:03 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:19:03 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.objects.instance [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lazy-loading 'vcpu_model' on Instance uuid c75f37aa-657f-4076-b42b-b716ed608fac {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.objects.base [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Object Instance<c75f37aa-657f-4076-b42b-b716ed608fac> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfPWirVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:19:03 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:19:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:19:03 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:19:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:19:03 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce01e97-9431-4426-9021-8f7c4e04a96b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:19:03 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b342ae-af4f-4bee-b53c-144bfeb39eda]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2] added
Oct 20 09:19:03 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e059d50-950a-4b21-97d9-940bf37fb092]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be502a7-57fa-4dee-9129-18598526aafb]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MfPWirVa {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MfPWirVa" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a1f20e-8d5e-4306-a54d-c229b128e1cd]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MfPWirVa'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1994e6c-916f-4853-8408-db9160b096ca]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e672813-9fc2-46ef-8772-f8b817382d43]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:19:03 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:19:03 user nova-compute[74039]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)
Oct 20 09:19:03 user nova-compute[74039]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 (non-flash)
Oct 20 09:19:03 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:19:03 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:19:03 user nova-compute[74039]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)
Oct 20 09:19:03 user nova-compute[74039]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 (non-flash)
Oct 20 09:19:03 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:19:03 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2a6500-6179-449a-a893-daddf5890b13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2, portal: 172.16.0.220,3260]
Oct 20 09:19:04 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2, portal: 172.16.0.220,3260] successful.
Oct 20 09:19:04 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[937feb6b-17dc-40c3-a0b2-65ca7ddc5b2f]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2d9d2d-e1ad-4456-8ad3-2f26a3cbb220]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:19:04 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:19:04 user nova-compute[74039]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)
Oct 20 09:19:04 user nova-compute[74039]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 (non-flash)
Oct 20 09:19:04 user nova-compute[74039]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)
Oct 20 09:19:04 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:19:04 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:19:04 user nova-compute[74039]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)
Oct 20 09:19:04 user nova-compute[74039]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 (non-flash)
Oct 20 09:19:04 user nova-compute[74039]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)
Oct 20 09:19:04 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] HCTL ('37', '-', '-', 0) found on session 50 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e92d66d-f158-4e3e-8843-4b8ecec1afa1]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Searching for a device in session 50 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfPWirVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG nova.network.neutron [req-715a7fe1-7379-4cc4-91b6-224d1c0d93ae req-b1a65f2f-fc79-4348-a0ed-ff8f99fe4395 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Updated VIF entry in instance network info cache for port c1e04f2d-ef5c-4de2-831e-28d7339feba3. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG nova.network.neutron [req-715a7fe1-7379-4cc4-91b6-224d1c0d93ae req-b1a65f2f-fc79-4348-a0ed-ff8f99fe4395 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Updating instance_info_cache with network_info: [{"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-715a7fe1-7379-4cc4-91b6-224d1c0d93ae req-b1a65f2f-fc79-4348-a0ed-ff8f99fe4395 service nova] Releasing lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:19:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23862666264636330', 'path': '/dev/sdf'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862666264636330', 'path': '/dev/sdf'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T09:14:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-614706847',display_name='tempest-TestShelveInstance-server-614706847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-614706847',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1056844604',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:15:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='91d6aa3596714916a466942e5e43ae2e',ramdisk_id='',reservation_id='r-zp3vbwnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1029412800',owner_user_name='tempest-TestShelveInstance-1029412800-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:18:44Z,user_data=None,user_id='80e383c8e1544ecebd906c182383eb60',uuid=c75f37aa-657f-4076-b42b-b716ed608fac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Converting VIF {"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c8:18,bridge_name='br-int',has_traffic_filtering=True,id=c1e04f2d-ef5c-4de2-831e-28d7339feba3,network=Network(c6342f79-d0fd-46a8-86e4-013c32691c72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1e04f2d-ef') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG nova.objects.instance [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lazy-loading 'pci_devices' on Instance uuid c75f37aa-657f-4076-b42b-b716ed608fac {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG nova.objects.base [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Object Instance<c75f37aa-657f-4076-b42b-b716ed608fac> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:19:05 user nova-compute[74039]:   <uuid>c75f37aa-657f-4076-b42b-b716ed608fac</uuid>
Oct 20 09:19:05 user nova-compute[74039]:   <name>instance-0000002a</name>
Oct 20 09:19:05 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:19:05 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:19:05 user nova-compute[74039]:   <metadata>
Oct 20 09:19:05 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:19:05 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:19:05 user nova-compute[74039]:       <nova:name>tempest-TestShelveInstance-server-614706847</nova:name>
Oct 20 09:19:05 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:19:03</nova:creationTime>
Oct 20 09:19:05 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:19:05 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:19:05 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:19:05 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:19:05 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:19:05 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:19:05 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:19:05 user nova-compute[74039]:       <nova:owner>
Oct 20 09:19:05 user nova-compute[74039]:         <nova:user uuid="80e383c8e1544ecebd906c182383eb60">tempest-TestShelveInstance-1029412800-project-member</nova:user>
Oct 20 09:19:05 user nova-compute[74039]:         <nova:project uuid="91d6aa3596714916a466942e5e43ae2e">tempest-TestShelveInstance-1029412800</nova:project>
Oct 20 09:19:05 user nova-compute[74039]:       </nova:owner>
Oct 20 09:19:05 user nova-compute[74039]:       <nova:ports>
Oct 20 09:19:05 user nova-compute[74039]:         <nova:port uuid="c1e04f2d-ef5c-4de2-831e-28d7339feba3">
Oct 20 09:19:05 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 09:19:05 user nova-compute[74039]:         </nova:port>
Oct 20 09:19:05 user nova-compute[74039]:       </nova:ports>
Oct 20 09:19:05 user nova-compute[74039]:     </nova:instance>
Oct 20 09:19:05 user nova-compute[74039]:   </metadata>
Oct 20 09:19:05 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:19:05 user nova-compute[74039]:     <system>
Oct 20 09:19:05 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:19:05 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:19:05 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:19:05 user nova-compute[74039]:       <entry name="serial">c75f37aa-657f-4076-b42b-b716ed608fac</entry>
Oct 20 09:19:05 user nova-compute[74039]:       <entry name="uuid">c75f37aa-657f-4076-b42b-b716ed608fac</entry>
Oct 20 09:19:05 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:19:05 user nova-compute[74039]:     </system>
Oct 20 09:19:05 user nova-compute[74039]:   </sysinfo>
Oct 20 09:19:05 user nova-compute[74039]:   <os>
Oct 20 09:19:05 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:19:05 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:19:05 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:19:05 user nova-compute[74039]:   </os>
Oct 20 09:19:05 user nova-compute[74039]:   <features>
Oct 20 09:19:05 user nova-compute[74039]:     <acpi/>
Oct 20 09:19:05 user nova-compute[74039]:     <apic/>
Oct 20 09:19:05 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:19:05 user nova-compute[74039]:   </features>
Oct 20 09:19:05 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:19:05 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:19:05 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:19:05 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:19:05 user nova-compute[74039]:   </clock>
Oct 20 09:19:05 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:19:05 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:19:05 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:19:05 user nova-compute[74039]:   </cpu>
Oct 20 09:19:05 user nova-compute[74039]:   <devices>
Oct 20 09:19:05 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 09:19:05 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:19:05 user nova-compute[74039]:       <source dev="/dev/sdf"/>
Oct 20 09:19:05 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:19:05 user nova-compute[74039]:       <serial>aabc70a6-44d6-49c8-9503-04ea2a26ead2</serial>
Oct 20 09:19:05 user nova-compute[74039]:     </disk>
Oct 20 09:19:05 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:19:05 user nova-compute[74039]:       <mac address="fa:16:3e:e2:c8:18"/>
Oct 20 09:19:05 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:19:05 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:19:05 user nova-compute[74039]:       <target dev="tapc1e04f2d-ef"/>
Oct 20 09:19:05 user nova-compute[74039]:     </interface>
Oct 20 09:19:05 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:19:05 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/c75f37aa-657f-4076-b42b-b716ed608fac/console.log" append="off"/>
Oct 20 09:19:05 user nova-compute[74039]:     </serial>
Oct 20 09:19:05 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:19:05 user nova-compute[74039]:     <video>
Oct 20 09:19:05 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:19:05 user nova-compute[74039]:     </video>
Oct 20 09:19:05 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:19:05 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:19:05 user nova-compute[74039]:     </rng>
Oct 20 09:19:05 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:19:05 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:19:05 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:19:05 user nova-compute[74039]:     </memballoon>
Oct 20 09:19:05 user nova-compute[74039]:   </devices>
Oct 20 09:19:05 user nova-compute[74039]: </domain>
Oct 20 09:19:05 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T09:14:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-614706847',display_name='tempest-TestShelveInstance-server-614706847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-614706847',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1056844604',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:15:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='91d6aa3596714916a466942e5e43ae2e',ramdisk_id='',reservation_id='r-zp3vbwnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1029412800',owner_user_name='tempest-TestShelveInstance-1029412800-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:18:44Z,user_data=None,user_id='80e383c8e1544ecebd906c182383eb60',uuid=c75f37aa-657f-4076-b42b-b716ed608fac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Converting VIF {"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c8:18,bridge_name='br-int',has_traffic_filtering=True,id=c1e04f2d-ef5c-4de2-831e-28d7339feba3,network=Network(c6342f79-d0fd-46a8-86e4-013c32691c72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1e04f2d-ef') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_vif [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c8:18,bridge_name='br-int',has_traffic_filtering=True,id=c1e04f2d-ef5c-4de2-831e-28d7339feba3,network=Network(c6342f79-d0fd-46a8-86e4-013c32691c72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1e04f2d-ef') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '78576c1b-0bd0-5c5a-8458-1f40432d8565', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1e04f2d-ef, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1e04f2d-ef, col_values=(('qos', UUID('5a291320-1d6e-43d3-a853-ec7a5d1ec3e1')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1e04f2d-ef, col_values=(('external_ids', {'iface-id': 'c1e04f2d-ef5c-4de2-831e-28d7339feba3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:c8:18', 'vm-uuid': 'c75f37aa-657f-4076-b42b-b716ed608fac'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:05 user nova-compute[74039]: INFO os_vif [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c8:18,bridge_name='br-int',has_traffic_filtering=True,id=c1e04f2d-ef5c-4de2-831e-28d7339feba3,network=Network(c6342f79-d0fd-46a8-86e4-013c32691c72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1e04f2d-ef')
Oct 20 09:19:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] No VIF found with MAC fa:16:3e:e2:c8:18, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:19:05 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 69541e4b-dded-4e7c-9cfa-d93f8824179f is timed out.
Oct 20 09:19:05 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Successfully detached device vdb from instance 69541e4b-dded-4e7c-9cfa-d93f8824179f from the live domain config.
Oct 20 09:19:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hMiFpRAo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:19:05 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c1bad2-18a6-46b7-aedf-d24e25df4a18]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:19:05 user nova-compute[74039]: No targets found.
Oct 20 09:19:05 user nova-compute[74039]: iSNS:
Oct 20 09:19:05 user nova-compute[74039]: No targets found.
Oct 20 09:19:05 user nova-compute[74039]: STATIC:
Oct 20 09:19:05 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14
Oct 20 09:19:05 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:19:05 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:19:05 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2
Oct 20 09:19:05 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:19:05 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:19:05 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735
Oct 20 09:19:05 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:19:05 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:19:05 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9
Oct 20 09:19:05 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:19:05 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:19:05 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5
Oct 20 09:19:05 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:19:05 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:19:05 user nova-compute[74039]: FIRMWARE:
Oct 20 09:19:05 user nova-compute[74039]: No targets found.
Oct 20 09:19:05 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:19:05 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:19:05 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c924f4f-e198-4996-8679-4e84682160c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[753102d4-c83e-4120-bb9e-3ba5ba08184c]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:19:05 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:19:05 user nova-compute[74039]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)
Oct 20 09:19:05 user nova-compute[74039]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 (non-flash)
Oct 20 09:19:05 user nova-compute[74039]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)
Oct 20 09:19:05 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:19:05 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:19:05 user nova-compute[74039]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)
Oct 20 09:19:05 user nova-compute[74039]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 (non-flash)
Oct 20 09:19:05 user nova-compute[74039]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)
Oct 20 09:19:05 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae6c4c17e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5'): ({'sde'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Removing single pathed devices sde {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bc98bf-27ff-45cd-bac6-5848480b31fd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb6d5ae-38d8-41a9-ad8f-55056ef1360a]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Flushing IO for device /dev/sde {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d668fe-cb34-4359-9225-9d09bfa2e7f0]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f55a93-778f-4f74-af48-6bd75c70cd32]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] SCSI volumes sde have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9150b2bc-49ec-481a-be1f-f2649a3eb727]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[516e2ec6-d1c8-4720-874c-3bfd80837d7b]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5, portal: 172.16.0.220,3260]
Oct 20 09:19:05 user nova-compute[74039]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5, portal: 172.16.0.220,3260] successful.
Oct 20 09:19:05 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb55988-fb66-491b-8f05-f4a09a6c85c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fefd14b-4be7-4596-89fb-75f105789524]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] <== disconnect_volume: return (326ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:19:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:19:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:06 user nova-compute[74039]: DEBUG nova.objects.instance [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lazy-loading 'flavor' on Instance uuid 69541e4b-dded-4e7c-9cfa-d93f8824179f {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:19:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fb0c75aa-0673-4720-a668-e79e644e79db tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.902s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:19:06 user nova-compute[74039]: DEBUG nova.compute.manager [req-79de8730-d2a5-43cb-9d24-3001338f39d2 req-71c6a4c3-1b4b-4c06-80d4-d14643fc1258 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received event network-vif-plugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:19:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-79de8730-d2a5-43cb-9d24-3001338f39d2 req-71c6a4c3-1b4b-4c06-80d4-d14643fc1258 service nova] Acquiring lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:19:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-79de8730-d2a5-43cb-9d24-3001338f39d2 req-71c6a4c3-1b4b-4c06-80d4-d14643fc1258 service nova] Lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:19:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-79de8730-d2a5-43cb-9d24-3001338f39d2 req-71c6a4c3-1b4b-4c06-80d4-d14643fc1258 service nova] Lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:19:06 user nova-compute[74039]: DEBUG nova.compute.manager [req-79de8730-d2a5-43cb-9d24-3001338f39d2 req-71c6a4c3-1b4b-4c06-80d4-d14643fc1258 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] No waiting events found dispatching network-vif-plugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:19:06 user nova-compute[74039]: WARNING nova.compute.manager [req-79de8730-d2a5-43cb-9d24-3001338f39d2 req-71c6a4c3-1b4b-4c06-80d4-d14643fc1258 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received unexpected event network-vif-plugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 09:19:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:08 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:19:08 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:19:08 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Instance spawned successfully.
Oct 20 09:19:08 user nova-compute[74039]: DEBUG nova.compute.manager [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:19:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-b969041a-aafb-4a28-a1a2-46f51d3527e5 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "c75f37aa-657f-4076-b42b-b716ed608fac" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.753s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:19:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-30b4fdbd-dca1-4193-9209-4c0e7e33ec1a req-f1fad2d3-0c9c-4cc4-ba1d-119b94d6d81b service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received event network-vif-plugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:19:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-30b4fdbd-dca1-4193-9209-4c0e7e33ec1a req-f1fad2d3-0c9c-4cc4-ba1d-119b94d6d81b service nova] Acquiring lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:19:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-30b4fdbd-dca1-4193-9209-4c0e7e33ec1a req-f1fad2d3-0c9c-4cc4-ba1d-119b94d6d81b service nova] Lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:19:08 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-30b4fdbd-dca1-4193-9209-4c0e7e33ec1a req-f1fad2d3-0c9c-4cc4-ba1d-119b94d6d81b service nova] Lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:19:08 user nova-compute[74039]: DEBUG nova.compute.manager [req-30b4fdbd-dca1-4193-9209-4c0e7e33ec1a req-f1fad2d3-0c9c-4cc4-ba1d-119b94d6d81b service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] No waiting events found dispatching network-vif-plugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:19:08 user nova-compute[74039]: WARNING nova.compute.manager [req-30b4fdbd-dca1-4193-9209-4c0e7e33ec1a req-f1fad2d3-0c9c-4cc4-ba1d-119b94d6d81b service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received unexpected event network-vif-plugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 for instance with vm_state active and task_state None.
Oct 20 09:19:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:30 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:19:30 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:19:30 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:19:33 user nova-compute[74039]: INFO nova.compute.manager [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Terminating instance
Oct 20 09:19:33 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG nova.compute.manager [req-2efeeecc-e719-4acb-820d-f45aef75fe7d req-7dee8bc3-e36e-4489-8cc2-3febbcccb868 service nova] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Received event network-vif-unplugged-60c06649-bdef-4530-9b11-75cf36406563 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2efeeecc-e719-4acb-820d-f45aef75fe7d req-7dee8bc3-e36e-4489-8cc2-3febbcccb868 service nova] Acquiring lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2efeeecc-e719-4acb-820d-f45aef75fe7d req-7dee8bc3-e36e-4489-8cc2-3febbcccb868 service nova] Lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2efeeecc-e719-4acb-820d-f45aef75fe7d req-7dee8bc3-e36e-4489-8cc2-3febbcccb868 service nova] Lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG nova.compute.manager [req-2efeeecc-e719-4acb-820d-f45aef75fe7d req-7dee8bc3-e36e-4489-8cc2-3febbcccb868 service nova] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] No waiting events found dispatching network-vif-unplugged-60c06649-bdef-4530-9b11-75cf36406563 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG nova.compute.manager [req-2efeeecc-e719-4acb-820d-f45aef75fe7d req-7dee8bc3-e36e-4489-8cc2-3febbcccb868 service nova] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Received event network-vif-unplugged-60c06649-bdef-4530-9b11-75cf36406563 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:19:33 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Instance destroyed successfully.
Oct 20 09:19:33 user nova-compute[74039]: DEBUG nova.objects.instance [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lazy-loading 'resources' on Instance uuid 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:17:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1265792638',display_name='tempest-TestVolumeBootPattern-server-1265792638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1265792638',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:18:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='367334c57f8f47b696a477460afba369',ramdisk_id='',reservation_id='r-rqc6ge82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1725287482',owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:18:11Z,user_data=None,user_id='8d68ed2131b34e57a5f10a01409fee62',uuid=3d5cd514-9b82-4a1a-8bc9-570b2f7cf822,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60c06649-bdef-4530-9b11-75cf36406563", "address": "fa:16:3e:e2:4e:8c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c06649-bd", "ovs_interfaceid": "60c06649-bdef-4530-9b11-75cf36406563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converting VIF {"id": "60c06649-bdef-4530-9b11-75cf36406563", "address": "fa:16:3e:e2:4e:8c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c06649-bd", "ovs_interfaceid": "60c06649-bdef-4530-9b11-75cf36406563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4e:8c,bridge_name='br-int',has_traffic_filtering=True,id=60c06649-bdef-4530-9b11-75cf36406563,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c06649-bd') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG os_vif [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4e:8c,bridge_name='br-int',has_traffic_filtering=True,id=60c06649-bdef-4530-9b11-75cf36406563,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c06649-bd') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60c06649-bd, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ce830d7-a83f-4127-8491-713c8213bea5) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:19:33 user nova-compute[74039]: INFO os_vif [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4e:8c,bridge_name='br-int',has_traffic_filtering=True,id=60c06649-bdef-4530-9b11-75cf36406563,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c06649-bd')
Oct 20 09:19:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HIfZcPVk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:19:33 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:19:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6fde03-da6c-401f-9b07-9f66c830222c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:19:33 user nova-compute[74039]: No targets found.
Oct 20 09:19:33 user nova-compute[74039]: iSNS:
Oct 20 09:19:33 user nova-compute[74039]: No targets found.
Oct 20 09:19:33 user nova-compute[74039]: STATIC:
Oct 20 09:19:33 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14
Oct 20 09:19:33 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:19:33 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:19:33 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2
Oct 20 09:19:33 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:19:33 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:19:33 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735
Oct 20 09:19:33 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:19:33 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:19:33 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9
Oct 20 09:19:33 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:19:33 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:19:33 user nova-compute[74039]: FIRMWARE:
Oct 20 09:19:33 user nova-compute[74039]: No targets found.
Oct 20 09:19:33 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:19:33 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:19:33 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-69541e4b-dded-4e7c-9cfa-d93f8824179f" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-69541e4b-dded-4e7c-9cfa-d93f8824179f" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c455e0-c8f8-4113-af2d-f9cfca466311]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39ee389-7a5a-4cdd-b8b9-95cc7d8b03d3]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:19:33 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:19:33 user nova-compute[74039]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)
Oct 20 09:19:33 user nova-compute[74039]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)
Oct 20 09:19:33 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:19:33 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:19:33 user nova-compute[74039]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 (non-flash)
Oct 20 09:19:33 user nova-compute[74039]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)
Oct 20 09:19:33 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae84411bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735'): ({'sdd'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Removing single pathed devices sdd {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[251ac802-d0cd-4167-af35-c7d1b1b5f27c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[512ba98d-84f4-47ee-8c7f-8bb9139bf4ca]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Flushing IO for device /dev/sdd {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:19:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[667d3926-23ee-4cb1-8b50-d086a4554a7f]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82a6590-1c57-466a-9596-04b01ff6ba01]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_71f21904', '/dev/disk/by-id/scsi-1SCST_BIO71f21904-64ed3baeda45f8b6', '/dev/disk/by-id/scsi-23634656433626165') {{(pid=85466) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf17dec-5786-4d87-98b6-29d87e15c874]: (4, None) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bafe38-7220-4c14-8cb2-0d174a5cb247]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed107207-8d71-46eb-b575-85e08ecbeeaf]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735, portal: 172.16.0.220,3260]
Oct 20 09:19:34 user nova-compute[74039]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735, portal: 172.16.0.220,3260] successful.
Oct 20 09:19:34 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6dbaaf-be2c-4b8d-870c-3f542e1d3852]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] <== disconnect_volume: return (358ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:19:34 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Deleting instance files /opt/stack/data/nova/instances/3d5cd514-9b82-4a1a-8bc9-570b2f7cf822_del
Oct 20 09:19:34 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Deletion of /opt/stack/data/nova/instances/3d5cd514-9b82-4a1a-8bc9-570b2f7cf822_del complete
Oct 20 09:19:34 user nova-compute[74039]: INFO nova.compute.manager [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Took 1.25 seconds to destroy the instance on the hypervisor.
Oct 20 09:19:34 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Updating instance_info_cache with network_info: [{"id": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "address": "fa:16:3e:53:1c:b8", "network": {"id": "4cdbb359-74da-4e4d-a725-6f0ce82cc435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1113356046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173c1e40b30c479292dd4f96e61bb72b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bf552c-41", "ovs_interfaceid": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-69541e4b-dded-4e7c-9cfa-d93f8824179f" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:19:34 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:19:34 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Took 0.47 seconds to deallocate network for instance.
Oct 20 09:19:35 user nova-compute[74039]: DEBUG nova.compute.manager [req-d6dcae1f-a613-4222-b843-be56289cdcc9 req-68264cb7-a30e-4e55-ab5a-8bca5a5ef839 service nova] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Received event network-vif-plugged-60c06649-bdef-4530-9b11-75cf36406563 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:19:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d6dcae1f-a613-4222-b843-be56289cdcc9 req-68264cb7-a30e-4e55-ab5a-8bca5a5ef839 service nova] Acquiring lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:19:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d6dcae1f-a613-4222-b843-be56289cdcc9 req-68264cb7-a30e-4e55-ab5a-8bca5a5ef839 service nova] Lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:19:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d6dcae1f-a613-4222-b843-be56289cdcc9 req-68264cb7-a30e-4e55-ab5a-8bca5a5ef839 service nova] Lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:19:35 user nova-compute[74039]: DEBUG nova.compute.manager [req-d6dcae1f-a613-4222-b843-be56289cdcc9 req-68264cb7-a30e-4e55-ab5a-8bca5a5ef839 service nova] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] No waiting events found dispatching network-vif-plugged-60c06649-bdef-4530-9b11-75cf36406563 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:19:35 user nova-compute[74039]: WARNING nova.compute.manager [req-d6dcae1f-a613-4222-b843-be56289cdcc9 req-68264cb7-a30e-4e55-ab5a-8bca5a5ef839 service nova] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Received unexpected event network-vif-plugged-60c06649-bdef-4530-9b11-75cf36406563 for instance with vm_state active and task_state deleting.
Oct 20 09:19:35 user nova-compute[74039]: DEBUG nova.compute.manager [req-d6dcae1f-a613-4222-b843-be56289cdcc9 req-68264cb7-a30e-4e55-ab5a-8bca5a5ef839 service nova] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Received event network-vif-deleted-60c06649-bdef-4530-9b11-75cf36406563 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:19:35 user nova-compute[74039]: INFO nova.compute.manager [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Took 0.81 seconds to detach 1 volumes for instance.
Oct 20 09:19:35 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822] Deleting volume: 8bc9e2c5-a0d3-4640-8e04-84d86d8b5735 {{(pid=74039) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 09:19:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:19:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:19:35 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:19:35 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:19:35 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:19:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:19:36 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Deleted allocations for instance 3d5cd514-9b82-4a1a-8bc9-570b2f7cf822
Oct 20 09:19:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f252ad35-2070-4722-9f4f-d19035ccb634 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "3d5cd514-9b82-4a1a-8bc9-570b2f7cf822" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.090s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:19:36 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:19:38 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:19:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG nova.objects.instance [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lazy-loading 'flavor' on Instance uuid 69541e4b-dded-4e7c-9cfa-d93f8824179f {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:19:40 user nova-compute[74039]: INFO nova.compute.manager [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Attaching volume d2d0f34f-6e0f-4d8f-a335-844665a02c8a to /dev/vdb
Oct 20 09:19:40 user nova-compute[74039]: DEBUG os_brick.utils [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d32a57-2ea9-433c-a1a4-ed29bc06c78f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[695005db-987c-462a-90b1-203c1126bb6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef4d633-fc98-4f30-b0b5-6b7c6a752003]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[68846982-6c47-4e26-8619-f4475516604f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:19:40 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:19:40 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[874f41cc-d9dc-4e7f-a1b8-0adea93bf9ba]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG os_brick.utils [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:19:40 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Updating existing volume attachment record: a268681e-88e0-47e8-b1e0-38cd06beaa78 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:19:42 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:19:42 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Cleaning up deleted instances {{(pid=74039) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 09:19:42 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] There are 0 instances to clean {{(pid=74039) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 09:19:43 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:19:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:47 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:19:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:19:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:19:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:19:47 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:19:47 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:19:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:19:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:19:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf598ec2-bd4c-4bd6-b20e-b11617907c77/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf598ec2-bd4c-4bd6-b20e-b11617907c77/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf598ec2-bd4c-4bd6-b20e-b11617907c77/disk.rescue --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:19:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf598ec2-bd4c-4bd6-b20e-b11617907c77/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:19:50 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:19:50 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:19:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8099MB free_disk=25.14196014404297GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:19:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:19:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:19:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:19:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:19:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance d109c52e-1d09-4ed1-9c63-97abcf37ff92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:19:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance bd1f0c3b-32f3-4954-b38d-b57e16259234 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:19:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 69541e4b-dded-4e7c-9cfa-d93f8824179f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:19:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance bf598ec2-bd4c-4bd6-b20e-b11617907c77 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:19:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c75f37aa-657f-4076-b42b-b716ed608fac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:19:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:19:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:19:50 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:19:50 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:19:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:19:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:19:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:19:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:20:03 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:20:03 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74039) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 09:20:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:20:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrlyNzXM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:20:13 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:20:13 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:20:13 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3661ae-5689-4e30-9fea-16c734640627]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:20:13 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b23dbc4-e2c9-4af7-b41b-5c8a1ab4523c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a] added
Oct 20 09:20:13 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70957d6-b50d-4dbb-9cc2-7250e2e55991]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0021a6ea-8798-4a66-8744-f97048ec04e7]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SrlyNzXM {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SrlyNzXM" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[846f9e9b-5539-4e6e-a9e9-5123c2898393]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SrlyNzXM'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[45185c64-81e9-4685-bfa7-f05c414f03fe]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16619a9-1c5e-4c6a-84b7-a4a5c751f654]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:20:13 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:20:13 user nova-compute[74039]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)
Oct 20 09:20:13 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:20:13 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:20:13 user nova-compute[74039]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)
Oct 20 09:20:13 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a61ce6d-2c40-4afb-ac0a-1a16bce0f944]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a, portal: 172.16.0.220,3260]
Oct 20 09:20:13 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a, portal: 172.16.0.220,3260] successful.
Oct 20 09:20:13 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23230cc-c278-4e12-9dc9-d88230a7318c]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7b043e-c788-46c5-a811-4f3c57404483]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:20:13 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:20:13 user nova-compute[74039]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)
Oct 20 09:20:13 user nova-compute[74039]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a (non-flash)
Oct 20 09:20:13 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:20:13 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:20:13 user nova-compute[74039]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)
Oct 20 09:20:13 user nova-compute[74039]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a (non-flash)
Oct 20 09:20:13 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b16479-ab2d-4fb9-b4ff-643169d03424]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrlyNzXM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:20:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:20:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:20:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23164353662313663', 'path': '/dev/sdd'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:20:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164353662313663', 'path': '/dev/sdd'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:20:14 user nova-compute[74039]: DEBUG nova.objects.instance [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lazy-loading 'flavor' on Instance uuid 69541e4b-dded-4e7c-9cfa-d93f8824179f {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:20:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 09:20:14 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:20:14 user nova-compute[74039]:   <source dev="/dev/sdd"/>
Oct 20 09:20:14 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:20:14 user nova-compute[74039]:   <serial>d2d0f34f-6e0f-4d8f-a335-844665a02c8a</serial>
Oct 20 09:20:14 user nova-compute[74039]: </disk>
Oct 20 09:20:14 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 09:20:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:20:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:20:15 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] No VIF found with MAC fa:16:3e:53:1c:b8, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:20:15 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-66ad0d08-8084-4b67-8cc1-cbae94e49c43 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.545s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:20:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:20:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:20:17 user nova-compute[74039]: INFO nova.compute.manager [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Detaching volume d2d0f34f-6e0f-4d8f-a335-844665a02c8a
Oct 20 09:20:17 user nova-compute[74039]: INFO nova.virt.block_device [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Attempting to driver detach volume d2d0f34f-6e0f-4d8f-a335-844665a02c8a from mountpoint /dev/vdb
Oct 20 09:20:17 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Attempting to detach device vdb from instance 69541e4b-dded-4e7c-9cfa-d93f8824179f from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 09:20:17 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:20:17 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:20:17 user nova-compute[74039]:   <source dev="/dev/sdd"/>
Oct 20 09:20:17 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:20:17 user nova-compute[74039]:   <serial>d2d0f34f-6e0f-4d8f-a335-844665a02c8a</serial>
Oct 20 09:20:17 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:20:17 user nova-compute[74039]: </disk>
Oct 20 09:20:17 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:20:17 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Successfully detached device vdb from instance 69541e4b-dded-4e7c-9cfa-d93f8824179f from the persistent domain config.
Oct 20 09:20:17 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 69541e4b-dded-4e7c-9cfa-d93f8824179f from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 09:20:17 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:20:17 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:20:17 user nova-compute[74039]:   <source dev="/dev/sdd"/>
Oct 20 09:20:17 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:20:17 user nova-compute[74039]:   <serial>d2d0f34f-6e0f-4d8f-a335-844665a02c8a</serial>
Oct 20 09:20:17 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:20:17 user nova-compute[74039]: </disk>
Oct 20 09:20:17 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:20:17 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 69541e4b-dded-4e7c-9cfa-d93f8824179f {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 09:20:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:20:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:30 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:20:30 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:20:32 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:20:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:20:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:20:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:20:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:20:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG nova.compute.manager [req-4e39915a-2010-4e4d-8911-9534ae9f84cd req-92bdfbd6-9c4d-40d8-a5df-4747cdd89b05 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received event network-changed-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG nova.compute.manager [req-4e39915a-2010-4e4d-8911-9534ae9f84cd req-92bdfbd6-9c4d-40d8-a5df-4747cdd89b05 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Refreshing instance network info cache due to event network-changed-c1e04f2d-ef5c-4de2-831e-28d7339feba3. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4e39915a-2010-4e4d-8911-9534ae9f84cd req-92bdfbd6-9c4d-40d8-a5df-4747cdd89b05 service nova] Acquiring lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4e39915a-2010-4e4d-8911-9534ae9f84cd req-92bdfbd6-9c4d-40d8-a5df-4747cdd89b05 service nova] Acquired lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG nova.network.neutron [req-4e39915a-2010-4e4d-8911-9534ae9f84cd req-92bdfbd6-9c4d-40d8-a5df-4747cdd89b05 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Refreshing network info cache for port c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquiring lock "c75f37aa-657f-4076-b42b-b716ed608fac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "c75f37aa-657f-4076-b42b-b716ed608fac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquiring lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:20:35 user nova-compute[74039]: INFO nova.compute.manager [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Terminating instance
Oct 20 09:20:35 user nova-compute[74039]: DEBUG nova.compute.manager [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG nova.network.neutron [req-4e39915a-2010-4e4d-8911-9534ae9f84cd req-92bdfbd6-9c4d-40d8-a5df-4747cdd89b05 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Updated VIF entry in instance network info cache for port c1e04f2d-ef5c-4de2-831e-28d7339feba3. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG nova.network.neutron [req-4e39915a-2010-4e4d-8911-9534ae9f84cd req-92bdfbd6-9c4d-40d8-a5df-4747cdd89b05 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Updating instance_info_cache with network_info: [{"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4e39915a-2010-4e4d-8911-9534ae9f84cd req-92bdfbd6-9c4d-40d8-a5df-4747cdd89b05 service nova] Releasing lock "refresh_cache-c75f37aa-657f-4076-b42b-b716ed608fac" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG nova.compute.manager [req-13404399-3e98-41e4-9430-0db622604a97 req-d593a5d4-40a2-4bef-9d40-a3a5268d871a service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received event network-vif-unplugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-13404399-3e98-41e4-9430-0db622604a97 req-d593a5d4-40a2-4bef-9d40-a3a5268d871a service nova] Acquiring lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-13404399-3e98-41e4-9430-0db622604a97 req-d593a5d4-40a2-4bef-9d40-a3a5268d871a service nova] Lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-13404399-3e98-41e4-9430-0db622604a97 req-d593a5d4-40a2-4bef-9d40-a3a5268d871a service nova] Lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG nova.compute.manager [req-13404399-3e98-41e4-9430-0db622604a97 req-d593a5d4-40a2-4bef-9d40-a3a5268d871a service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] No waiting events found dispatching network-vif-unplugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG nova.compute.manager [req-13404399-3e98-41e4-9430-0db622604a97 req-d593a5d4-40a2-4bef-9d40-a3a5268d871a service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received event network-vif-unplugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Skipping network cache update for instance because it is being deleted. {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9970}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Didn't find any instances for network info cache update. {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:20:35 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Instance destroyed successfully.
Oct 20 09:20:35 user nova-compute[74039]: DEBUG nova.objects.instance [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lazy-loading 'resources' on Instance uuid c75f37aa-657f-4076-b42b-b716ed608fac {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T09:14:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-614706847',display_name='tempest-TestShelveInstance-server-614706847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-614706847',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKP6fCWfjEUsn/M6cqzJEhygYrcpj6FXmn0D9ZhSrnVED0MGeydQ0/ihFZ6xTLs93YfmSBmg1jpySYLOPI+t2U57SJ3XAEA8NSHExjn6f/2QpPCFGG7Gxo677Op3gWA6cQ==',key_name='tempest-TestShelveInstance-1056844604',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:19:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91d6aa3596714916a466942e5e43ae2e',ramdisk_id='',reservation_id='r-zp3vbwnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1029412800',owner_user_name='tempest-TestShelveInstance-1029412800-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:19:09Z,user_data=None,user_id='80e383c8e1544ecebd906c182383eb60',uuid=c75f37aa-657f-4076-b42b-b716ed608fac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Converting VIF {"id": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "address": "fa:16:3e:e2:c8:18", "network": {"id": "c6342f79-d0fd-46a8-86e4-013c32691c72", "bridge": "br-int", "label": "tempest-TestShelveInstance-1453257454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91d6aa3596714916a466942e5e43ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1e04f2d-ef", "ovs_interfaceid": "c1e04f2d-ef5c-4de2-831e-28d7339feba3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c8:18,bridge_name='br-int',has_traffic_filtering=True,id=c1e04f2d-ef5c-4de2-831e-28d7339feba3,network=Network(c6342f79-d0fd-46a8-86e4-013c32691c72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1e04f2d-ef') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG os_vif [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c8:18,bridge_name='br-int',has_traffic_filtering=True,id=c1e04f2d-ef5c-4de2-831e-28d7339feba3,network=Network(c6342f79-d0fd-46a8-86e4-013c32691c72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1e04f2d-ef') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1e04f2d-ef, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a291320-1d6e-43d3-a853-ec7a5d1ec3e1) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:20:35 user nova-compute[74039]: INFO os_vif [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c8:18,bridge_name='br-int',has_traffic_filtering=True,id=c1e04f2d-ef5c-4de2-831e-28d7339feba3,network=Network(c6342f79-d0fd-46a8-86e4-013c32691c72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1e04f2d-ef')
Oct 20 09:20:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfPWirVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:20:35 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:20:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fa548c-4c37-4213-b447-31575d2c7a18]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:20:35 user nova-compute[74039]: No targets found.
Oct 20 09:20:35 user nova-compute[74039]: iSNS:
Oct 20 09:20:35 user nova-compute[74039]: No targets found.
Oct 20 09:20:35 user nova-compute[74039]: STATIC:
Oct 20 09:20:35 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14
Oct 20 09:20:35 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:20:35 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:20:35 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a
Oct 20 09:20:35 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:20:35 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:20:35 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2
Oct 20 09:20:35 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:20:35 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:20:35 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9
Oct 20 09:20:35 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:20:35 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:20:35 user nova-compute[74039]: FIRMWARE:
Oct 20 09:20:35 user nova-compute[74039]: No targets found.
Oct 20 09:20:35 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:20:35 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:20:35 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0badc0be-2d73-4d8e-af2f-7dd929ede72d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:35 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee09e09-c771-4bd4-9ae5-d041ca07b144]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:20:36 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:20:36 user nova-compute[74039]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)
Oct 20 09:20:36 user nova-compute[74039]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a (non-flash)
Oct 20 09:20:36 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:20:36 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:20:36 user nova-compute[74039]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 (non-flash)
Oct 20 09:20:36 user nova-compute[74039]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a (non-flash)
Oct 20 09:20:36 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae840f3640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2'): ({'sdf'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Removing single pathed devices sdf {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49044c9-11d9-438e-ace4-a42a55f420c3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df1c94d-d4d5-4b92-baaf-6a17d97429f0]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Flushing IO for device /dev/sdf {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9583ff-dad2-41cb-8ff3-98104afd88f6]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9b3e66-72d5-41ab-ac3a-464176dec0fd]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] SCSI volumes sdf have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb3d55503-8bfbdcc07abc3040', '/dev/disk/by-id/scsi-23862666264636330', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b3d55503') {{(pid=85466) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[25886628-4b50-42e5-a1d3-87b916fd3ac8]: (4, None) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e8ddb1-e8f6-4b0b-896f-6e27c2e0636c]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c09f95-c5be-4607-ad3e-36b22ecb5a47]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2, portal: 172.16.0.220,3260]
Oct 20 09:20:36 user nova-compute[74039]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2, portal: 172.16.0.220,3260] successful.
Oct 20 09:20:36 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabc70a6-44d6-49c8-9503-04ea2a26ead2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fda95b-f43b-4246-8de4-0683d181898d]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] <== disconnect_volume: return (326ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:20:36 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Deleting instance files /opt/stack/data/nova/instances/c75f37aa-657f-4076-b42b-b716ed608fac_del
Oct 20 09:20:36 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Deletion of /opt/stack/data/nova/instances/c75f37aa-657f-4076-b42b-b716ed608fac_del complete
Oct 20 09:20:36 user nova-compute[74039]: INFO nova.compute.manager [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Took 1.23 seconds to destroy the instance on the hypervisor.
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:20:36 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:20:37 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Took 0.77 seconds to deallocate network for instance.
Oct 20 09:20:37 user nova-compute[74039]: DEBUG nova.compute.manager [req-ecbf0511-ddc0-4c94-90d5-99cf9cf1ac53 req-7fe2f74f-8b6a-4da1-a3a6-d83989af06a8 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received event network-vif-deleted-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:20:37 user nova-compute[74039]: INFO nova.compute.manager [req-ecbf0511-ddc0-4c94-90d5-99cf9cf1ac53 req-7fe2f74f-8b6a-4da1-a3a6-d83989af06a8 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Neutron deleted interface c1e04f2d-ef5c-4de2-831e-28d7339feba3; detaching it from the instance and deleting it from the info cache
Oct 20 09:20:37 user nova-compute[74039]: DEBUG nova.network.neutron [req-ecbf0511-ddc0-4c94-90d5-99cf9cf1ac53 req-7fe2f74f-8b6a-4da1-a3a6-d83989af06a8 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG nova.compute.manager [req-ecbf0511-ddc0-4c94-90d5-99cf9cf1ac53 req-7fe2f74f-8b6a-4da1-a3a6-d83989af06a8 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Detach interface failed, port_id=c1e04f2d-ef5c-4de2-831e-28d7339feba3, reason: Instance c75f37aa-657f-4076-b42b-b716ed608fac could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG nova.compute.manager [req-9c428514-4934-480a-9232-80bd8d8c0ffd req-8801a783-9763-41cf-95b1-bf060eca5f45 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received event network-vif-plugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9c428514-4934-480a-9232-80bd8d8c0ffd req-8801a783-9763-41cf-95b1-bf060eca5f45 service nova] Acquiring lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9c428514-4934-480a-9232-80bd8d8c0ffd req-8801a783-9763-41cf-95b1-bf060eca5f45 service nova] Lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9c428514-4934-480a-9232-80bd8d8c0ffd req-8801a783-9763-41cf-95b1-bf060eca5f45 service nova] Lock "c75f37aa-657f-4076-b42b-b716ed608fac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG nova.compute.manager [req-9c428514-4934-480a-9232-80bd8d8c0ffd req-8801a783-9763-41cf-95b1-bf060eca5f45 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] No waiting events found dispatching network-vif-plugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:20:37 user nova-compute[74039]: WARNING nova.compute.manager [req-9c428514-4934-480a-9232-80bd8d8c0ffd req-8801a783-9763-41cf-95b1-bf060eca5f45 service nova] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Received unexpected event network-vif-plugged-c1e04f2d-ef5c-4de2-831e-28d7339feba3 for instance with vm_state active and task_state deleting.
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:20:37 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 69541e4b-dded-4e7c-9cfa-d93f8824179f is timed out.
Oct 20 09:20:37 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Successfully detached device vdb from instance 69541e4b-dded-4e7c-9cfa-d93f8824179f from the live domain config.
Oct 20 09:20:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrlyNzXM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:20:37 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:20:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b307cf2b-b3c3-4df1-aa7a-443235f45f96]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:20:37 user nova-compute[74039]: No targets found.
Oct 20 09:20:37 user nova-compute[74039]: iSNS:
Oct 20 09:20:37 user nova-compute[74039]: No targets found.
Oct 20 09:20:37 user nova-compute[74039]: STATIC:
Oct 20 09:20:37 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14
Oct 20 09:20:37 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:20:37 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:20:37 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a
Oct 20 09:20:37 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:20:37 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:20:37 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9
Oct 20 09:20:37 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:20:37 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:20:37 user nova-compute[74039]: FIRMWARE:
Oct 20 09:20:37 user nova-compute[74039]: No targets found.
Oct 20 09:20:37 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:20:37 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:20:37 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa499f98-6a45-40f7-a43a-63149f90e6bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df0c0f9-3b05-411a-ac8e-44ac1353a922]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:20:37 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:20:37 user nova-compute[74039]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a (non-flash)
Oct 20 09:20:37 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:20:37 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:20:37 user nova-compute[74039]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a (non-flash)
Oct 20 09:20:37 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae7c354dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a'): ({'sdd'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Removing single pathed devices sdd {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f248ae0a-5faa-4adc-a89b-9c38c2a904e7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[39798eef-8a07-4794-b70c-6301f1181039]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Flushing IO for device /dev/sdd {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[852f3417-613a-4d91-a912-f0ea85c19343]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:20:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a38dd8d-3138-4dba-909d-09d0cc38fc35]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:38 user nova-compute[74039]: INFO nova.compute.manager [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Took 0.90 seconds to detach 1 volumes for instance.
Oct 20 09:20:38 user nova-compute[74039]: DEBUG nova.compute.manager [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] [instance: c75f37aa-657f-4076-b42b-b716ed608fac] Deleting volume: aabc70a6-44d6-49c8-9503-04ea2a26ead2 {{(pid=74039) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a29f84-db1e-4d9e-ad2c-578343db0b50]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[70988b85-a19a-4244-9b0c-82e5be7e0d68]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a, portal: 172.16.0.220,3260]
Oct 20 09:20:38 user nova-compute[74039]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a, portal: 172.16.0.220,3260] successful.
Oct 20 09:20:38 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d0f34f-6e0f-4d8f-a335-844665a02c8a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3ec50c-8836-45e3-b76a-002347f21515]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] <== disconnect_volume: return (321ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:20:38 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Deleted allocations for instance c75f37aa-657f-4076-b42b-b716ed608fac
Oct 20 09:20:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-13f2b6d2-1fb3-4eef-a4bc-6cb69641a492 tempest-TestShelveInstance-1029412800 tempest-TestShelveInstance-1029412800-project-member] Lock "c75f37aa-657f-4076-b42b-b716ed608fac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.444s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:20:38 user nova-compute[74039]: DEBUG nova.objects.instance [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lazy-loading 'flavor' on Instance uuid 69541e4b-dded-4e7c-9cfa-d93f8824179f {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:20:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c94bc66d-819e-417c-a323-9d981d0ca00f tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.771s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:20:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:39 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:20:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:45 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:20:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:20:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:20:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:20:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:20:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:46 user nova-compute[74039]: INFO nova.compute.manager [None req-fa951d40-1ab5-49b0-a55f-0dd43e8ba61c tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Unrescuing
Oct 20 09:20:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fa951d40-1ab5-49b0-a55f-0dd43e8ba61c tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "refresh_cache-bf598ec2-bd4c-4bd6-b20e-b11617907c77" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:20:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fa951d40-1ab5-49b0-a55f-0dd43e8ba61c tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquired lock "refresh_cache-bf598ec2-bd4c-4bd6-b20e-b11617907c77" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:20:46 user nova-compute[74039]: DEBUG nova.network.neutron [None req-fa951d40-1ab5-49b0-a55f-0dd43e8ba61c tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:20:46 user nova-compute[74039]: DEBUG nova.network.neutron [None req-fa951d40-1ab5-49b0-a55f-0dd43e8ba61c tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Updating instance_info_cache with network_info: [{"id": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "address": "fa:16:3e:36:1e:50", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb89e6-7b", "ovs_interfaceid": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:20:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-fa951d40-1ab5-49b0-a55f-0dd43e8ba61c tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Releasing lock "refresh_cache-bf598ec2-bd4c-4bd6-b20e-b11617907c77" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:20:46 user nova-compute[74039]: DEBUG nova.objects.instance [None req-fa951d40-1ab5-49b0-a55f-0dd43e8ba61c tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'flavor' on Instance uuid bf598ec2-bd4c-4bd6-b20e-b11617907c77 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:20:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-36bc4fc2-ca27-49e4-b881-dd7cf482277f req-57ff7fa0-3514-480c-a5b0-74c7739e83e4 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received event network-vif-unplugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:20:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-36bc4fc2-ca27-49e4-b881-dd7cf482277f req-57ff7fa0-3514-480c-a5b0-74c7739e83e4 service nova] Acquiring lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:20:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-36bc4fc2-ca27-49e4-b881-dd7cf482277f req-57ff7fa0-3514-480c-a5b0-74c7739e83e4 service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:20:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-36bc4fc2-ca27-49e4-b881-dd7cf482277f req-57ff7fa0-3514-480c-a5b0-74c7739e83e4 service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:20:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-36bc4fc2-ca27-49e4-b881-dd7cf482277f req-57ff7fa0-3514-480c-a5b0-74c7739e83e4 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] No waiting events found dispatching network-vif-unplugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:20:46 user nova-compute[74039]: WARNING nova.compute.manager [req-36bc4fc2-ca27-49e4-b881-dd7cf482277f req-57ff7fa0-3514-480c-a5b0-74c7739e83e4 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received unexpected event network-vif-unplugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 for instance with vm_state rescued and task_state unrescuing.
Oct 20 09:20:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:47 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Instance destroyed successfully.
Oct 20 09:20:48 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:20:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:20:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:20:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:20:48 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:20:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:48 user nova-compute[74039]: DEBUG nova.compute.manager [req-7778ce7e-3ee3-4007-ae78-6cd10a2c4481 req-769859c8-a148-41a3-9c84-f69061429069 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received event network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:20:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7778ce7e-3ee3-4007-ae78-6cd10a2c4481 req-769859c8-a148-41a3-9c84-f69061429069 service nova] Acquiring lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:20:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7778ce7e-3ee3-4007-ae78-6cd10a2c4481 req-769859c8-a148-41a3-9c84-f69061429069 service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:20:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7778ce7e-3ee3-4007-ae78-6cd10a2c4481 req-769859c8-a148-41a3-9c84-f69061429069 service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:20:48 user nova-compute[74039]: DEBUG nova.compute.manager [req-7778ce7e-3ee3-4007-ae78-6cd10a2c4481 req-769859c8-a148-41a3-9c84-f69061429069 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] No waiting events found dispatching network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:20:48 user nova-compute[74039]: WARNING nova.compute.manager [req-7778ce7e-3ee3-4007-ae78-6cd10a2c4481 req-769859c8-a148-41a3-9c84-f69061429069 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received unexpected event network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 for instance with vm_state rescued and task_state unrescuing.
Oct 20 09:20:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:20:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:20:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:20:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-d7c80de5-f4d6-488e-8991-1bd2b17ca15a req-10742c72-edf8-4793-8fd5-d7612625c9c8 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received event network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d7c80de5-f4d6-488e-8991-1bd2b17ca15a req-10742c72-edf8-4793-8fd5-d7612625c9c8 service nova] Acquiring lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d7c80de5-f4d6-488e-8991-1bd2b17ca15a req-10742c72-edf8-4793-8fd5-d7612625c9c8 service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d7c80de5-f4d6-488e-8991-1bd2b17ca15a req-10742c72-edf8-4793-8fd5-d7612625c9c8 service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-d7c80de5-f4d6-488e-8991-1bd2b17ca15a req-10742c72-edf8-4793-8fd5-d7612625c9c8 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] No waiting events found dispatching network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:20:51 user nova-compute[74039]: WARNING nova.compute.manager [req-d7c80de5-f4d6-488e-8991-1bd2b17ca15a req-10742c72-edf8-4793-8fd5-d7612625c9c8 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received unexpected event network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 for instance with vm_state rescued and task_state unrescuing.
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-d7c80de5-f4d6-488e-8991-1bd2b17ca15a req-10742c72-edf8-4793-8fd5-d7612625c9c8 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received event network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d7c80de5-f4d6-488e-8991-1bd2b17ca15a req-10742c72-edf8-4793-8fd5-d7612625c9c8 service nova] Acquiring lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d7c80de5-f4d6-488e-8991-1bd2b17ca15a req-10742c72-edf8-4793-8fd5-d7612625c9c8 service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d7c80de5-f4d6-488e-8991-1bd2b17ca15a req-10742c72-edf8-4793-8fd5-d7612625c9c8 service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-d7c80de5-f4d6-488e-8991-1bd2b17ca15a req-10742c72-edf8-4793-8fd5-d7612625c9c8 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] No waiting events found dispatching network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:20:51 user nova-compute[74039]: WARNING nova.compute.manager [req-d7c80de5-f4d6-488e-8991-1bd2b17ca15a req-10742c72-edf8-4793-8fd5-d7612625c9c8 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received unexpected event network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 for instance with vm_state rescued and task_state unrescuing.
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.compute.manager [None req-fa951d40-1ab5-49b0-a55f-0dd43e8ba61c tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:20:51 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:20:51 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8432MB free_disk=25.13216781616211GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance d109c52e-1d09-4ed1-9c63-97abcf37ff92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance bd1f0c3b-32f3-4954-b38d-b57e16259234 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 69541e4b-dded-4e7c-9cfa-d93f8824179f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance bf598ec2-bd4c-4bd6-b20e-b11617907c77 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing inventories for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Updating ProviderTree inventory for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Updating inventory in ProviderTree for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing aggregate associations for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb, aggregates: None {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing trait associations for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:20:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:20:54 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:20:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:20:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:20:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:20:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:20:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:20:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "6939df16-e062-40a1-a705-fe0c03ce647e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:20:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "6939df16-e062-40a1-a705-fe0c03ce647e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:20:59 user nova-compute[74039]: DEBUG nova.compute.manager [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:20:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:20:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:20:59 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:20:59 user nova-compute[74039]: INFO nova.compute.claims [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Claim successful on node user
Oct 20 09:21:00 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG nova.compute.manager [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG nova.compute.manager [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG nova.network.neutron [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:21:00 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:21:00 user nova-compute[74039]: DEBUG nova.compute.manager [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG nova.policy [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d68ed2131b34e57a5f10a01409fee62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367334c57f8f47b696a477460afba369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:21:00 user nova-compute[74039]: INFO nova.virt.block_device [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Booting with volume 8b9dc75e-95c3-45ed-a77c-db42f186ffdc at /dev/vda
Oct 20 09:21:00 user nova-compute[74039]: DEBUG os_brick.utils [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c96f30-4154-4fd5-9ffe-1f1f50f18b0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cace07-2c04-44e7-ac19-f0d90bf35a48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[12397060-3e78-4032-8964-9ede80a1883d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[014bff78-6fc3-4dda-909b-12a12fc08f2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:21:00 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:21:00 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a734d6f-fff5-49e2-bd94-35f4fb01f511]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG os_brick.utils [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Updating existing volume attachment record: 86f9a859-8d16-4498-8e2c-338adcc1183f {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:21:00 user nova-compute[74039]: DEBUG nova.network.neutron [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Successfully created port: 69b9c433-1e21-4b68-a843-9866dc032a2d {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:21:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:21:01 user nova-compute[74039]: DEBUG nova.network.neutron [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Successfully updated port: 69b9c433-1e21-4b68-a843-9866dc032a2d {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:21:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "refresh_cache-6939df16-e062-40a1-a705-fe0c03ce647e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:21:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquired lock "refresh_cache-6939df16-e062-40a1-a705-fe0c03ce647e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:21:01 user nova-compute[74039]: DEBUG nova.network.neutron [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:21:01 user nova-compute[74039]: DEBUG nova.compute.manager [req-04eb4550-4a81-4509-91fa-c0d6bcbff5b6 req-29c6a86b-d2d6-4cba-a19a-142659de136f service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Received event network-changed-69b9c433-1e21-4b68-a843-9866dc032a2d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:21:01 user nova-compute[74039]: DEBUG nova.compute.manager [req-04eb4550-4a81-4509-91fa-c0d6bcbff5b6 req-29c6a86b-d2d6-4cba-a19a-142659de136f service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Refreshing instance network info cache due to event network-changed-69b9c433-1e21-4b68-a843-9866dc032a2d. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:21:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-04eb4550-4a81-4509-91fa-c0d6bcbff5b6 req-29c6a86b-d2d6-4cba-a19a-142659de136f service nova] Acquiring lock "refresh_cache-6939df16-e062-40a1-a705-fe0c03ce647e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:21:01 user nova-compute[74039]: DEBUG nova.network.neutron [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:21:01 user nova-compute[74039]: DEBUG nova.network.neutron [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Updating instance_info_cache with network_info: [{"id": "69b9c433-1e21-4b68-a843-9866dc032a2d", "address": "fa:16:3e:66:bb:54", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9c433-1e", "ovs_interfaceid": "69b9c433-1e21-4b68-a843-9866dc032a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:21:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Releasing lock "refresh_cache-6939df16-e062-40a1-a705-fe0c03ce647e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:21:01 user nova-compute[74039]: DEBUG nova.compute.manager [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Instance network_info: |[{"id": "69b9c433-1e21-4b68-a843-9866dc032a2d", "address": "fa:16:3e:66:bb:54", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9c433-1e", "ovs_interfaceid": "69b9c433-1e21-4b68-a843-9866dc032a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:21:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-04eb4550-4a81-4509-91fa-c0d6bcbff5b6 req-29c6a86b-d2d6-4cba-a19a-142659de136f service nova] Acquired lock "refresh_cache-6939df16-e062-40a1-a705-fe0c03ce647e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:21:01 user nova-compute[74039]: DEBUG nova.network.neutron [req-04eb4550-4a81-4509-91fa-c0d6bcbff5b6 req-29c6a86b-d2d6-4cba-a19a-142659de136f service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Refreshing network info cache for port 69b9c433-1e21-4b68-a843-9866dc032a2d {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:21:02 user nova-compute[74039]: DEBUG nova.network.neutron [req-04eb4550-4a81-4509-91fa-c0d6bcbff5b6 req-29c6a86b-d2d6-4cba-a19a-142659de136f service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Updated VIF entry in instance network info cache for port 69b9c433-1e21-4b68-a843-9866dc032a2d. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:21:02 user nova-compute[74039]: DEBUG nova.network.neutron [req-04eb4550-4a81-4509-91fa-c0d6bcbff5b6 req-29c6a86b-d2d6-4cba-a19a-142659de136f service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Updating instance_info_cache with network_info: [{"id": "69b9c433-1e21-4b68-a843-9866dc032a2d", "address": "fa:16:3e:66:bb:54", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9c433-1e", "ovs_interfaceid": "69b9c433-1e21-4b68-a843-9866dc032a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:21:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-04eb4550-4a81-4509-91fa-c0d6bcbff5b6 req-29c6a86b-d2d6-4cba-a19a-142659de136f service nova] Releasing lock "refresh_cache-6939df16-e062-40a1-a705-fe0c03ce647e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:21:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:21:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG nova.objects.instance [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lazy-loading 'flavor' on Instance uuid 69541e4b-dded-4e7c-9cfa-d93f8824179f {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:21:12 user nova-compute[74039]: INFO nova.compute.manager [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Attaching volume fbeb0a75-b666-43da-8162-5f3766c2caa9 to /dev/vdb
Oct 20 09:21:12 user nova-compute[74039]: DEBUG os_brick.utils [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f35e1a-fcf8-4b76-a10f-530f7a95e6bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5771ef28-16ce-48e8-a19c-dd1a76dc222f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[deda3cee-a7db-4fee-b288-c7d19f005343]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8382c8f-1e2c-404e-913d-a98a18c0506e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:21:12 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:21:12 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a326945e-3109-418e-aaf0-e41a5d0e9690]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG os_brick.utils [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:21:12 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Updating existing volume attachment record: c6da8ae9-337c-4a1f-925f-fdb00a8a90a0 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:21:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.compute.manager [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:21:16 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Creating image(s)
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Did not create local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Ensure instance console log exists: /opt/stack/data/nova/instances/6939df16-e062-40a1-a705-fe0c03ce647e/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Start _get_guest_xml network_info=[{"id": "69b9c433-1e21-4b68-a843-9866dc032a2d", "address": "fa:16:3e:66:bb:54", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9c433-1e", "ovs_interfaceid": "69b9c433-1e21-4b68-a843-9866dc032a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '86f9a859-8d16-4498-8e2c-338adcc1183f', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VxhpOsMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6939df16-e062-40a1-a705-fe0c03ce647e', 'attached_at': '', 'detached_at': '', 'volume_id': '8b9dc75e-95c3-45ed-a77c-db42f186ffdc', 'serial': '8b9dc75e-95c3-45ed-a77c-db42f186ffdc'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:21:16 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:21:16 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VxhpOsMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:21:16 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:21:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:21:16 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:21:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:21:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:21:16 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:21:16 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb2912c-85da-4982-9345-79c800b07617]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:21:17 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d265cf-5fbc-4d96-9dde-3ee0b11171d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc] added
Oct 20 09:21:17 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e396784-e1e3-4053-a6ea-a1d20b8a8e57]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3399dabe-fed0-473d-a811-c2d82f9edf48]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VxhpOsMT {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VxhpOsMT" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b08ba0-bf56-4d34-815c-275644d64d94]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VxhpOsMT'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63e28a8-ed60-4a88-864e-7b8ae50b8646]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[049c44f6-a493-4dad-9549-ea3f9e055b56]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:21:17 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:21:17 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:21:17 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:21:17 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d4bc1a-0612-4363-a790-78ae06281b2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc, portal: 172.16.0.220,3260]
Oct 20 09:21:17 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc, portal: 172.16.0.220,3260] successful.
Oct 20 09:21:17 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a5ddf3-548c-434a-85df-776a6b039eec]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[072647da-199f-431b-8528-0b5143bec740]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:21:17 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:21:17 user nova-compute[74039]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)
Oct 20 09:21:17 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:21:17 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:21:17 user nova-compute[74039]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)
Oct 20 09:21:17 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12ddd24-6e25-411e-94f9-54be94924183]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:17 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: None {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VxhpOsMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23762343863663139', 'path': '/dev/sdd'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762343863663139', 'path': '/dev/sdd'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1867896093',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1867896093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1867896093',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaWeLwEKEjPognnxfyns2mZ3K0IJ30TaUPub1gV/mB5PMJbOpI15EzRHDyhXVAA8gO8FFYXTdFr1X7vrEDLNwW5lHS7ube59zQLe469td5MVOLT4ZFy8n24UxQjSUS8yg==',key_name='tempest-keypair-1077972919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='367334c57f8f47b696a477460afba369',ramdisk_id='',reservation_id='r-1k026v6t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725287482',owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d68ed2131b34e57a5f10a01409fee62',uuid=6939df16-e062-40a1-a705-fe0c03ce647e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69b9c433-1e21-4b68-a843-9866dc032a2d", "address": "fa:16:3e:66:bb:54", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9c433-1e", "ovs_interfaceid": "69b9c433-1e21-4b68-a843-9866dc032a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converting VIF {"id": "69b9c433-1e21-4b68-a843-9866dc032a2d", "address": "fa:16:3e:66:bb:54", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9c433-1e", "ovs_interfaceid": "69b9c433-1e21-4b68-a843-9866dc032a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:bb:54,bridge_name='br-int',has_traffic_filtering=True,id=69b9c433-1e21-4b68-a843-9866dc032a2d,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b9c433-1e') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG nova.objects.instance [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lazy-loading 'pci_devices' on Instance uuid 6939df16-e062-40a1-a705-fe0c03ce647e {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:21:18 user nova-compute[74039]:   <uuid>6939df16-e062-40a1-a705-fe0c03ce647e</uuid>
Oct 20 09:21:18 user nova-compute[74039]:   <name>instance-0000002e</name>
Oct 20 09:21:18 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:21:18 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:21:18 user nova-compute[74039]:   <metadata>
Oct 20 09:21:18 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:21:18 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:21:18 user nova-compute[74039]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1867896093</nova:name>
Oct 20 09:21:18 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:21:16</nova:creationTime>
Oct 20 09:21:18 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:21:18 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:21:18 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:21:18 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:21:18 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:21:18 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:21:18 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:21:18 user nova-compute[74039]:       <nova:owner>
Oct 20 09:21:18 user nova-compute[74039]:         <nova:user uuid="8d68ed2131b34e57a5f10a01409fee62">tempest-TestVolumeBootPattern-1725287482-project-member</nova:user>
Oct 20 09:21:18 user nova-compute[74039]:         <nova:project uuid="367334c57f8f47b696a477460afba369">tempest-TestVolumeBootPattern-1725287482</nova:project>
Oct 20 09:21:18 user nova-compute[74039]:       </nova:owner>
Oct 20 09:21:18 user nova-compute[74039]:       <nova:ports>
Oct 20 09:21:18 user nova-compute[74039]:         <nova:port uuid="69b9c433-1e21-4b68-a843-9866dc032a2d">
Oct 20 09:21:18 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 09:21:18 user nova-compute[74039]:         </nova:port>
Oct 20 09:21:18 user nova-compute[74039]:       </nova:ports>
Oct 20 09:21:18 user nova-compute[74039]:     </nova:instance>
Oct 20 09:21:18 user nova-compute[74039]:   </metadata>
Oct 20 09:21:18 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:21:18 user nova-compute[74039]:     <system>
Oct 20 09:21:18 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:21:18 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:21:18 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:21:18 user nova-compute[74039]:       <entry name="serial">6939df16-e062-40a1-a705-fe0c03ce647e</entry>
Oct 20 09:21:18 user nova-compute[74039]:       <entry name="uuid">6939df16-e062-40a1-a705-fe0c03ce647e</entry>
Oct 20 09:21:18 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:21:18 user nova-compute[74039]:     </system>
Oct 20 09:21:18 user nova-compute[74039]:   </sysinfo>
Oct 20 09:21:18 user nova-compute[74039]:   <os>
Oct 20 09:21:18 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:21:18 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:21:18 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:21:18 user nova-compute[74039]:   </os>
Oct 20 09:21:18 user nova-compute[74039]:   <features>
Oct 20 09:21:18 user nova-compute[74039]:     <acpi/>
Oct 20 09:21:18 user nova-compute[74039]:     <apic/>
Oct 20 09:21:18 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:21:18 user nova-compute[74039]:   </features>
Oct 20 09:21:18 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:21:18 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:21:18 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:21:18 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:21:18 user nova-compute[74039]:   </clock>
Oct 20 09:21:18 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:21:18 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:21:18 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:21:18 user nova-compute[74039]:   </cpu>
Oct 20 09:21:18 user nova-compute[74039]:   <devices>
Oct 20 09:21:18 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 09:21:18 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:21:18 user nova-compute[74039]:       <source dev="/dev/sdd"/>
Oct 20 09:21:18 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:21:18 user nova-compute[74039]:       <serial>8b9dc75e-95c3-45ed-a77c-db42f186ffdc</serial>
Oct 20 09:21:18 user nova-compute[74039]:     </disk>
Oct 20 09:21:18 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:21:18 user nova-compute[74039]:       <mac address="fa:16:3e:66:bb:54"/>
Oct 20 09:21:18 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:21:18 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:21:18 user nova-compute[74039]:       <target dev="tap69b9c433-1e"/>
Oct 20 09:21:18 user nova-compute[74039]:     </interface>
Oct 20 09:21:18 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:21:18 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/6939df16-e062-40a1-a705-fe0c03ce647e/console.log" append="off"/>
Oct 20 09:21:18 user nova-compute[74039]:     </serial>
Oct 20 09:21:18 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:21:18 user nova-compute[74039]:     <video>
Oct 20 09:21:18 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:21:18 user nova-compute[74039]:     </video>
Oct 20 09:21:18 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:21:18 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:21:18 user nova-compute[74039]:     </rng>
Oct 20 09:21:18 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:21:18 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:21:18 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:21:18 user nova-compute[74039]:     </memballoon>
Oct 20 09:21:18 user nova-compute[74039]:   </devices>
Oct 20 09:21:18 user nova-compute[74039]: </domain>
Oct 20 09:21:18 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1867896093',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1867896093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1867896093',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaWeLwEKEjPognnxfyns2mZ3K0IJ30TaUPub1gV/mB5PMJbOpI15EzRHDyhXVAA8gO8FFYXTdFr1X7vrEDLNwW5lHS7ube59zQLe469td5MVOLT4ZFy8n24UxQjSUS8yg==',key_name='tempest-keypair-1077972919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='367334c57f8f47b696a477460afba369',ramdisk_id='',reservation_id='r-1k026v6t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725287482',owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d68ed2131b34e57a5f10a01409fee62',uuid=6939df16-e062-40a1-a705-fe0c03ce647e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69b9c433-1e21-4b68-a843-9866dc032a2d", "address": "fa:16:3e:66:bb:54", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9c433-1e", "ovs_interfaceid": "69b9c433-1e21-4b68-a843-9866dc032a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converting VIF {"id": "69b9c433-1e21-4b68-a843-9866dc032a2d", "address": "fa:16:3e:66:bb:54", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9c433-1e", "ovs_interfaceid": "69b9c433-1e21-4b68-a843-9866dc032a2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:bb:54,bridge_name='br-int',has_traffic_filtering=True,id=69b9c433-1e21-4b68-a843-9866dc032a2d,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b9c433-1e') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG os_vif [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:bb:54,bridge_name='br-int',has_traffic_filtering=True,id=69b9c433-1e21-4b68-a843-9866dc032a2d,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b9c433-1e') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '554024ae-eaf4-5ba2-875d-c30d38140498', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69b9c433-1e, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69b9c433-1e, col_values=(('qos', UUID('12f77289-6929-4b73-b5c9-d234be558868')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69b9c433-1e, col_values=(('external_ids', {'iface-id': '69b9c433-1e21-4b68-a843-9866dc032a2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:bb:54', 'vm-uuid': '6939df16-e062-40a1-a705-fe0c03ce647e'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:18 user nova-compute[74039]: INFO os_vif [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:bb:54,bridge_name='br-int',has_traffic_filtering=True,id=69b9c433-1e21-4b68-a843-9866dc032a2d,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b9c433-1e')
Oct 20 09:21:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:21:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] No VIF found with MAC fa:16:3e:66:bb:54, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:21:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:19 user nova-compute[74039]: DEBUG nova.compute.manager [req-5c6f59c7-b941-41f2-afa0-69a60410fcf3 req-2e8a699d-666a-4c48-a176-fe5daeab8bae service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Received event network-vif-plugged-69b9c433-1e21-4b68-a843-9866dc032a2d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:21:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5c6f59c7-b941-41f2-afa0-69a60410fcf3 req-2e8a699d-666a-4c48-a176-fe5daeab8bae service nova] Acquiring lock "6939df16-e062-40a1-a705-fe0c03ce647e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:21:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5c6f59c7-b941-41f2-afa0-69a60410fcf3 req-2e8a699d-666a-4c48-a176-fe5daeab8bae service nova] Lock "6939df16-e062-40a1-a705-fe0c03ce647e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:21:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5c6f59c7-b941-41f2-afa0-69a60410fcf3 req-2e8a699d-666a-4c48-a176-fe5daeab8bae service nova] Lock "6939df16-e062-40a1-a705-fe0c03ce647e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:21:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-5c6f59c7-b941-41f2-afa0-69a60410fcf3 req-2e8a699d-666a-4c48-a176-fe5daeab8bae service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] No waiting events found dispatching network-vif-plugged-69b9c433-1e21-4b68-a843-9866dc032a2d {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:21:20 user nova-compute[74039]: WARNING nova.compute.manager [req-5c6f59c7-b941-41f2-afa0-69a60410fcf3 req-2e8a699d-666a-4c48-a176-fe5daeab8bae service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Received unexpected event network-vif-plugged-69b9c433-1e21-4b68-a843-9866dc032a2d for instance with vm_state building and task_state spawning.
Oct 20 09:21:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:22 user nova-compute[74039]: DEBUG nova.compute.manager [req-fb752713-c213-4e99-9d60-5e0411b80e38 req-cf5c57d1-5091-47d0-963a-bef69c957e58 service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Received event network-vif-plugged-69b9c433-1e21-4b68-a843-9866dc032a2d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:21:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-fb752713-c213-4e99-9d60-5e0411b80e38 req-cf5c57d1-5091-47d0-963a-bef69c957e58 service nova] Acquiring lock "6939df16-e062-40a1-a705-fe0c03ce647e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:21:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-fb752713-c213-4e99-9d60-5e0411b80e38 req-cf5c57d1-5091-47d0-963a-bef69c957e58 service nova] Lock "6939df16-e062-40a1-a705-fe0c03ce647e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:21:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-fb752713-c213-4e99-9d60-5e0411b80e38 req-cf5c57d1-5091-47d0-963a-bef69c957e58 service nova] Lock "6939df16-e062-40a1-a705-fe0c03ce647e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:21:22 user nova-compute[74039]: DEBUG nova.compute.manager [req-fb752713-c213-4e99-9d60-5e0411b80e38 req-cf5c57d1-5091-47d0-963a-bef69c957e58 service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] No waiting events found dispatching network-vif-plugged-69b9c433-1e21-4b68-a843-9866dc032a2d {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:21:22 user nova-compute[74039]: WARNING nova.compute.manager [req-fb752713-c213-4e99-9d60-5e0411b80e38 req-cf5c57d1-5091-47d0-963a-bef69c957e58 service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Received unexpected event network-vif-plugged-69b9c433-1e21-4b68-a843-9866dc032a2d for instance with vm_state building and task_state spawning.
Oct 20 09:21:22 user nova-compute[74039]: DEBUG nova.compute.manager [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:21:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:21:22 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Instance spawned successfully.
Oct 20 09:21:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:21:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:21:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:21:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:21:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:21:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:21:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:21:22 user nova-compute[74039]: INFO nova.compute.manager [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Took 5.37 seconds to spawn the instance on the hypervisor.
Oct 20 09:21:22 user nova-compute[74039]: DEBUG nova.compute.manager [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:21:22 user nova-compute[74039]: INFO nova.compute.manager [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Took 22.62 seconds to build instance.
Oct 20 09:21:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-46c0955e-18c4-4525-b54b-9827166c2400 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "6939df16-e062-40a1-a705-fe0c03ce647e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.717s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:21:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:30 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:21:30 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:21:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:30 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:21:30 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idOPqbTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:21:30 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:21:30 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:21:30 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:21:30 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:21:30 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:21:30 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:21:30 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:21:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:30 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad762f3c-3beb-4fac-9dbd-2c3121445b23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:30 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:21:30 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:21:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:30 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccd860d-8ebc-4b50-a081-244e47f0024f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:30 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9] added
Oct 20 09:21:30 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:21:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:30 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2745b7e4-ae1f-499c-aedb-1af79ebc442c]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:30 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[084fd795-e937-41b0-8fff-cdb6a84876bc]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idOPqbTK {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idOPqbTK" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2e0e07-930d-44f2-9310-9bb28fb7eaa5]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'idOPqbTK'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d53148-9216-4268-a08f-b1ddf6eab4c8]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b83ea28-967c-4ce8-9661-a4b5fb4c67ae]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:21:31 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:21:31 user nova-compute[74039]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)
Oct 20 09:21:31 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:21:31 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:21:31 user nova-compute[74039]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)
Oct 20 09:21:31 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef02f6c0-6595-48b0-a79d-f93f65a21d9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9, portal: 172.16.0.220,3260]
Oct 20 09:21:31 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9, portal: 172.16.0.220,3260] successful.
Oct 20 09:21:31 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d783d7-c4af-493a-b53c-e57e26490cf9]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6782c36f-4812-465f-a042-aa9500ca2173]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:21:31 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:21:31 user nova-compute[74039]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)
Oct 20 09:21:31 user nova-compute[74039]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 (non-flash)
Oct 20 09:21:31 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:21:31 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:21:31 user nova-compute[74039]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)
Oct 20 09:21:31 user nova-compute[74039]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 (non-flash)
Oct 20 09:21:31 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] HCTL ('36', '-', '-', 0) found on session 53 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[da77d197-239b-4a33-8d12-b8b76b36c0be]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:21:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idOPqbTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:21:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:21:32 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26361363730333839', 'path': '/dev/sde'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:21:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361363730333839', 'path': '/dev/sde'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:21:32 user nova-compute[74039]: DEBUG nova.objects.instance [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lazy-loading 'flavor' on Instance uuid 69541e4b-dded-4e7c-9cfa-d93f8824179f {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:21:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 09:21:32 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:21:32 user nova-compute[74039]:   <source dev="/dev/sde"/>
Oct 20 09:21:32 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:21:32 user nova-compute[74039]:   <serial>fbeb0a75-b666-43da-8162-5f3766c2caa9</serial>
Oct 20 09:21:32 user nova-compute[74039]: </disk>
Oct 20 09:21:32 user nova-compute[74039]:  {{(pid=74039) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 09:21:32 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:21:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:21:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:21:32 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] No VIF found with MAC fa:16:3e:53:1c:b8, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:21:32 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-d4c5532f-77f6-47ab-adec-dcc2e54138a5 tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.225s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:21:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:35 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:21:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:21:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:21:36 user nova-compute[74039]: INFO nova.compute.manager [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Detaching volume fbeb0a75-b666-43da-8162-5f3766c2caa9
Oct 20 09:21:36 user nova-compute[74039]: INFO nova.virt.block_device [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Attempting to driver detach volume fbeb0a75-b666-43da-8162-5f3766c2caa9 from mountpoint /dev/vdb
Oct 20 09:21:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Attempting to detach device vdb from instance 69541e4b-dded-4e7c-9cfa-d93f8824179f from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 09:21:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:21:36 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:21:36 user nova-compute[74039]:   <source dev="/dev/sde"/>
Oct 20 09:21:36 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:21:36 user nova-compute[74039]:   <serial>fbeb0a75-b666-43da-8162-5f3766c2caa9</serial>
Oct 20 09:21:36 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:21:36 user nova-compute[74039]: </disk>
Oct 20 09:21:36 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:21:36 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Successfully detached device vdb from instance 69541e4b-dded-4e7c-9cfa-d93f8824179f from the persistent domain config.
Oct 20 09:21:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 69541e4b-dded-4e7c-9cfa-d93f8824179f from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 09:21:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:21:36 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:21:36 user nova-compute[74039]:   <source dev="/dev/sde"/>
Oct 20 09:21:36 user nova-compute[74039]:   <target dev="vdb" bus="virtio"/>
Oct 20 09:21:36 user nova-compute[74039]:   <serial>fbeb0a75-b666-43da-8162-5f3766c2caa9</serial>
Oct 20 09:21:36 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 09:21:36 user nova-compute[74039]: </disk>
Oct 20 09:21:36 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:21:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 69541e4b-dded-4e7c-9cfa-d93f8824179f {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 09:21:37 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:21:37 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:21:37 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Rebuilding the list of instances to heal {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 09:21:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:21:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:21:37 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:21:37 user nova-compute[74039]: DEBUG nova.objects.instance [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lazy-loading 'info_cache' on Instance uuid 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:21:38 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Updating instance_info_cache with network_info: [{"id": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "address": "fa:16:3e:d6:ab:b8", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e6bac4-ee", "ovs_interfaceid": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:21:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:21:38 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:21:38 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:21:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:38 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:21:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:41 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:21:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:45 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:21:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:48 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:21:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:21:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:21:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:21:48 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:21:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:21:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:21:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:21:50 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:21:50 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:21:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8202MB free_disk=25.13018035888672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:21:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:21:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:21:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:21:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:21:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance d109c52e-1d09-4ed1-9c63-97abcf37ff92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:21:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance bd1f0c3b-32f3-4954-b38d-b57e16259234 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:21:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 69541e4b-dded-4e7c-9cfa-d93f8824179f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:21:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance bf598ec2-bd4c-4bd6-b20e-b11617907c77 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:21:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 6939df16-e062-40a1-a705-fe0c03ce647e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:21:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:21:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:21:51 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:21:51 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:21:51 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:21:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:21:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:21:56 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 69541e4b-dded-4e7c-9cfa-d93f8824179f is timed out.
Oct 20 09:21:56 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Successfully detached device vdb from instance 69541e4b-dded-4e7c-9cfa-d93f8824179f from the live domain config.
Oct 20 09:21:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idOPqbTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:21:56 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:21:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd0b492-90bc-46fa-9047-8a38ff4e96ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:21:56 user nova-compute[74039]: No targets found.
Oct 20 09:21:56 user nova-compute[74039]: iSNS:
Oct 20 09:21:56 user nova-compute[74039]: No targets found.
Oct 20 09:21:56 user nova-compute[74039]: STATIC:
Oct 20 09:21:56 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14
Oct 20 09:21:56 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:21:56 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:21:56 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9
Oct 20 09:21:56 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:21:56 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:21:56 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc
Oct 20 09:21:56 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:21:56 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:21:56 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9
Oct 20 09:21:56 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:21:56 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:21:56 user nova-compute[74039]: FIRMWARE:
Oct 20 09:21:56 user nova-compute[74039]: No targets found.
Oct 20 09:21:56 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:21:56 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:21:56 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3b2438-5a9e-4bde-805e-d9402b73614d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9d50b4-f27e-471a-8173-9a504d036ed6]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:21:56 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:21:56 user nova-compute[74039]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)
Oct 20 09:21:56 user nova-compute[74039]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 (non-flash)
Oct 20 09:21:56 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:21:56 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:21:56 user nova-compute[74039]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)
Oct 20 09:21:56 user nova-compute[74039]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 (non-flash)
Oct 20 09:21:56 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae6c4c0a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9'): ({'sde'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Removing single pathed devices sde {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd055f91-f049-402c-a685-d626917b4e50]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb3ff31-1733-42fd-8013-bf8420e4f061]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Flushing IO for device /dev/sde {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dfaf92-4144-4a32-8f8e-817aaaeba9eb]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d335315-2a83-4204-aef5-3d62a071e4f2]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] SCSI volumes sde have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9db5f6-5746-4efb-91cf-a49857769961]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dd6215-405d-4023-a314-a0f911514b43]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9, portal: 172.16.0.220,3260]
Oct 20 09:21:56 user nova-compute[74039]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9, portal: 172.16.0.220,3260] successful.
Oct 20 09:21:56 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbeb0a75-b666-43da-8162-5f3766c2caa9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fae8a57-7dac-44c9-8fdd-2c0b0093507c]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] <== disconnect_volume: return (325ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:21:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:21:57 user nova-compute[74039]: DEBUG nova.objects.instance [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lazy-loading 'flavor' on Instance uuid 69541e4b-dded-4e7c-9cfa-d93f8824179f {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:21:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f75a0180-6633-4770-a0fc-ec7a7a2b426d tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.723s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:21:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Acquiring lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:22:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:22:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Acquiring lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:22:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:22:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:22:17 user nova-compute[74039]: INFO nova.compute.manager [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Terminating instance
Oct 20 09:22:17 user nova-compute[74039]: DEBUG nova.compute.manager [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:22:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG nova.compute.manager [req-98b5d276-e48b-487c-aeac-8c6022edb56f req-75f142bf-e5f3-4296-8ff9-3e77b4a2ab74 service nova] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Received event network-vif-unplugged-eb611398-f36f-449f-8a0f-d2028c761079 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-98b5d276-e48b-487c-aeac-8c6022edb56f req-75f142bf-e5f3-4296-8ff9-3e77b4a2ab74 service nova] Acquiring lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-98b5d276-e48b-487c-aeac-8c6022edb56f req-75f142bf-e5f3-4296-8ff9-3e77b4a2ab74 service nova] Lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-98b5d276-e48b-487c-aeac-8c6022edb56f req-75f142bf-e5f3-4296-8ff9-3e77b4a2ab74 service nova] Lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG nova.compute.manager [req-98b5d276-e48b-487c-aeac-8c6022edb56f req-75f142bf-e5f3-4296-8ff9-3e77b4a2ab74 service nova] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] No waiting events found dispatching network-vif-unplugged-eb611398-f36f-449f-8a0f-d2028c761079 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG nova.compute.manager [req-98b5d276-e48b-487c-aeac-8c6022edb56f req-75f142bf-e5f3-4296-8ff9-3e77b4a2ab74 service nova] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Received event network-vif-unplugged-eb611398-f36f-449f-8a0f-d2028c761079 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:18 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Instance destroyed successfully.
Oct 20 09:22:18 user nova-compute[74039]: DEBUG nova.objects.instance [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lazy-loading 'resources' on Instance uuid d109c52e-1d09-4ed1-9c63-97abcf37ff92 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-849691281',display_name='tempest-ServersNegativeTestJSON-server-849691281',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-849691281',id=39,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:13:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc4517bc9ca141198f7fbc358756a880',ramdisk_id='',reservation_id='r-3eaucgmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1549503071',owner_user_name='tempest-ServersNegativeTestJSON-1549503071-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:13:24Z,user_data=None,user_id='b959b678b5fb44d08c0ef8f113004e91',uuid=d109c52e-1d09-4ed1-9c63-97abcf37ff92,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb611398-f36f-449f-8a0f-d2028c761079", "address": "fa:16:3e:a6:40:db", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb611398-f3", "ovs_interfaceid": "eb611398-f36f-449f-8a0f-d2028c761079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Converting VIF {"id": "eb611398-f36f-449f-8a0f-d2028c761079", "address": "fa:16:3e:a6:40:db", "network": {"id": "55f22c53-eb29-43fd-9039-5f9d4b28eff5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-258725230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc4517bc9ca141198f7fbc358756a880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb611398-f3", "ovs_interfaceid": "eb611398-f36f-449f-8a0f-d2028c761079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:40:db,bridge_name='br-int',has_traffic_filtering=True,id=eb611398-f36f-449f-8a0f-d2028c761079,network=Network(55f22c53-eb29-43fd-9039-5f9d4b28eff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb611398-f3') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG os_vif [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:40:db,bridge_name='br-int',has_traffic_filtering=True,id=eb611398-f36f-449f-8a0f-d2028c761079,network=Network(55f22c53-eb29-43fd-9039-5f9d4b28eff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb611398-f3') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb611398-f3, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c692ba1f-c926-425a-b1a5-bccf1be4eb7d) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:18 user nova-compute[74039]: INFO os_vif [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:40:db,bridge_name='br-int',has_traffic_filtering=True,id=eb611398-f36f-449f-8a0f-d2028c761079,network=Network(55f22c53-eb29-43fd-9039-5f9d4b28eff5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb611398-f3')
Oct 20 09:22:18 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Deleting instance files /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92_del
Oct 20 09:22:18 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Deletion of /opt/stack/data/nova/instances/d109c52e-1d09-4ed1-9c63-97abcf37ff92_del complete
Oct 20 09:22:18 user nova-compute[74039]: INFO nova.compute.manager [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Took 0.66 seconds to destroy the instance on the hypervisor.
Oct 20 09:22:18 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:22:18 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:22:19 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:22:19 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Took 0.65 seconds to deallocate network for instance.
Oct 20 09:22:19 user nova-compute[74039]: DEBUG nova.compute.manager [req-79a5dfc3-1f74-40cb-b524-caa0ebba4138 req-4686ab3a-5064-4952-96d7-80f1c7ddfd6a service nova] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Received event network-vif-deleted-eb611398-f36f-449f-8a0f-d2028c761079 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:22:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:22:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:22:19 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:22:19 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:22:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:22:19 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Deleted allocations for instance d109c52e-1d09-4ed1-9c63-97abcf37ff92
Oct 20 09:22:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e872d713-5e3b-4000-8c4c-94ed6315ebe9 tempest-ServersNegativeTestJSON-1549503071 tempest-ServersNegativeTestJSON-1549503071-project-member] Lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.743s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:22:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-7333ae3d-f5dc-4670-9551-1aa9ca76f51b req-bcf0a1e0-b502-40ad-a005-644ef3c3a127 service nova] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Received event network-vif-plugged-eb611398-f36f-449f-8a0f-d2028c761079 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:22:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7333ae3d-f5dc-4670-9551-1aa9ca76f51b req-bcf0a1e0-b502-40ad-a005-644ef3c3a127 service nova] Acquiring lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:22:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7333ae3d-f5dc-4670-9551-1aa9ca76f51b req-bcf0a1e0-b502-40ad-a005-644ef3c3a127 service nova] Lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:22:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7333ae3d-f5dc-4670-9551-1aa9ca76f51b req-bcf0a1e0-b502-40ad-a005-644ef3c3a127 service nova] Lock "d109c52e-1d09-4ed1-9c63-97abcf37ff92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:22:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-7333ae3d-f5dc-4670-9551-1aa9ca76f51b req-bcf0a1e0-b502-40ad-a005-644ef3c3a127 service nova] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] No waiting events found dispatching network-vif-plugged-eb611398-f36f-449f-8a0f-d2028c761079 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:22:20 user nova-compute[74039]: WARNING nova.compute.manager [req-7333ae3d-f5dc-4670-9551-1aa9ca76f51b req-bcf0a1e0-b502-40ad-a005-644ef3c3a127 service nova] [instance: d109c52e-1d09-4ed1-9c63-97abcf37ff92] Received unexpected event network-vif-plugged-eb611398-f36f-449f-8a0f-d2028c761079 for instance with vm_state deleted and task_state None.
Oct 20 09:22:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:35 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:22:35 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:22:35 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:22:35 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:22:37 user nova-compute[74039]: INFO nova.compute.manager [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Terminating instance
Oct 20 09:22:37 user nova-compute[74039]: DEBUG nova.compute.manager [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG nova.compute.manager [req-2953e953-6d61-4172-8e6c-3b5118fbcc30 req-c953658b-1fae-4e4e-bacb-aba716dcd96a service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received event network-vif-unplugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2953e953-6d61-4172-8e6c-3b5118fbcc30 req-c953658b-1fae-4e4e-bacb-aba716dcd96a service nova] Acquiring lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2953e953-6d61-4172-8e6c-3b5118fbcc30 req-c953658b-1fae-4e4e-bacb-aba716dcd96a service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-2953e953-6d61-4172-8e6c-3b5118fbcc30 req-c953658b-1fae-4e4e-bacb-aba716dcd96a service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG nova.compute.manager [req-2953e953-6d61-4172-8e6c-3b5118fbcc30 req-c953658b-1fae-4e4e-bacb-aba716dcd96a service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] No waiting events found dispatching network-vif-unplugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG nova.compute.manager [req-2953e953-6d61-4172-8e6c-3b5118fbcc30 req-c953658b-1fae-4e4e-bacb-aba716dcd96a service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received event network-vif-unplugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:37 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Instance destroyed successfully.
Oct 20 09:22:37 user nova-compute[74039]: DEBUG nova.objects.instance [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'resources' on Instance uuid bf598ec2-bd4c-4bd6-b20e-b11617907c77 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:17:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-120225547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-120225547',id=44,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:19:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7ed96a82048434fb0d79a55838184e4',ramdisk_id='',reservation_id='r-wsf27t04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:20:51Z,user_data=None,user_id='1e07a52b4e3b4a65b34f71fb2cca8de3',uuid=bf598ec2-bd4c-4bd6-b20e-b11617907c77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "address": "fa:16:3e:36:1e:50", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb89e6-7b", "ovs_interfaceid": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converting VIF {"id": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "address": "fa:16:3e:36:1e:50", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90bb89e6-7b", "ovs_interfaceid": "90bb89e6-7b81-4665-8eac-8979ab44e9d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:1e:50,bridge_name='br-int',has_traffic_filtering=True,id=90bb89e6-7b81-4665-8eac-8979ab44e9d5,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bb89e6-7b') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG os_vif [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:1e:50,bridge_name='br-int',has_traffic_filtering=True,id=90bb89e6-7b81-4665-8eac-8979ab44e9d5,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bb89e6-7b') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90bb89e6-7b, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70bc9a9e-c390-4ea9-a977-196d204f2a81) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:37 user nova-compute[74039]: INFO os_vif [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:1e:50,bridge_name='br-int',has_traffic_filtering=True,id=90bb89e6-7b81-4665-8eac-8979ab44e9d5,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90bb89e6-7b')
Oct 20 09:22:37 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YqRfFSvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:22:37 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:22:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4a5ea6-be34-4bbe-acaa-f89374e3f0e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:22:37 user nova-compute[74039]: No targets found.
Oct 20 09:22:37 user nova-compute[74039]: iSNS:
Oct 20 09:22:37 user nova-compute[74039]: No targets found.
Oct 20 09:22:37 user nova-compute[74039]: STATIC:
Oct 20 09:22:37 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14
Oct 20 09:22:37 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:22:37 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:22:37 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc
Oct 20 09:22:37 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:22:37 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:22:37 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9
Oct 20 09:22:37 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:22:37 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:22:37 user nova-compute[74039]: FIRMWARE:
Oct 20 09:22:37 user nova-compute[74039]: No targets found.
Oct 20 09:22:37 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:22:37 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:22:37 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f99497-3b4c-4eeb-9e39-251665272a6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:22:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d9b042-d719-48cc-aa9f-6a9ab655fa90]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:22:38 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:22:38 user nova-compute[74039]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)
Oct 20 09:22:38 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:22:38 user nova-compute[74039]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 (non-flash)
Oct 20 09:22:38 user nova-compute[74039]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)
Oct 20 09:22:38 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae840f2440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9'): ({'sdb'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Removing single pathed devices sdb {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7906ed80-9f1f-464f-9234-63007c7cbd2d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f827a45c-371f-4392-a320-e0aa151cbb51]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Flushing IO for device /dev/sdb {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6faf939-6158-4ae2-b52e-2efe14e37cbd]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c54a91-975b-4b6e-b0b5-26a7663bf485]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ceaf7a42', '/dev/disk/by-id/scsi-1SCST_BIOceaf7a42-abfa98579cb43a8b', '/dev/disk/by-id/scsi-26162666139383537') {{(pid=85466) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[db03c6c2-646d-4c14-8524-27663d6e289f]: (4, None) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9a1d9c-e078-4cbd-8d1a-ffce48152bcd]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cf4108-7e07-45c7-839e-2fe7e48f7cde]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9, portal: 172.16.0.220,3260]
Oct 20 09:22:38 user nova-compute[74039]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9, portal: 172.16.0.220,3260] successful.
Oct 20 09:22:38 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e1aebe0-9d2e-47de-b29b-037e176f3dd9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81fc5d0-0080-4b97-96d8-1b4dd4df647e]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] <== disconnect_volume: return (303ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:22:38 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Deleting instance files /opt/stack/data/nova/instances/bf598ec2-bd4c-4bd6-b20e-b11617907c77_del
Oct 20 09:22:38 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Deletion of /opt/stack/data/nova/instances/bf598ec2-bd4c-4bd6-b20e-b11617907c77_del complete
Oct 20 09:22:38 user nova-compute[74039]: INFO nova.compute.manager [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 20 09:22:38 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:22:38 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Took 0.51 seconds to deallocate network for instance.
Oct 20 09:22:38 user nova-compute[74039]: DEBUG nova.compute.manager [req-c0a41fd4-a3a5-48ec-bc5d-f58ec6ab090e req-e76268d9-6c48-4713-8d1f-9e731f3b4697 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received event network-vif-deleted-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:22:38 user nova-compute[74039]: INFO nova.compute.manager [req-c0a41fd4-a3a5-48ec-bc5d-f58ec6ab090e req-e76268d9-6c48-4713-8d1f-9e731f3b4697 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Neutron deleted interface 90bb89e6-7b81-4665-8eac-8979ab44e9d5; detaching it from the instance and deleting it from the info cache
Oct 20 09:22:38 user nova-compute[74039]: DEBUG nova.network.neutron [req-c0a41fd4-a3a5-48ec-bc5d-f58ec6ab090e req-e76268d9-6c48-4713-8d1f-9e731f3b4697 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:22:38 user nova-compute[74039]: DEBUG nova.compute.manager [req-c0a41fd4-a3a5-48ec-bc5d-f58ec6ab090e req-e76268d9-6c48-4713-8d1f-9e731f3b4697 service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Detach interface failed, port_id=90bb89e6-7b81-4665-8eac-8979ab44e9d5, reason: Instance bf598ec2-bd4c-4bd6-b20e-b11617907c77 could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 09:22:39 user nova-compute[74039]: DEBUG nova.compute.manager [req-52e4e0d5-6a69-4b55-8e76-1af32f8001f1 req-e47ac635-3048-484a-a4fe-83493db94caf service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received event network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:22:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-52e4e0d5-6a69-4b55-8e76-1af32f8001f1 req-e47ac635-3048-484a-a4fe-83493db94caf service nova] Acquiring lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:22:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-52e4e0d5-6a69-4b55-8e76-1af32f8001f1 req-e47ac635-3048-484a-a4fe-83493db94caf service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:22:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-52e4e0d5-6a69-4b55-8e76-1af32f8001f1 req-e47ac635-3048-484a-a4fe-83493db94caf service nova] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:22:39 user nova-compute[74039]: DEBUG nova.compute.manager [req-52e4e0d5-6a69-4b55-8e76-1af32f8001f1 req-e47ac635-3048-484a-a4fe-83493db94caf service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] No waiting events found dispatching network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:22:39 user nova-compute[74039]: WARNING nova.compute.manager [req-52e4e0d5-6a69-4b55-8e76-1af32f8001f1 req-e47ac635-3048-484a-a4fe-83493db94caf service nova] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Received unexpected event network-vif-plugged-90bb89e6-7b81-4665-8eac-8979ab44e9d5 for instance with vm_state active and task_state deleting.
Oct 20 09:22:39 user nova-compute[74039]: INFO nova.compute.manager [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bf598ec2-bd4c-4bd6-b20e-b11617907c77] Took 0.86 seconds to detach 1 volumes for instance.
Oct 20 09:22:39 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:22:39 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:22:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:22:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:22:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:22:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:22:39 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:22:39 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:22:39 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:22:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:22:40 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Deleted allocations for instance bf598ec2-bd4c-4bd6-b20e-b11617907c77
Oct 20 09:22:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-6e0d748d-9a14-424b-b0b1-1835c4053233 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "bf598ec2-bd4c-4bd6-b20e-b11617907c77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.966s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:22:40 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Updating instance_info_cache with network_info: [{"id": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "address": "fa:16:3e:63:49:5e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc0a1c-ee", "ovs_interfaceid": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:22:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:22:40 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:22:40 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:22:42 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:22:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:45 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:22:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:22:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:22:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:22:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:22:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:22:48 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:22:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:22:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:22:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:22:48 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:22:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:22:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:22:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:22:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:22:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:22:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:22:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:22:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:22:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:22:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:22:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:22:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:22:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:22:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:22:50 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:22:50 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:22:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8473MB free_disk=25.156585693359375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:22:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:22:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:22:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:22:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:22:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance bd1f0c3b-32f3-4954-b38d-b57e16259234 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:22:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 69541e4b-dded-4e7c-9cfa-d93f8824179f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:22:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 6939df16-e062-40a1-a705-fe0c03ce647e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:22:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:22:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:22:50 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:22:50 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:22:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:22:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:22:50 user nova-compute[74039]: DEBUG nova.compute.manager [req-5ab85fe4-cc3a-4689-8e42-31f913a4eda8 req-569faaa0-9950-4e47-81d6-050f032f299d service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Received event network-changed-69b9c433-1e21-4b68-a843-9866dc032a2d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:22:50 user nova-compute[74039]: DEBUG nova.compute.manager [req-5ab85fe4-cc3a-4689-8e42-31f913a4eda8 req-569faaa0-9950-4e47-81d6-050f032f299d service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Refreshing instance network info cache due to event network-changed-69b9c433-1e21-4b68-a843-9866dc032a2d. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:22:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5ab85fe4-cc3a-4689-8e42-31f913a4eda8 req-569faaa0-9950-4e47-81d6-050f032f299d service nova] Acquiring lock "refresh_cache-6939df16-e062-40a1-a705-fe0c03ce647e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:22:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5ab85fe4-cc3a-4689-8e42-31f913a4eda8 req-569faaa0-9950-4e47-81d6-050f032f299d service nova] Acquired lock "refresh_cache-6939df16-e062-40a1-a705-fe0c03ce647e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:22:50 user nova-compute[74039]: DEBUG nova.network.neutron [req-5ab85fe4-cc3a-4689-8e42-31f913a4eda8 req-569faaa0-9950-4e47-81d6-050f032f299d service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Refreshing network info cache for port 69b9c433-1e21-4b68-a843-9866dc032a2d {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:22:51 user nova-compute[74039]: DEBUG nova.network.neutron [req-5ab85fe4-cc3a-4689-8e42-31f913a4eda8 req-569faaa0-9950-4e47-81d6-050f032f299d service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Updated VIF entry in instance network info cache for port 69b9c433-1e21-4b68-a843-9866dc032a2d. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:22:51 user nova-compute[74039]: DEBUG nova.network.neutron [req-5ab85fe4-cc3a-4689-8e42-31f913a4eda8 req-569faaa0-9950-4e47-81d6-050f032f299d service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Updating instance_info_cache with network_info: [{"id": "69b9c433-1e21-4b68-a843-9866dc032a2d", "address": "fa:16:3e:66:bb:54", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9c433-1e", "ovs_interfaceid": "69b9c433-1e21-4b68-a843-9866dc032a2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:22:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5ab85fe4-cc3a-4689-8e42-31f913a4eda8 req-569faaa0-9950-4e47-81d6-050f032f299d service nova] Releasing lock "refresh_cache-6939df16-e062-40a1-a705-fe0c03ce647e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:22:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:22:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:56 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:22:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:22:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "7adabc8f-9975-4db0-9b0b-728753fb42d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "7adabc8f-9975-4db0-9b0b-728753fb42d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:04 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:23:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:04 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:23:04 user nova-compute[74039]: INFO nova.compute.claims [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Claim successful on node user
Oct 20 09:23:04 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:23:04 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:23:04 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:04 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:23:04 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:23:04 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:23:04 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:23:04 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:23:04 user nova-compute[74039]: INFO nova.virt.block_device [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Booting with volume snapshot 4810e184-bb7b-44c7-a28e-375f83776857 at /dev/vda
Oct 20 09:23:04 user nova-compute[74039]: DEBUG nova.policy [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d68ed2131b34e57a5f10a01409fee62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367334c57f8f47b696a477460afba369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:23:05 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Successfully created port: 0ca94546-dc77-45a3-9032-26b264c49756 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:23:05 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Successfully updated port: 0ca94546-dc77-45a3-9032-26b264c49756 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:23:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "refresh_cache-7adabc8f-9975-4db0-9b0b-728753fb42d5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:23:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquired lock "refresh_cache-7adabc8f-9975-4db0-9b0b-728753fb42d5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:23:05 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:23:05 user nova-compute[74039]: DEBUG nova.compute.manager [req-de3f8010-3228-471a-93d1-02c721dc39f8 req-641ae6e5-f775-4326-9921-132e2e62ca0d service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Received event network-changed-0ca94546-dc77-45a3-9032-26b264c49756 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:23:05 user nova-compute[74039]: DEBUG nova.compute.manager [req-de3f8010-3228-471a-93d1-02c721dc39f8 req-641ae6e5-f775-4326-9921-132e2e62ca0d service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Refreshing instance network info cache due to event network-changed-0ca94546-dc77-45a3-9032-26b264c49756. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:23:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-de3f8010-3228-471a-93d1-02c721dc39f8 req-641ae6e5-f775-4326-9921-132e2e62ca0d service nova] Acquiring lock "refresh_cache-7adabc8f-9975-4db0-9b0b-728753fb42d5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:23:05 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:23:06 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Updating instance_info_cache with network_info: [{"id": "0ca94546-dc77-45a3-9032-26b264c49756", "address": "fa:16:3e:8f:47:3c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca94546-dc", "ovs_interfaceid": "0ca94546-dc77-45a3-9032-26b264c49756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:23:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Releasing lock "refresh_cache-7adabc8f-9975-4db0-9b0b-728753fb42d5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:23:06 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Instance network_info: |[{"id": "0ca94546-dc77-45a3-9032-26b264c49756", "address": "fa:16:3e:8f:47:3c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca94546-dc", "ovs_interfaceid": "0ca94546-dc77-45a3-9032-26b264c49756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:23:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-de3f8010-3228-471a-93d1-02c721dc39f8 req-641ae6e5-f775-4326-9921-132e2e62ca0d service nova] Acquired lock "refresh_cache-7adabc8f-9975-4db0-9b0b-728753fb42d5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:23:06 user nova-compute[74039]: DEBUG nova.network.neutron [req-de3f8010-3228-471a-93d1-02c721dc39f8 req-641ae6e5-f775-4326-9921-132e2e62ca0d service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Refreshing network info cache for port 0ca94546-dc77-45a3-9032-26b264c49756 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:23:06 user nova-compute[74039]: DEBUG nova.network.neutron [req-de3f8010-3228-471a-93d1-02c721dc39f8 req-641ae6e5-f775-4326-9921-132e2e62ca0d service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Updated VIF entry in instance network info cache for port 0ca94546-dc77-45a3-9032-26b264c49756. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:23:06 user nova-compute[74039]: DEBUG nova.network.neutron [req-de3f8010-3228-471a-93d1-02c721dc39f8 req-641ae6e5-f775-4326-9921-132e2e62ca0d service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Updating instance_info_cache with network_info: [{"id": "0ca94546-dc77-45a3-9032-26b264c49756", "address": "fa:16:3e:8f:47:3c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca94546-dc", "ovs_interfaceid": "0ca94546-dc77-45a3-9032-26b264c49756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:23:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-de3f8010-3228-471a-93d1-02c721dc39f8 req-641ae6e5-f775-4326-9921-132e2e62ca0d service nova] Releasing lock "refresh_cache-7adabc8f-9975-4db0-9b0b-728753fb42d5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:23:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:23:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:23:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:23:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:23:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG os_brick.utils [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af2b5cd-93ce-425f-b4ed-13cf0f9acaa1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1335305-44cc-4f37-80c8-5f49d1bb35a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a5c71e-afbc-4936-b6fd-61cf42156fc5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b0a3d0-1b98-462c-b0ec-0f42a4ab1d7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:23:10 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:23:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[947311e3-7d22-40ba-9d9a-839b782037a4]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG os_brick.utils [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:23:10 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Updating existing volume attachment record: 9fe19700-24ba-4929-a014-dce848656818 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:23:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "1cdbf79e-90b7-4746-8286-8f69277c71c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:20 user nova-compute[74039]: DEBUG nova.compute.manager [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:23:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:20 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:23:20 user nova-compute[74039]: INFO nova.compute.claims [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Claim successful on node user
Oct 20 09:23:21 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:23:21 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:23:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:21 user nova-compute[74039]: DEBUG nova.compute.manager [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:23:21 user nova-compute[74039]: DEBUG nova.compute.manager [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:23:21 user nova-compute[74039]: DEBUG nova.network.neutron [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:23:21 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:23:21 user nova-compute[74039]: DEBUG nova.compute.manager [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:23:21 user nova-compute[74039]: DEBUG nova.policy [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd7771575aef439ebf1d55d3c4dcc377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235f30d0612f4bfba028314ba7155dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:23:21 user nova-compute[74039]: DEBUG nova.compute.manager [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:23:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:23:21 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Creating image(s)
Oct 20 09:23:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "/opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "/opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "/opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.222s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.192s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk 1073741824" returned: 0 in 0.054s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:22 user nova-compute[74039]: DEBUG nova.network.neutron [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Successfully created port: 401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:23:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.241s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:22 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:23:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:22 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:22 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Cannot resize image /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:23:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:23:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Ensure instance console log exists: /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:23:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.network.neutron [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Successfully updated port: 401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquired lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.network.neutron [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.network.neutron [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-ab1e20eb-1d94-4d18-a703-41026287d01e req-3701a8b9-2810-45e7-93cb-f3c7843898fe service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received event network-changed-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-ab1e20eb-1d94-4d18-a703-41026287d01e req-3701a8b9-2810-45e7-93cb-f3c7843898fe service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Refreshing instance network info cache due to event network-changed-401cb923-c809-4d13-8811-ac2e26bab571. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ab1e20eb-1d94-4d18-a703-41026287d01e req-3701a8b9-2810-45e7-93cb-f3c7843898fe service nova] Acquiring lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.network.neutron [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Updating instance_info_cache with network_info: [{"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Releasing lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.compute.manager [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Instance network_info: |[{"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ab1e20eb-1d94-4d18-a703-41026287d01e req-3701a8b9-2810-45e7-93cb-f3c7843898fe service nova] Acquired lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.network.neutron [req-ab1e20eb-1d94-4d18-a703-41026287d01e req-3701a8b9-2810-45e7-93cb-f3c7843898fe service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Refreshing network info cache for port 401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Start _get_guest_xml network_info=[{"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:23:23 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:23:23 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:23:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-890462872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-890462872',id=48,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTYRbiu5Cmg+KEfhGZotfGpvgUcK4Dd565SZY8zSSnNi464CjCWyuaB6Fdk7pfl8N2qugu2uYO1MXw3EVvETszsJ2uFQVRR375OQj8nISw4lFiUuufNVNOw3M4sMthB5w==',key_name='tempest-keypair-931468445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='235f30d0612f4bfba028314ba7155dcf',ramdisk_id='',reservation_id='r-4jx12o7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1190516011',owner_user_name='tempest-AttachVolumeShelveTestJSON-1190516011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd7771575aef439ebf1d55d3c4dcc377',uuid=1cdbf79e-90b7-4746-8286-8f69277c71c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converting VIF {"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=401cb923-c809-4d13-8811-ac2e26bab571,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401cb923-c8') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.objects.instance [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'pci_devices' on Instance uuid 1cdbf79e-90b7-4746-8286-8f69277c71c5 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:23:23 user nova-compute[74039]:   <uuid>1cdbf79e-90b7-4746-8286-8f69277c71c5</uuid>
Oct 20 09:23:23 user nova-compute[74039]:   <name>instance-00000030</name>
Oct 20 09:23:23 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:23:23 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:23:23 user nova-compute[74039]:   <metadata>
Oct 20 09:23:23 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:23:23 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:23:23 user nova-compute[74039]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-890462872</nova:name>
Oct 20 09:23:23 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:23:23</nova:creationTime>
Oct 20 09:23:23 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:23:23 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:23:23 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:23:23 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:23:23 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:23:23 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:23:23 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:23:23 user nova-compute[74039]:       <nova:owner>
Oct 20 09:23:23 user nova-compute[74039]:         <nova:user uuid="bd7771575aef439ebf1d55d3c4dcc377">tempest-AttachVolumeShelveTestJSON-1190516011-project-member</nova:user>
Oct 20 09:23:23 user nova-compute[74039]:         <nova:project uuid="235f30d0612f4bfba028314ba7155dcf">tempest-AttachVolumeShelveTestJSON-1190516011</nova:project>
Oct 20 09:23:23 user nova-compute[74039]:       </nova:owner>
Oct 20 09:23:23 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:23:23 user nova-compute[74039]:       <nova:ports>
Oct 20 09:23:23 user nova-compute[74039]:         <nova:port uuid="401cb923-c809-4d13-8811-ac2e26bab571">
Oct 20 09:23:23 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 09:23:23 user nova-compute[74039]:         </nova:port>
Oct 20 09:23:23 user nova-compute[74039]:       </nova:ports>
Oct 20 09:23:23 user nova-compute[74039]:     </nova:instance>
Oct 20 09:23:23 user nova-compute[74039]:   </metadata>
Oct 20 09:23:23 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:23:23 user nova-compute[74039]:     <system>
Oct 20 09:23:23 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:23:23 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:23:23 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:23:23 user nova-compute[74039]:       <entry name="serial">1cdbf79e-90b7-4746-8286-8f69277c71c5</entry>
Oct 20 09:23:23 user nova-compute[74039]:       <entry name="uuid">1cdbf79e-90b7-4746-8286-8f69277c71c5</entry>
Oct 20 09:23:23 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:23:23 user nova-compute[74039]:     </system>
Oct 20 09:23:23 user nova-compute[74039]:   </sysinfo>
Oct 20 09:23:23 user nova-compute[74039]:   <os>
Oct 20 09:23:23 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:23:23 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:23:23 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:23:23 user nova-compute[74039]:   </os>
Oct 20 09:23:23 user nova-compute[74039]:   <features>
Oct 20 09:23:23 user nova-compute[74039]:     <acpi/>
Oct 20 09:23:23 user nova-compute[74039]:     <apic/>
Oct 20 09:23:23 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:23:23 user nova-compute[74039]:   </features>
Oct 20 09:23:23 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:23:23 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:23:23 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:23:23 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:23:23 user nova-compute[74039]:   </clock>
Oct 20 09:23:23 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:23:23 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:23:23 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:23:23 user nova-compute[74039]:   </cpu>
Oct 20 09:23:23 user nova-compute[74039]:   <devices>
Oct 20 09:23:23 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:23:23 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:23:23 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk"/>
Oct 20 09:23:23 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:23:23 user nova-compute[74039]:     </disk>
Oct 20 09:23:23 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:23:23 user nova-compute[74039]:       <mac address="fa:16:3e:57:e1:1e"/>
Oct 20 09:23:23 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:23:23 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:23:23 user nova-compute[74039]:       <target dev="tap401cb923-c8"/>
Oct 20 09:23:23 user nova-compute[74039]:     </interface>
Oct 20 09:23:23 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:23:23 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/console.log" append="off"/>
Oct 20 09:23:23 user nova-compute[74039]:     </serial>
Oct 20 09:23:23 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:23:23 user nova-compute[74039]:     <video>
Oct 20 09:23:23 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:23:23 user nova-compute[74039]:     </video>
Oct 20 09:23:23 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:23:23 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:23:23 user nova-compute[74039]:     </rng>
Oct 20 09:23:23 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:23:23 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:23:23 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:23:23 user nova-compute[74039]:     </memballoon>
Oct 20 09:23:23 user nova-compute[74039]:   </devices>
Oct 20 09:23:23 user nova-compute[74039]: </domain>
Oct 20 09:23:23 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:23:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-890462872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-890462872',id=48,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTYRbiu5Cmg+KEfhGZotfGpvgUcK4Dd565SZY8zSSnNi464CjCWyuaB6Fdk7pfl8N2qugu2uYO1MXw3EVvETszsJ2uFQVRR375OQj8nISw4lFiUuufNVNOw3M4sMthB5w==',key_name='tempest-keypair-931468445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='235f30d0612f4bfba028314ba7155dcf',ramdisk_id='',reservation_id='r-4jx12o7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1190516011',owner_user_name='tempest-AttachVolumeShelveTestJSON-1190516011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd7771575aef439ebf1d55d3c4dcc377',uuid=1cdbf79e-90b7-4746-8286-8f69277c71c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converting VIF {"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=401cb923-c809-4d13-8811-ac2e26bab571,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401cb923-c8') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG os_vif [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=401cb923-c809-4d13-8811-ac2e26bab571,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401cb923-c8') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a92c888-46fb-574f-8ff8-27c5a3877578', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap401cb923-c8, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap401cb923-c8, col_values=(('qos', UUID('d260a539-cfad-44e2-989b-64fd0da1b437')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap401cb923-c8, col_values=(('external_ids', {'iface-id': '401cb923-c809-4d13-8811-ac2e26bab571', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:e1:1e', 'vm-uuid': '1cdbf79e-90b7-4746-8286-8f69277c71c5'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:23 user nova-compute[74039]: INFO os_vif [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=401cb923-c809-4d13-8811-ac2e26bab571,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401cb923-c8')
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] No VIF found with MAC fa:16:3e:57:e1:1e, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.network.neutron [req-ab1e20eb-1d94-4d18-a703-41026287d01e req-3701a8b9-2810-45e7-93cb-f3c7843898fe service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Updated VIF entry in instance network info cache for port 401cb923-c809-4d13-8811-ac2e26bab571. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG nova.network.neutron [req-ab1e20eb-1d94-4d18-a703-41026287d01e req-3701a8b9-2810-45e7-93cb-f3c7843898fe service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Updating instance_info_cache with network_info: [{"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:23:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ab1e20eb-1d94-4d18-a703-41026287d01e req-3701a8b9-2810-45e7-93cb-f3c7843898fe service nova] Releasing lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:23:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:25 user nova-compute[74039]: DEBUG nova.compute.manager [req-dd233513-0a0f-45ad-b980-c0523d59156a req-19cb9bb6-5003-438f-b49e-dac2bb412771 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received event network-vif-plugged-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:23:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-dd233513-0a0f-45ad-b980-c0523d59156a req-19cb9bb6-5003-438f-b49e-dac2bb412771 service nova] Acquiring lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-dd233513-0a0f-45ad-b980-c0523d59156a req-19cb9bb6-5003-438f-b49e-dac2bb412771 service nova] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-dd233513-0a0f-45ad-b980-c0523d59156a req-19cb9bb6-5003-438f-b49e-dac2bb412771 service nova] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:25 user nova-compute[74039]: DEBUG nova.compute.manager [req-dd233513-0a0f-45ad-b980-c0523d59156a req-19cb9bb6-5003-438f-b49e-dac2bb412771 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] No waiting events found dispatching network-vif-plugged-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:23:25 user nova-compute[74039]: WARNING nova.compute.manager [req-dd233513-0a0f-45ad-b980-c0523d59156a req-19cb9bb6-5003-438f-b49e-dac2bb412771 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received unexpected event network-vif-plugged-401cb923-c809-4d13-8811-ac2e26bab571 for instance with vm_state building and task_state spawning.
Oct 20 09:23:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:27 user nova-compute[74039]: DEBUG nova.compute.manager [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:23:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:23:27 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Instance spawned successfully.
Oct 20 09:23:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:23:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:23:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:23:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:23:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:23:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:23:27 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:23:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-4b532b17-7cb6-4e5f-b8cf-7b8eddaa0636 req-b77295f6-8821-4e77-bdb7-897b8d3581e9 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received event network-vif-plugged-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:23:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4b532b17-7cb6-4e5f-b8cf-7b8eddaa0636 req-b77295f6-8821-4e77-bdb7-897b8d3581e9 service nova] Acquiring lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4b532b17-7cb6-4e5f-b8cf-7b8eddaa0636 req-b77295f6-8821-4e77-bdb7-897b8d3581e9 service nova] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4b532b17-7cb6-4e5f-b8cf-7b8eddaa0636 req-b77295f6-8821-4e77-bdb7-897b8d3581e9 service nova] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-4b532b17-7cb6-4e5f-b8cf-7b8eddaa0636 req-b77295f6-8821-4e77-bdb7-897b8d3581e9 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] No waiting events found dispatching network-vif-plugged-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:23:27 user nova-compute[74039]: WARNING nova.compute.manager [req-4b532b17-7cb6-4e5f-b8cf-7b8eddaa0636 req-b77295f6-8821-4e77-bdb7-897b8d3581e9 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received unexpected event network-vif-plugged-401cb923-c809-4d13-8811-ac2e26bab571 for instance with vm_state building and task_state spawning.
Oct 20 09:23:27 user nova-compute[74039]: INFO nova.compute.manager [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Took 5.69 seconds to spawn the instance on the hypervisor.
Oct 20 09:23:27 user nova-compute[74039]: DEBUG nova.compute.manager [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:23:27 user nova-compute[74039]: INFO nova.compute.manager [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Took 6.55 seconds to build instance.
Oct 20 09:23:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3383cce5-a405-403c-a090-53cea2ef55f1 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.662s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "bd1f0c3b-32f3-4954-b38d-b57e16259234" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:27 user nova-compute[74039]: INFO nova.compute.manager [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Terminating instance
Oct 20 09:23:27 user nova-compute[74039]: DEBUG nova.compute.manager [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-43fd14e4-115d-4a95-a4e4-bf99fa10ad03 req-bd9da083-b2da-46ab-b4e7-0bce6be585e5 service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Received event network-vif-unplugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-43fd14e4-115d-4a95-a4e4-bf99fa10ad03 req-bd9da083-b2da-46ab-b4e7-0bce6be585e5 service nova] Acquiring lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-43fd14e4-115d-4a95-a4e4-bf99fa10ad03 req-bd9da083-b2da-46ab-b4e7-0bce6be585e5 service nova] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-43fd14e4-115d-4a95-a4e4-bf99fa10ad03 req-bd9da083-b2da-46ab-b4e7-0bce6be585e5 service nova] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-43fd14e4-115d-4a95-a4e4-bf99fa10ad03 req-bd9da083-b2da-46ab-b4e7-0bce6be585e5 service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] No waiting events found dispatching network-vif-unplugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-43fd14e4-115d-4a95-a4e4-bf99fa10ad03 req-bd9da083-b2da-46ab-b4e7-0bce6be585e5 service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Received event network-vif-unplugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:28 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Instance destroyed successfully.
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.objects.instance [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'resources' on Instance uuid bd1f0c3b-32f3-4954-b38d-b57e16259234 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1928279480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1928279480',id=40,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:14:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7ed96a82048434fb0d79a55838184e4',ramdisk_id='',reservation_id='r-1w2prayl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:16:03Z,user_data=None,user_id='1e07a52b4e3b4a65b34f71fb2cca8de3',uuid=bd1f0c3b-32f3-4954-b38d-b57e16259234,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "address": "fa:16:3e:b2:6d:1e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fed849-1f", "ovs_interfaceid": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converting VIF {"id": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "address": "fa:16:3e:b2:6d:1e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fed849-1f", "ovs_interfaceid": "d9fed849-1f54-4316-8ba3-26c92e7f41cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:6d:1e,bridge_name='br-int',has_traffic_filtering=True,id=d9fed849-1f54-4316-8ba3-26c92e7f41cc,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fed849-1f') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG os_vif [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:6d:1e,bridge_name='br-int',has_traffic_filtering=True,id=d9fed849-1f54-4316-8ba3-26c92e7f41cc,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fed849-1f') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9fed849-1f, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25168779-6d94-4b51-b271-fe0b8d8b2acf) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:23:28 user nova-compute[74039]: INFO os_vif [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:6d:1e,bridge_name='br-int',has_traffic_filtering=True,id=d9fed849-1f54-4316-8ba3-26c92e7f41cc,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fed849-1f')
Oct 20 09:23:28 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Deleting instance files /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234_del
Oct 20 09:23:28 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Deletion of /opt/stack/data/nova/instances/bd1f0c3b-32f3-4954-b38d-b57e16259234_del complete
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:23:28 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Creating image(s)
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Did not create local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Ensure instance console log exists: /opt/stack/data/nova/instances/7adabc8f-9975-4db0-9b0b-728753fb42d5/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Start _get_guest_xml network_info=[{"id": "0ca94546-dc77-45a3-9032-26b264c49756", "address": "fa:16:3e:8f:47:3c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca94546-dc", "ovs_interfaceid": "0ca94546-dc77-45a3-9032-26b264c49756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-20T09:22:52Z,direct_url=<?>,disk_format='qcow2',id=003de5c4-e4fd-4804-9000-de81aedeaa82,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-396673302',owner='367334c57f8f47b696a477460afba369',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-20T09:22:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9fe19700-24ba-4929-a014-dce848656818', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UfSoKXud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7adabc8f-9975-4db0-9b0b-728753fb42d5', 'attached_at': '', 'detached_at': '', 'volume_id': 'b48a9867-ef37-4f71-8b1e-458640701e4d', 'serial': 'b48a9867-ef37-4f71-8b1e-458640701e4d'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:23:28 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:23:28 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-20T09:22:52Z,direct_url=<?>,disk_format='qcow2',id=003de5c4-e4fd-4804-9000-de81aedeaa82,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-396673302',owner='367334c57f8f47b696a477460afba369',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-20T09:22:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UfSoKXud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:23:28 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:23:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:23:28 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:23:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:23:28 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:28 user nova-compute[74039]: INFO nova.compute.manager [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Took 0.76 seconds to destroy the instance on the hypervisor.
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ceafeb-0a78-45f2-8746-21088764037b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:23:28 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9508fe2-be47-431a-9aec-8b0ce5e9091a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d] added
Oct 20 09:23:28 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[086d47fe-8f05-44a4-8551-edc1a0ec61ac]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7f5028-55bf-4977-b2b9-8b7d431c0592]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UfSoKXud {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UfSoKXud" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5a7a5b-397a-4403-a8ab-800599d0b217]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UfSoKXud'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4ab49c-05ae-4378-8084-fb24e70c8f19]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7fa4c3-a91e-44bd-9249-cc86cbf9aab9]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:23:28 user nova-compute[74039]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)
Oct 20 09:23:28 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:23:28 user nova-compute[74039]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)
Oct 20 09:23:28 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:23:28 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:29 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:23:29 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Took 0.93 seconds to deallocate network for instance.
Oct 20 09:23:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:29 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:29 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:23:29 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:23:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 --login" returned: 0 in 1.089s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:29 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bc735d-cd40-49dc-a07a-7590e1352dfd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:23:29 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d, portal: 172.16.0.220,3260]
Oct 20 09:23:29 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d, portal: 172.16.0.220,3260] successful.
Oct 20 09:23:29 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a2e194-d6a9-42c3-82fe-43404920fc44]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[13499f36-ad77-4aa7-bef6-761e2d44b184]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:23:30 user nova-compute[74039]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)
Oct 20 09:23:30 user nova-compute[74039]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d (non-flash)
Oct 20 09:23:30 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:23:30 user nova-compute[74039]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)
Oct 20 09:23:30 user nova-compute[74039]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d (non-flash)
Oct 20 09:23:30 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.362s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:23:30 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Deleted allocations for instance bd1f0c3b-32f3-4954-b38d-b57e16259234
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbf07ee-f094-4d8c-bea3-40ba0d5fc23c]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UfSoKXud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-00c7ec50-f3cd-47ec-bb91-96821e02d867 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.241s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Received event network-vif-plugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] Acquiring lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] No waiting events found dispatching network-vif-plugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:23:30 user nova-compute[74039]: WARNING nova.compute.manager [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Received unexpected event network-vif-plugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc for instance with vm_state deleted and task_state None.
Oct 20 09:23:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Received event network-vif-plugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] Acquiring lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] No waiting events found dispatching network-vif-plugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:23:30 user nova-compute[74039]: WARNING nova.compute.manager [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Received unexpected event network-vif-plugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc for instance with vm_state deleted and task_state None.
Oct 20 09:23:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Received event network-vif-plugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] Acquiring lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] No waiting events found dispatching network-vif-plugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:23:30 user nova-compute[74039]: WARNING nova.compute.manager [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Received unexpected event network-vif-plugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc for instance with vm_state deleted and task_state None.
Oct 20 09:23:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Received event network-vif-plugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] Acquiring lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] Lock "bd1f0c3b-32f3-4954-b38d-b57e16259234-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] No waiting events found dispatching network-vif-plugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:23:30 user nova-compute[74039]: WARNING nova.compute.manager [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Received unexpected event network-vif-plugged-d9fed849-1f54-4316-8ba3-26c92e7f41cc for instance with vm_state deleted and task_state None.
Oct 20 09:23:30 user nova-compute[74039]: DEBUG nova.compute.manager [req-5c1e1700-03c8-4490-b02b-b813d938e13a req-af9cb3e2-820e-4f13-b1bf-cc0d8725ce31 service nova] [instance: bd1f0c3b-32f3-4954-b38d-b57e16259234] Received event network-vif-deleted-d9fed849-1f54-4316-8ba3-26c92e7f41cc {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.404s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] <== connect_volume: return (2406ms) {'type': 'block', 'scsi_wwn': '26261653633656234', 'path': '/dev/sdb'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261653633656234', 'path': '/dev/sdb'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:23:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1155087958',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1155087958',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1155087958',id=47,image_ref='003de5c4-e4fd-4804-9000-de81aedeaa82',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNmE2mrLnJ6cDQioKayaTcWOrB9EzbtdgsG5Sfmnyadrv5cs4DHSJSD5q95dc+8u3HqZ0HCadjo/Nm2bs1eRPocnl+afhtfsoyrP/2aiGe9bR4qyxQE1zZwPbmrJdIVaA==',key_name='tempest-keypair-482360881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='367334c57f8f47b696a477460afba369',ramdisk_id='',reservation_id='r-cgodpeth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1725287482',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725287482',owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:23:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d68ed2131b34e57a5f10a01409fee62',uuid=7adabc8f-9975-4db0-9b0b-728753fb42d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ca94546-dc77-45a3-9032-26b264c49756", "address": "fa:16:3e:8f:47:3c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca94546-dc", "ovs_interfaceid": "0ca94546-dc77-45a3-9032-26b264c49756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converting VIF {"id": "0ca94546-dc77-45a3-9032-26b264c49756", "address": "fa:16:3e:8f:47:3c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca94546-dc", "ovs_interfaceid": "0ca94546-dc77-45a3-9032-26b264c49756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:47:3c,bridge_name='br-int',has_traffic_filtering=True,id=0ca94546-dc77-45a3-9032-26b264c49756,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca94546-dc') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG nova.objects.instance [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lazy-loading 'pci_devices' on Instance uuid 7adabc8f-9975-4db0-9b0b-728753fb42d5 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:23:31 user nova-compute[74039]:   <uuid>7adabc8f-9975-4db0-9b0b-728753fb42d5</uuid>
Oct 20 09:23:31 user nova-compute[74039]:   <name>instance-0000002f</name>
Oct 20 09:23:31 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:23:31 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:23:31 user nova-compute[74039]:   <metadata>
Oct 20 09:23:31 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:23:31 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:23:31 user nova-compute[74039]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1155087958</nova:name>
Oct 20 09:23:31 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:23:28</nova:creationTime>
Oct 20 09:23:31 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:23:31 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:23:31 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:23:31 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:23:31 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:23:31 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:23:31 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:23:31 user nova-compute[74039]:       <nova:owner>
Oct 20 09:23:31 user nova-compute[74039]:         <nova:user uuid="8d68ed2131b34e57a5f10a01409fee62">tempest-TestVolumeBootPattern-1725287482-project-member</nova:user>
Oct 20 09:23:31 user nova-compute[74039]:         <nova:project uuid="367334c57f8f47b696a477460afba369">tempest-TestVolumeBootPattern-1725287482</nova:project>
Oct 20 09:23:31 user nova-compute[74039]:       </nova:owner>
Oct 20 09:23:31 user nova-compute[74039]:       <nova:root type="image" uuid="003de5c4-e4fd-4804-9000-de81aedeaa82"/>
Oct 20 09:23:31 user nova-compute[74039]:       <nova:ports>
Oct 20 09:23:31 user nova-compute[74039]:         <nova:port uuid="0ca94546-dc77-45a3-9032-26b264c49756">
Oct 20 09:23:31 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 09:23:31 user nova-compute[74039]:         </nova:port>
Oct 20 09:23:31 user nova-compute[74039]:       </nova:ports>
Oct 20 09:23:31 user nova-compute[74039]:     </nova:instance>
Oct 20 09:23:31 user nova-compute[74039]:   </metadata>
Oct 20 09:23:31 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:23:31 user nova-compute[74039]:     <system>
Oct 20 09:23:31 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:23:31 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:23:31 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:23:31 user nova-compute[74039]:       <entry name="serial">7adabc8f-9975-4db0-9b0b-728753fb42d5</entry>
Oct 20 09:23:31 user nova-compute[74039]:       <entry name="uuid">7adabc8f-9975-4db0-9b0b-728753fb42d5</entry>
Oct 20 09:23:31 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:23:31 user nova-compute[74039]:     </system>
Oct 20 09:23:31 user nova-compute[74039]:   </sysinfo>
Oct 20 09:23:31 user nova-compute[74039]:   <os>
Oct 20 09:23:31 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:23:31 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:23:31 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:23:31 user nova-compute[74039]:   </os>
Oct 20 09:23:31 user nova-compute[74039]:   <features>
Oct 20 09:23:31 user nova-compute[74039]:     <acpi/>
Oct 20 09:23:31 user nova-compute[74039]:     <apic/>
Oct 20 09:23:31 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:23:31 user nova-compute[74039]:   </features>
Oct 20 09:23:31 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:23:31 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:23:31 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:23:31 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:23:31 user nova-compute[74039]:   </clock>
Oct 20 09:23:31 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:23:31 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:23:31 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:23:31 user nova-compute[74039]:   </cpu>
Oct 20 09:23:31 user nova-compute[74039]:   <devices>
Oct 20 09:23:31 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 09:23:31 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:23:31 user nova-compute[74039]:       <source dev="/dev/sdb"/>
Oct 20 09:23:31 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:23:31 user nova-compute[74039]:       <serial>b48a9867-ef37-4f71-8b1e-458640701e4d</serial>
Oct 20 09:23:31 user nova-compute[74039]:     </disk>
Oct 20 09:23:31 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:23:31 user nova-compute[74039]:       <mac address="fa:16:3e:8f:47:3c"/>
Oct 20 09:23:31 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:23:31 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:23:31 user nova-compute[74039]:       <target dev="tap0ca94546-dc"/>
Oct 20 09:23:31 user nova-compute[74039]:     </interface>
Oct 20 09:23:31 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:23:31 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/7adabc8f-9975-4db0-9b0b-728753fb42d5/console.log" append="off"/>
Oct 20 09:23:31 user nova-compute[74039]:     </serial>
Oct 20 09:23:31 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:23:31 user nova-compute[74039]:     <video>
Oct 20 09:23:31 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:23:31 user nova-compute[74039]:     </video>
Oct 20 09:23:31 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:23:31 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:23:31 user nova-compute[74039]:     </rng>
Oct 20 09:23:31 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:23:31 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:23:31 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:23:31 user nova-compute[74039]:     </memballoon>
Oct 20 09:23:31 user nova-compute[74039]:   </devices>
Oct 20 09:23:31 user nova-compute[74039]: </domain>
Oct 20 09:23:31 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:23:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1155087958',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1155087958',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1155087958',id=47,image_ref='003de5c4-e4fd-4804-9000-de81aedeaa82',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNmE2mrLnJ6cDQioKayaTcWOrB9EzbtdgsG5Sfmnyadrv5cs4DHSJSD5q95dc+8u3HqZ0HCadjo/Nm2bs1eRPocnl+afhtfsoyrP/2aiGe9bR4qyxQE1zZwPbmrJdIVaA==',key_name='tempest-keypair-482360881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='367334c57f8f47b696a477460afba369',ramdisk_id='',reservation_id='r-cgodpeth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1725287482',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725287482',owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:23:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d68ed2131b34e57a5f10a01409fee62',uuid=7adabc8f-9975-4db0-9b0b-728753fb42d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ca94546-dc77-45a3-9032-26b264c49756", "address": "fa:16:3e:8f:47:3c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca94546-dc", "ovs_interfaceid": "0ca94546-dc77-45a3-9032-26b264c49756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converting VIF {"id": "0ca94546-dc77-45a3-9032-26b264c49756", "address": "fa:16:3e:8f:47:3c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca94546-dc", "ovs_interfaceid": "0ca94546-dc77-45a3-9032-26b264c49756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:47:3c,bridge_name='br-int',has_traffic_filtering=True,id=0ca94546-dc77-45a3-9032-26b264c49756,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca94546-dc') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG os_vif [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:47:3c,bridge_name='br-int',has_traffic_filtering=True,id=0ca94546-dc77-45a3-9032-26b264c49756,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca94546-dc') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dbf3b089-758a-5d43-9030-fda67aebbc3b', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ca94546-dc, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ca94546-dc, col_values=(('qos', UUID('9e5b6e49-e996-4801-9d50-3c84c300c147')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ca94546-dc, col_values=(('external_ids', {'iface-id': '0ca94546-dc77-45a3-9032-26b264c49756', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:47:3c', 'vm-uuid': '7adabc8f-9975-4db0-9b0b-728753fb42d5'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:31 user nova-compute[74039]: INFO os_vif [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:47:3c,bridge_name='br-int',has_traffic_filtering=True,id=0ca94546-dc77-45a3-9032-26b264c49756,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca94546-dc')
Oct 20 09:23:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] No VIF found with MAC fa:16:3e:8f:47:3c, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "69541e4b-dded-4e7c-9cfa-d93f8824179f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:31 user nova-compute[74039]: INFO nova.compute.manager [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Terminating instance
Oct 20 09:23:31 user nova-compute[74039]: DEBUG nova.compute.manager [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-9c240307-98c7-474f-96dc-90f32eb5e157 req-dc971331-e64b-4b5b-8239-64a746d01a7e service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Received event network-vif-unplugged-d5bf552c-4108-4e8e-b919-e2fc9c22963e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9c240307-98c7-474f-96dc-90f32eb5e157 req-dc971331-e64b-4b5b-8239-64a746d01a7e service nova] Acquiring lock "69541e4b-dded-4e7c-9cfa-d93f8824179f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9c240307-98c7-474f-96dc-90f32eb5e157 req-dc971331-e64b-4b5b-8239-64a746d01a7e service nova] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9c240307-98c7-474f-96dc-90f32eb5e157 req-dc971331-e64b-4b5b-8239-64a746d01a7e service nova] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-9c240307-98c7-474f-96dc-90f32eb5e157 req-dc971331-e64b-4b5b-8239-64a746d01a7e service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] No waiting events found dispatching network-vif-unplugged-d5bf552c-4108-4e8e-b919-e2fc9c22963e {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:23:31 user nova-compute[74039]: DEBUG nova.compute.manager [req-9c240307-98c7-474f-96dc-90f32eb5e157 req-dc971331-e64b-4b5b-8239-64a746d01a7e service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Received event network-vif-unplugged-d5bf552c-4108-4e8e-b919-e2fc9c22963e for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:23:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:32 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Instance destroyed successfully.
Oct 20 09:23:32 user nova-compute[74039]: DEBUG nova.objects.instance [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lazy-loading 'resources' on Instance uuid 69541e4b-dded-4e7c-9cfa-d93f8824179f {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1840740764',display_name='tempest-SnapshotDataIntegrityTests-server-1840740764',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1840740764',id=41,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHwblTMABn6Dwi+fBbT7+8oEe8pKv+0+f6FrVgbdMaS0VoduxP/mybZyQDibWSOBKHUgpoGSQXATmsScB2zUvzsygfxb+A0mBZ8iCNszNsVVVFllokVzcTTsazQ6ypA+A==',key_name='tempest-keypair-1111917610',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:14:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='173c1e40b30c479292dd4f96e61bb72b',ramdisk_id='',reservation_id='r-3dbpkdcx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1427567799',owner_user_name='tempest-SnapshotDataIntegrityTests-1427567799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:14:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d7f85ab6fdc4c76be5d62d5b2a5962b',uuid=69541e4b-dded-4e7c-9cfa-d93f8824179f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "address": "fa:16:3e:53:1c:b8", "network": {"id": "4cdbb359-74da-4e4d-a725-6f0ce82cc435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1113356046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173c1e40b30c479292dd4f96e61bb72b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bf552c-41", "ovs_interfaceid": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Converting VIF {"id": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "address": "fa:16:3e:53:1c:b8", "network": {"id": "4cdbb359-74da-4e4d-a725-6f0ce82cc435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1113356046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "173c1e40b30c479292dd4f96e61bb72b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5bf552c-41", "ovs_interfaceid": "d5bf552c-4108-4e8e-b919-e2fc9c22963e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:1c:b8,bridge_name='br-int',has_traffic_filtering=True,id=d5bf552c-4108-4e8e-b919-e2fc9c22963e,network=Network(4cdbb359-74da-4e4d-a725-6f0ce82cc435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5bf552c-41') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG os_vif [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:1c:b8,bridge_name='br-int',has_traffic_filtering=True,id=d5bf552c-4108-4e8e-b919-e2fc9c22963e,network=Network(4cdbb359-74da-4e4d-a725-6f0ce82cc435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5bf552c-41') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5bf552c-41, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d9e7885-2d54-4066-bacf-5dcdd92839f4) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:33 user nova-compute[74039]: INFO os_vif [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:1c:b8,bridge_name='br-int',has_traffic_filtering=True,id=d5bf552c-4108-4e8e-b919-e2fc9c22963e,network=Network(4cdbb359-74da-4e4d-a725-6f0ce82cc435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5bf552c-41')
Oct 20 09:23:33 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Deleting instance files /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f_del
Oct 20 09:23:33 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Deletion of /opt/stack/data/nova/instances/69541e4b-dded-4e7c-9cfa-d93f8824179f_del complete
Oct 20 09:23:33 user nova-compute[74039]: INFO nova.compute.manager [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Took 1.60 seconds to destroy the instance on the hypervisor.
Oct 20 09:23:33 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG nova.compute.manager [req-d34b1424-e582-406b-9478-0141e4b24383 req-42807dcb-11b1-4016-b228-60260709461c service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Received event network-vif-plugged-d5bf552c-4108-4e8e-b919-e2fc9c22963e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d34b1424-e582-406b-9478-0141e4b24383 req-42807dcb-11b1-4016-b228-60260709461c service nova] Acquiring lock "69541e4b-dded-4e7c-9cfa-d93f8824179f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d34b1424-e582-406b-9478-0141e4b24383 req-42807dcb-11b1-4016-b228-60260709461c service nova] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d34b1424-e582-406b-9478-0141e4b24383 req-42807dcb-11b1-4016-b228-60260709461c service nova] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:33 user nova-compute[74039]: DEBUG nova.compute.manager [req-d34b1424-e582-406b-9478-0141e4b24383 req-42807dcb-11b1-4016-b228-60260709461c service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] No waiting events found dispatching network-vif-plugged-d5bf552c-4108-4e8e-b919-e2fc9c22963e {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:23:34 user nova-compute[74039]: WARNING nova.compute.manager [req-d34b1424-e582-406b-9478-0141e4b24383 req-42807dcb-11b1-4016-b228-60260709461c service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Received unexpected event network-vif-plugged-d5bf552c-4108-4e8e-b919-e2fc9c22963e for instance with vm_state active and task_state deleting.
Oct 20 09:23:34 user nova-compute[74039]: DEBUG nova.compute.manager [req-d34b1424-e582-406b-9478-0141e4b24383 req-42807dcb-11b1-4016-b228-60260709461c service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Received event network-vif-plugged-0ca94546-dc77-45a3-9032-26b264c49756 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:23:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d34b1424-e582-406b-9478-0141e4b24383 req-42807dcb-11b1-4016-b228-60260709461c service nova] Acquiring lock "7adabc8f-9975-4db0-9b0b-728753fb42d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d34b1424-e582-406b-9478-0141e4b24383 req-42807dcb-11b1-4016-b228-60260709461c service nova] Lock "7adabc8f-9975-4db0-9b0b-728753fb42d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d34b1424-e582-406b-9478-0141e4b24383 req-42807dcb-11b1-4016-b228-60260709461c service nova] Lock "7adabc8f-9975-4db0-9b0b-728753fb42d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:34 user nova-compute[74039]: DEBUG nova.compute.manager [req-d34b1424-e582-406b-9478-0141e4b24383 req-42807dcb-11b1-4016-b228-60260709461c service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] No waiting events found dispatching network-vif-plugged-0ca94546-dc77-45a3-9032-26b264c49756 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:23:34 user nova-compute[74039]: WARNING nova.compute.manager [req-d34b1424-e582-406b-9478-0141e4b24383 req-42807dcb-11b1-4016-b228-60260709461c service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Received unexpected event network-vif-plugged-0ca94546-dc77-45a3-9032-26b264c49756 for instance with vm_state building and task_state spawning.
Oct 20 09:23:34 user nova-compute[74039]: DEBUG nova.compute.manager [req-d34b1424-e582-406b-9478-0141e4b24383 req-42807dcb-11b1-4016-b228-60260709461c service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Received event network-vif-plugged-0ca94546-dc77-45a3-9032-26b264c49756 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:23:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d34b1424-e582-406b-9478-0141e4b24383 req-42807dcb-11b1-4016-b228-60260709461c service nova] Acquiring lock "7adabc8f-9975-4db0-9b0b-728753fb42d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d34b1424-e582-406b-9478-0141e4b24383 req-42807dcb-11b1-4016-b228-60260709461c service nova] Lock "7adabc8f-9975-4db0-9b0b-728753fb42d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d34b1424-e582-406b-9478-0141e4b24383 req-42807dcb-11b1-4016-b228-60260709461c service nova] Lock "7adabc8f-9975-4db0-9b0b-728753fb42d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:34 user nova-compute[74039]: DEBUG nova.compute.manager [req-d34b1424-e582-406b-9478-0141e4b24383 req-42807dcb-11b1-4016-b228-60260709461c service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] No waiting events found dispatching network-vif-plugged-0ca94546-dc77-45a3-9032-26b264c49756 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:23:34 user nova-compute[74039]: WARNING nova.compute.manager [req-d34b1424-e582-406b-9478-0141e4b24383 req-42807dcb-11b1-4016-b228-60260709461c service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Received unexpected event network-vif-plugged-0ca94546-dc77-45a3-9032-26b264c49756 for instance with vm_state building and task_state spawning.
Oct 20 09:23:34 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Took 0.86 seconds to deallocate network for instance.
Oct 20 09:23:34 user nova-compute[74039]: DEBUG nova.compute.manager [req-e19d7c23-6847-4ce6-98aa-5f97c3d9579c req-14917952-4b26-48a9-8b1a-a98cd2203dda service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Received event network-vif-deleted-d5bf552c-4108-4e8e-b919-e2fc9c22963e {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:23:34 user nova-compute[74039]: INFO nova.compute.manager [req-e19d7c23-6847-4ce6-98aa-5f97c3d9579c req-14917952-4b26-48a9-8b1a-a98cd2203dda service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Neutron deleted interface d5bf552c-4108-4e8e-b919-e2fc9c22963e; detaching it from the instance and deleting it from the info cache
Oct 20 09:23:34 user nova-compute[74039]: DEBUG nova.network.neutron [req-e19d7c23-6847-4ce6-98aa-5f97c3d9579c req-14917952-4b26-48a9-8b1a-a98cd2203dda service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:23:34 user nova-compute[74039]: DEBUG nova.compute.manager [req-e19d7c23-6847-4ce6-98aa-5f97c3d9579c req-14917952-4b26-48a9-8b1a-a98cd2203dda service nova] [instance: 69541e4b-dded-4e7c-9cfa-d93f8824179f] Detach interface failed, port_id=d5bf552c-4108-4e8e-b919-e2fc9c22963e, reason: Instance 69541e4b-dded-4e7c-9cfa-d93f8824179f could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 09:23:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:34 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:23:34 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:23:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:34 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Deleted allocations for instance 69541e4b-dded-4e7c-9cfa-d93f8824179f
Oct 20 09:23:34 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-03e23c30-bb34-4e45-8993-c4b42218e82a tempest-SnapshotDataIntegrityTests-1427567799 tempest-SnapshotDataIntegrityTests-1427567799-project-member] Lock "69541e4b-dded-4e7c-9cfa-d93f8824179f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.011s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:35 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:23:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:23:35 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Instance spawned successfully.
Oct 20 09:23:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:23:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:23:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:23:35 user nova-compute[74039]: INFO nova.compute.manager [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Took 6.85 seconds to spawn the instance on the hypervisor.
Oct 20 09:23:35 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:23:35 user nova-compute[74039]: INFO nova.compute.manager [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Took 31.52 seconds to build instance.
Oct 20 09:23:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ebb1231e-b4f8-4762-b13d-b2554e532e3e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "7adabc8f-9975-4db0-9b0b-728753fb42d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.610s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:35 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:23:37 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:23:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:39 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:23:39 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:23:40 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:23:40 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:23:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-6939df16-e062-40a1-a705-fe0c03ce647e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:23:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-6939df16-e062-40a1-a705-fe0c03ce647e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:23:40 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:23:41 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Updating instance_info_cache with network_info: [{"id": "69b9c433-1e21-4b68-a843-9866dc032a2d", "address": "fa:16:3e:66:bb:54", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9c433-1e", "ovs_interfaceid": "69b9c433-1e21-4b68-a843-9866dc032a2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:23:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-6939df16-e062-40a1-a705-fe0c03ce647e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:23:41 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:23:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:44 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:23:47 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:23:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:48 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:23:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:48 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:23:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:23:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:23:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:23:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:23:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:23:50 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:23:50 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:23:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8295MB free_disk=25.270099639892578GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:23:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:23:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:23:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:23:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:23:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 6939df16-e062-40a1-a705-fe0c03ce647e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:23:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7adabc8f-9975-4db0-9b0b-728753fb42d5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:23:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 1cdbf79e-90b7-4746-8286-8f69277c71c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:23:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:23:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:23:50 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:23:50 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:23:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:23:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.322s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:23:53 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:23:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Verify base images {{(pid=74039) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Image id f58b9629-4790-4951-9492-6447e1485638 yields fingerprint ad6ae0cca52d348626240f5513d65f8591b19258 {{(pid=74039) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 20 09:24:05 user nova-compute[74039]: INFO nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] image f58b9629-4790-4951-9492-6447e1485638 at (/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258): checking
Oct 20 09:24:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] image f58b9629-4790-4951-9492-6447e1485638 at (/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258): image is in use {{(pid=74039) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74039) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Image id 003de5c4-e4fd-4804-9000-de81aedeaa82 yields fingerprint ebeab7e231588aa0c06074dded7bd989b88063e5 {{(pid=74039) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b is a valid instance name {{(pid=74039) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b has a disk file {{(pid=74039) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b is backed by ad6ae0cca52d348626240f5513d65f8591b19258 {{(pid=74039) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] 6939df16-e062-40a1-a705-fe0c03ce647e is a valid instance name {{(pid=74039) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 is a valid instance name {{(pid=74039) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] 1cdbf79e-90b7-4746-8286-8f69277c71c5 is a valid instance name {{(pid=74039) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] 1cdbf79e-90b7-4746-8286-8f69277c71c5 has a disk file {{(pid=74039) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 20 09:24:05 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 1cdbf79e-90b7-4746-8286-8f69277c71c5 is backed by ad6ae0cca52d348626240f5513d65f8591b19258 {{(pid=74039) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 20 09:24:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] 7adabc8f-9975-4db0-9b0b-728753fb42d5 is a valid instance name {{(pid=74039) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 09:24:06 user nova-compute[74039]: WARNING nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Unknown base file: /opt/stack/data/nova/instances/_base/30e5f00631d5bb7c68797337b3f0d4a3d83582d8
Oct 20 09:24:06 user nova-compute[74039]: WARNING nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Unknown base file: /opt/stack/data/nova/instances/_base/6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c
Oct 20 09:24:06 user nova-compute[74039]: WARNING nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Unknown base file: /opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894
Oct 20 09:24:06 user nova-compute[74039]: WARNING nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Unknown base file: /opt/stack/data/nova/instances/_base/ce7ce80c2565c5592fc174ee604368fe1d34c604
Oct 20 09:24:06 user nova-compute[74039]: WARNING nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Unknown base file: /opt/stack/data/nova/instances/_base/e17ca3b8a40e70597257dbe645f83d904004d426
Oct 20 09:24:06 user nova-compute[74039]: WARNING nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Unknown base file: /opt/stack/data/nova/instances/_base/6af971ea22dad70845cd1059f4bdf374647efdd7
Oct 20 09:24:06 user nova-compute[74039]: INFO nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Active base files: /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258
Oct 20 09:24:06 user nova-compute[74039]: INFO nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Removable base files: /opt/stack/data/nova/instances/_base/30e5f00631d5bb7c68797337b3f0d4a3d83582d8 /opt/stack/data/nova/instances/_base/6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c /opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894 /opt/stack/data/nova/instances/_base/ce7ce80c2565c5592fc174ee604368fe1d34c604 /opt/stack/data/nova/instances/_base/e17ca3b8a40e70597257dbe645f83d904004d426 /opt/stack/data/nova/instances/_base/6af971ea22dad70845cd1059f4bdf374647efdd7
Oct 20 09:24:06 user nova-compute[74039]: INFO nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/30e5f00631d5bb7c68797337b3f0d4a3d83582d8
Oct 20 09:24:06 user nova-compute[74039]: INFO nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6aaa4478a6e5a1cd28003a3e35714c17a1e39e6c
Oct 20 09:24:06 user nova-compute[74039]: INFO nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8f5ee4b4d771d83ab07a2f63f0b84f467a3e8894
Oct 20 09:24:06 user nova-compute[74039]: INFO nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ce7ce80c2565c5592fc174ee604368fe1d34c604
Oct 20 09:24:06 user nova-compute[74039]: INFO nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e17ca3b8a40e70597257dbe645f83d904004d426
Oct 20 09:24:06 user nova-compute[74039]: INFO nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6af971ea22dad70845cd1059f4bdf374647efdd7
Oct 20 09:24:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Verification complete {{(pid=74039) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 20 09:24:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Verify swap images {{(pid=74039) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 20 09:24:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.imagecache [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Verify ephemeral images {{(pid=74039) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 20 09:24:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:24:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:24:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:24:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:24:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:24:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:24:18 user nova-compute[74039]: INFO nova.compute.manager [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Terminating instance
Oct 20 09:24:18 user nova-compute[74039]: DEBUG nova.compute.manager [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:24:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:18 user nova-compute[74039]: DEBUG nova.compute.manager [req-6c802efb-9866-4a04-8e95-cec634047dfb req-96e4b3e7-3c6b-4dd4-ab37-13b0e3b77bd7 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received event network-vif-unplugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:24:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6c802efb-9866-4a04-8e95-cec634047dfb req-96e4b3e7-3c6b-4dd4-ab37-13b0e3b77bd7 service nova] Acquiring lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:24:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6c802efb-9866-4a04-8e95-cec634047dfb req-96e4b3e7-3c6b-4dd4-ab37-13b0e3b77bd7 service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:24:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6c802efb-9866-4a04-8e95-cec634047dfb req-96e4b3e7-3c6b-4dd4-ab37-13b0e3b77bd7 service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:24:18 user nova-compute[74039]: DEBUG nova.compute.manager [req-6c802efb-9866-4a04-8e95-cec634047dfb req-96e4b3e7-3c6b-4dd4-ab37-13b0e3b77bd7 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] No waiting events found dispatching network-vif-unplugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:24:18 user nova-compute[74039]: DEBUG nova.compute.manager [req-6c802efb-9866-4a04-8e95-cec634047dfb req-96e4b3e7-3c6b-4dd4-ab37-13b0e3b77bd7 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received event network-vif-unplugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:24:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:19 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Instance destroyed successfully.
Oct 20 09:24:19 user nova-compute[74039]: DEBUG nova.objects.instance [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'resources' on Instance uuid 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:08:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1276384976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1276384976',id=36,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:10:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7ed96a82048434fb0d79a55838184e4',ramdisk_id='',reservation_id='r-vf8crc97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:12:20Z,user_data=None,user_id='1e07a52b4e3b4a65b34f71fb2cca8de3',uuid=7ef84a0f-b5bd-4df4-b3e1-da05581d2b17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "address": "fa:16:3e:63:49:5e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc0a1c-ee", "ovs_interfaceid": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converting VIF {"id": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "address": "fa:16:3e:63:49:5e", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fc0a1c-ee", "ovs_interfaceid": "f9fc0a1c-ee0c-4540-9221-b93d88aafe99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:49:5e,bridge_name='br-int',has_traffic_filtering=True,id=f9fc0a1c-ee0c-4540-9221-b93d88aafe99,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc0a1c-ee') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_vif [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:49:5e,bridge_name='br-int',has_traffic_filtering=True,id=f9fc0a1c-ee0c-4540-9221-b93d88aafe99,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc0a1c-ee') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9fc0a1c-ee, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71b72e65-d877-4abc-8a16-3ddb9031d742) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:24:19 user nova-compute[74039]: INFO os_vif [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:49:5e,bridge_name='br-int',has_traffic_filtering=True,id=f9fc0a1c-ee0c-4540-9221-b93d88aafe99,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fc0a1c-ee')
Oct 20 09:24:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abucNVZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:24:19 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f489a67c-4810-4413-b09e-757c0b7a167e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:24:19 user nova-compute[74039]: No targets found.
Oct 20 09:24:19 user nova-compute[74039]: iSNS:
Oct 20 09:24:19 user nova-compute[74039]: No targets found.
Oct 20 09:24:19 user nova-compute[74039]: STATIC:
Oct 20 09:24:19 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14
Oct 20 09:24:19 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:24:19 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:24:19 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d
Oct 20 09:24:19 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:24:19 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:24:19 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc
Oct 20 09:24:19 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:24:19 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:24:19 user nova-compute[74039]: FIRMWARE:
Oct 20 09:24:19 user nova-compute[74039]: No targets found.
Oct 20 09:24:19 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:24:19 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:24:19 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d94d3c-4645-4ba5-87dd-f4c6e2bcef50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[658782b9-a966-4d14-bc89-eb91ff55c61e]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:24:19 user nova-compute[74039]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)
Oct 20 09:24:19 user nova-compute[74039]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d (non-flash)
Oct 20 09:24:19 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 (non-flash)
Oct 20 09:24:19 user nova-compute[74039]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)
Oct 20 09:24:19 user nova-compute[74039]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d (non-flash)
Oct 20 09:24:19 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae84117880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14'): ({'sdc'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Removing single pathed devices sdc {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ea662a-9fda-452a-b16d-57cd3aa1806b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[de30c576-f6ee-4ad1-8f6f-f0f1d8e32048]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Flushing IO for device /dev/sdc {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa869c4b-6363-4a16-9f36-7b5d3bc4f30a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f2a1d4-5c35-4cf0-b06f-a47104bbb83f]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a1c7a9-5877-41c9-babd-84a79b17fc6a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced0b5b5-123e-4fc7-be93-b40e7e2132a5]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14, portal: 172.16.0.220,3260]
Oct 20 09:24:19 user nova-compute[74039]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14, portal: 172.16.0.220,3260] successful.
Oct 20 09:24:19 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bae475b-ece4-4c2a-b9a4-c2291830bd14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[516b2d01-b450-4ce2-8ff0-f76517caf19d]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] <== disconnect_volume: return (301ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:24:19 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Deleting instance files /opt/stack/data/nova/instances/7ef84a0f-b5bd-4df4-b3e1-da05581d2b17_del
Oct 20 09:24:19 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Deletion of /opt/stack/data/nova/instances/7ef84a0f-b5bd-4df4-b3e1-da05581d2b17_del complete
Oct 20 09:24:19 user nova-compute[74039]: INFO nova.compute.manager [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 20 09:24:19 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:24:19 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:24:20 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:24:20 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Took 0.51 seconds to deallocate network for instance.
Oct 20 09:24:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-58b680b0-0413-4efb-8a64-a574112e930e req-59835f39-5737-40c9-80c1-0077b7f999a3 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received event network-vif-deleted-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:24:20 user nova-compute[74039]: INFO nova.compute.manager [req-58b680b0-0413-4efb-8a64-a574112e930e req-59835f39-5737-40c9-80c1-0077b7f999a3 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Neutron deleted interface f9fc0a1c-ee0c-4540-9221-b93d88aafe99; detaching it from the instance and deleting it from the info cache
Oct 20 09:24:20 user nova-compute[74039]: DEBUG nova.network.neutron [req-58b680b0-0413-4efb-8a64-a574112e930e req-59835f39-5737-40c9-80c1-0077b7f999a3 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:24:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-58b680b0-0413-4efb-8a64-a574112e930e req-59835f39-5737-40c9-80c1-0077b7f999a3 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Detach interface failed, port_id=f9fc0a1c-ee0c-4540-9221-b93d88aafe99, reason: Instance 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17 could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 09:24:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-34cb07ed-736e-4ca9-8516-1b89ed486d6a req-9d01c120-8835-47da-b299-633639e4a0e8 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received event network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:24:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-34cb07ed-736e-4ca9-8516-1b89ed486d6a req-9d01c120-8835-47da-b299-633639e4a0e8 service nova] Acquiring lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:24:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-34cb07ed-736e-4ca9-8516-1b89ed486d6a req-9d01c120-8835-47da-b299-633639e4a0e8 service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:24:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-34cb07ed-736e-4ca9-8516-1b89ed486d6a req-9d01c120-8835-47da-b299-633639e4a0e8 service nova] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:24:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-34cb07ed-736e-4ca9-8516-1b89ed486d6a req-9d01c120-8835-47da-b299-633639e4a0e8 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] No waiting events found dispatching network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:24:20 user nova-compute[74039]: WARNING nova.compute.manager [req-34cb07ed-736e-4ca9-8516-1b89ed486d6a req-9d01c120-8835-47da-b299-633639e4a0e8 service nova] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Received unexpected event network-vif-plugged-f9fc0a1c-ee0c-4540-9221-b93d88aafe99 for instance with vm_state active and task_state deleting.
Oct 20 09:24:21 user nova-compute[74039]: INFO nova.compute.manager [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17] Took 0.89 seconds to detach 1 volumes for instance.
Oct 20 09:24:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:24:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:24:21 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:24:21 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:24:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:24:21 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Deleted allocations for instance 7ef84a0f-b5bd-4df4-b3e1-da05581d2b17
Oct 20 09:24:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-2b649174-5348-4265-9044-827d904f3466 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "7ef84a0f-b5bd-4df4-b3e1-da05581d2b17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:24:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:24:35 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:24:35 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:24:35 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:24:38 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:24:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:39 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:24:41 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:24:42 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:24:42 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:24:42 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Rebuilding the list of instances to heal {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 09:24:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:24:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:24:42 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:24:42 user nova-compute[74039]: DEBUG nova.objects.instance [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lazy-loading 'info_cache' on Instance uuid 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:24:43 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Updating instance_info_cache with network_info: [{"id": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "address": "fa:16:3e:d6:ab:b8", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e6bac4-ee", "ovs_interfaceid": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:24:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:24:43 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:24:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:24:44 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:24:46 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:24:48 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:24:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:24:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:24:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:24:48 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:24:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:24:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:24:48 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:49 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:24:49 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:24:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8563MB free_disk=25.268020629882812GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:24:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:24:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:24:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:24:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 6939df16-e062-40a1-a705-fe0c03ce647e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:24:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 7adabc8f-9975-4db0-9b0b-728753fb42d5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:24:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 1cdbf79e-90b7-4746-8286-8f69277c71c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:24:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:24:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:24:50 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:24:50 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:24:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:24:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:24:50 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:24:50 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Cleaning up deleted instances {{(pid=74039) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 09:24:50 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] There are 0 instances to clean {{(pid=74039) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 09:24:51 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:24:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:24:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:24:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:24:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:24:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-74e93fc1-db95-438c-9555-52b4177074da req-21645732-b701-4657-b0c7-78b748b15512 service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Received event network-changed-0ca94546-dc77-45a3-9032-26b264c49756 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:24:54 user nova-compute[74039]: DEBUG nova.compute.manager [req-74e93fc1-db95-438c-9555-52b4177074da req-21645732-b701-4657-b0c7-78b748b15512 service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Refreshing instance network info cache due to event network-changed-0ca94546-dc77-45a3-9032-26b264c49756. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:24:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-74e93fc1-db95-438c-9555-52b4177074da req-21645732-b701-4657-b0c7-78b748b15512 service nova] Acquiring lock "refresh_cache-7adabc8f-9975-4db0-9b0b-728753fb42d5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:24:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-74e93fc1-db95-438c-9555-52b4177074da req-21645732-b701-4657-b0c7-78b748b15512 service nova] Acquired lock "refresh_cache-7adabc8f-9975-4db0-9b0b-728753fb42d5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:24:54 user nova-compute[74039]: DEBUG nova.network.neutron [req-74e93fc1-db95-438c-9555-52b4177074da req-21645732-b701-4657-b0c7-78b748b15512 service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Refreshing network info cache for port 0ca94546-dc77-45a3-9032-26b264c49756 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:24:55 user nova-compute[74039]: DEBUG nova.network.neutron [req-74e93fc1-db95-438c-9555-52b4177074da req-21645732-b701-4657-b0c7-78b748b15512 service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Updated VIF entry in instance network info cache for port 0ca94546-dc77-45a3-9032-26b264c49756. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:24:55 user nova-compute[74039]: DEBUG nova.network.neutron [req-74e93fc1-db95-438c-9555-52b4177074da req-21645732-b701-4657-b0c7-78b748b15512 service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Updating instance_info_cache with network_info: [{"id": "0ca94546-dc77-45a3-9032-26b264c49756", "address": "fa:16:3e:8f:47:3c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca94546-dc", "ovs_interfaceid": "0ca94546-dc77-45a3-9032-26b264c49756", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:24:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-74e93fc1-db95-438c-9555-52b4177074da req-21645732-b701-4657-b0c7-78b748b15512 service nova] Releasing lock "refresh_cache-7adabc8f-9975-4db0-9b0b-728753fb42d5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:24:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "7adabc8f-9975-4db0-9b0b-728753fb42d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:24:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "7adabc8f-9975-4db0-9b0b-728753fb42d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:24:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "7adabc8f-9975-4db0-9b0b-728753fb42d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:24:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "7adabc8f-9975-4db0-9b0b-728753fb42d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:24:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "7adabc8f-9975-4db0-9b0b-728753fb42d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:24:55 user nova-compute[74039]: INFO nova.compute.manager [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Terminating instance
Oct 20 09:24:55 user nova-compute[74039]: DEBUG nova.compute.manager [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:24:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-c0313b3a-1106-4246-91ac-ce33c43ef6aa req-6cedefa2-5575-4475-ba23-c32ca53e18dd service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Received event network-vif-unplugged-0ca94546-dc77-45a3-9032-26b264c49756 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:24:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c0313b3a-1106-4246-91ac-ce33c43ef6aa req-6cedefa2-5575-4475-ba23-c32ca53e18dd service nova] Acquiring lock "7adabc8f-9975-4db0-9b0b-728753fb42d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:24:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c0313b3a-1106-4246-91ac-ce33c43ef6aa req-6cedefa2-5575-4475-ba23-c32ca53e18dd service nova] Lock "7adabc8f-9975-4db0-9b0b-728753fb42d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:24:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-c0313b3a-1106-4246-91ac-ce33c43ef6aa req-6cedefa2-5575-4475-ba23-c32ca53e18dd service nova] Lock "7adabc8f-9975-4db0-9b0b-728753fb42d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:24:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-c0313b3a-1106-4246-91ac-ce33c43ef6aa req-6cedefa2-5575-4475-ba23-c32ca53e18dd service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] No waiting events found dispatching network-vif-unplugged-0ca94546-dc77-45a3-9032-26b264c49756 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:24:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-c0313b3a-1106-4246-91ac-ce33c43ef6aa req-6cedefa2-5575-4475-ba23-c32ca53e18dd service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Received event network-vif-unplugged-0ca94546-dc77-45a3-9032-26b264c49756 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:24:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:56 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Instance destroyed successfully.
Oct 20 09:24:56 user nova-compute[74039]: DEBUG nova.objects.instance [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lazy-loading 'resources' on Instance uuid 7adabc8f-9975-4db0-9b0b-728753fb42d5 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:23:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1155087958',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1155087958',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1155087958',id=47,image_ref='003de5c4-e4fd-4804-9000-de81aedeaa82',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNmE2mrLnJ6cDQioKayaTcWOrB9EzbtdgsG5Sfmnyadrv5cs4DHSJSD5q95dc+8u3HqZ0HCadjo/Nm2bs1eRPocnl+afhtfsoyrP/2aiGe9bR4qyxQE1zZwPbmrJdIVaA==',key_name='tempest-keypair-482360881',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:23:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='367334c57f8f47b696a477460afba369',ramdisk_id='',reservation_id='r-cgodpeth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1725287482',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1725287482',owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:23:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d68ed2131b34e57a5f10a01409fee62',uuid=7adabc8f-9975-4db0-9b0b-728753fb42d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ca94546-dc77-45a3-9032-26b264c49756", "address": "fa:16:3e:8f:47:3c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca94546-dc", "ovs_interfaceid": "0ca94546-dc77-45a3-9032-26b264c49756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converting VIF {"id": "0ca94546-dc77-45a3-9032-26b264c49756", "address": "fa:16:3e:8f:47:3c", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca94546-dc", "ovs_interfaceid": "0ca94546-dc77-45a3-9032-26b264c49756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:47:3c,bridge_name='br-int',has_traffic_filtering=True,id=0ca94546-dc77-45a3-9032-26b264c49756,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca94546-dc') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_vif [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:47:3c,bridge_name='br-int',has_traffic_filtering=True,id=0ca94546-dc77-45a3-9032-26b264c49756,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca94546-dc') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ca94546-dc, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e5b6e49-e996-4801-9d50-3c84c300c147) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:24:56 user nova-compute[74039]: INFO os_vif [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:47:3c,bridge_name='br-int',has_traffic_filtering=True,id=0ca94546-dc77-45a3-9032-26b264c49756,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca94546-dc')
Oct 20 09:24:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UfSoKXud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:24:56 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dea5ac-b604-496a-be06-99d3d105f387]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:24:56 user nova-compute[74039]: No targets found.
Oct 20 09:24:56 user nova-compute[74039]: iSNS:
Oct 20 09:24:56 user nova-compute[74039]: No targets found.
Oct 20 09:24:56 user nova-compute[74039]: STATIC:
Oct 20 09:24:56 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d
Oct 20 09:24:56 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:24:56 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:24:56 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc
Oct 20 09:24:56 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:24:56 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:24:56 user nova-compute[74039]: FIRMWARE:
Oct 20 09:24:56 user nova-compute[74039]: No targets found.
Oct 20 09:24:56 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:24:56 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:24:56 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[490615cc-278a-44a9-b4bb-3ed5bb50c473]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dae79f-1977-4725-8b54-b0e64e85ba43]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)
Oct 20 09:24:56 user nova-compute[74039]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d (non-flash)
Oct 20 09:24:56 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)
Oct 20 09:24:56 user nova-compute[74039]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d (non-flash)
Oct 20 09:24:56 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae841e27a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d'): ({'sdb'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Removing single pathed devices sdb {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1d4abb-2738-42d0-89bc-cbf900376696]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c26a62-eacf-4234-abab-dbe1134e88c4]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Flushing IO for device /dev/sdb {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7673a03f-61b4-48f3-b94d-52b26a36a4fd]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d96d5c8-e11b-4367-a53a-6ce98c96a9f5]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2a536542-bae63eb443375b14', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2a536542', '/dev/disk/by-id/scsi-26261653633656234') {{(pid=85466) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f0c296-6240-4bca-86ec-0cd1c8a9d692]: (4, None) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[100f49e9-fcea-492a-80a6-5f3c8afe554d]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5956c6-1fd8-4088-b5ef-ef70f427fbe4]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d, portal: 172.16.0.220,3260]
Oct 20 09:24:56 user nova-compute[74039]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d, portal: 172.16.0.220,3260] successful.
Oct 20 09:24:56 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48a9867-ef37-4f71-8b1e-458640701e4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce99c81-dc1b-4fda-9554-42305a2f503f]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] <== disconnect_volume: return (310ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:24:56 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Deleting instance files /opt/stack/data/nova/instances/7adabc8f-9975-4db0-9b0b-728753fb42d5_del
Oct 20 09:24:56 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Deletion of /opt/stack/data/nova/instances/7adabc8f-9975-4db0-9b0b-728753fb42d5_del complete
Oct 20 09:24:56 user nova-compute[74039]: INFO nova.compute.manager [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Took 1.17 seconds to destroy the instance on the hypervisor.
Oct 20 09:24:56 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:24:56 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:24:57 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:24:57 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Took 0.75 seconds to deallocate network for instance.
Oct 20 09:24:57 user nova-compute[74039]: DEBUG nova.compute.manager [req-f577e8d0-9ba2-4c13-9c0b-62add82a32d0 req-1d8a8ac7-7902-46a5-859f-eff536af9c5a service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Received event network-vif-deleted-0ca94546-dc77-45a3-9032-26b264c49756 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:24:57 user nova-compute[74039]: DEBUG nova.compute.manager [req-86a94dbb-ce17-4b7a-9a86-d7b69758e1a8 req-76fd1ad8-3b2b-4295-81d9-c3ca32e50805 service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Received event network-vif-plugged-0ca94546-dc77-45a3-9032-26b264c49756 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:24:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-86a94dbb-ce17-4b7a-9a86-d7b69758e1a8 req-76fd1ad8-3b2b-4295-81d9-c3ca32e50805 service nova] Acquiring lock "7adabc8f-9975-4db0-9b0b-728753fb42d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:24:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-86a94dbb-ce17-4b7a-9a86-d7b69758e1a8 req-76fd1ad8-3b2b-4295-81d9-c3ca32e50805 service nova] Lock "7adabc8f-9975-4db0-9b0b-728753fb42d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:24:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-86a94dbb-ce17-4b7a-9a86-d7b69758e1a8 req-76fd1ad8-3b2b-4295-81d9-c3ca32e50805 service nova] Lock "7adabc8f-9975-4db0-9b0b-728753fb42d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:24:57 user nova-compute[74039]: DEBUG nova.compute.manager [req-86a94dbb-ce17-4b7a-9a86-d7b69758e1a8 req-76fd1ad8-3b2b-4295-81d9-c3ca32e50805 service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] No waiting events found dispatching network-vif-plugged-0ca94546-dc77-45a3-9032-26b264c49756 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:24:57 user nova-compute[74039]: WARNING nova.compute.manager [req-86a94dbb-ce17-4b7a-9a86-d7b69758e1a8 req-76fd1ad8-3b2b-4295-81d9-c3ca32e50805 service nova] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Received unexpected event network-vif-plugged-0ca94546-dc77-45a3-9032-26b264c49756 for instance with vm_state active and task_state deleting.
Oct 20 09:24:58 user nova-compute[74039]: INFO nova.compute.manager [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Took 0.91 seconds to detach 1 volumes for instance.
Oct 20 09:24:58 user nova-compute[74039]: DEBUG nova.compute.manager [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 7adabc8f-9975-4db0-9b0b-728753fb42d5] Deleting volume: b48a9867-ef37-4f71-8b1e-458640701e4d {{(pid=74039) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 09:24:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:24:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:24:58 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:24:58 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:24:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:24:58 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Deleted allocations for instance 7adabc8f-9975-4db0-9b0b-728753fb42d5
Oct 20 09:24:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3c53d4e2-66a1-4fa0-a58c-e666872f8f69 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "7adabc8f-9975-4db0-9b0b-728753fb42d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.285s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:24:58 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:24:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:25:09 user nova-compute[74039]: INFO nova.compute.manager [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Terminating instance
Oct 20 09:25:09 user nova-compute[74039]: DEBUG nova.compute.manager [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-d3cdac2e-9922-4a0c-9615-726c068ea586 req-6ef8ad82-3633-4549-91cf-ce06cf5cca14 service nova] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Received event network-vif-unplugged-47e6bac4-ee17-4c84-821f-d92e0ee9aa93 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d3cdac2e-9922-4a0c-9615-726c068ea586 req-6ef8ad82-3633-4549-91cf-ce06cf5cca14 service nova] Acquiring lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d3cdac2e-9922-4a0c-9615-726c068ea586 req-6ef8ad82-3633-4549-91cf-ce06cf5cca14 service nova] Lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d3cdac2e-9922-4a0c-9615-726c068ea586 req-6ef8ad82-3633-4549-91cf-ce06cf5cca14 service nova] Lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-d3cdac2e-9922-4a0c-9615-726c068ea586 req-6ef8ad82-3633-4549-91cf-ce06cf5cca14 service nova] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] No waiting events found dispatching network-vif-unplugged-47e6bac4-ee17-4c84-821f-d92e0ee9aa93 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-d3cdac2e-9922-4a0c-9615-726c068ea586 req-6ef8ad82-3633-4549-91cf-ce06cf5cca14 service nova] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Received event network-vif-unplugged-47e6bac4-ee17-4c84-821f-d92e0ee9aa93 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:25:09 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Instance destroyed successfully.
Oct 20 09:25:09 user nova-compute[74039]: DEBUG nova.objects.instance [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lazy-loading 'resources' on Instance uuid 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-58075102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-58075102',id=31,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:05:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7ed96a82048434fb0d79a55838184e4',ramdisk_id='',reservation_id='r-b3fgw0jf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:07:29Z,user_data=None,user_id='1e07a52b4e3b4a65b34f71fb2cca8de3',uuid=4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "address": "fa:16:3e:d6:ab:b8", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e6bac4-ee", "ovs_interfaceid": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converting VIF {"id": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "address": "fa:16:3e:d6:ab:b8", "network": {"id": "b39389ea-d5b8-4c73-8c58-17c17ff82de4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1348090407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7ed96a82048434fb0d79a55838184e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e6bac4-ee", "ovs_interfaceid": "47e6bac4-ee17-4c84-821f-d92e0ee9aa93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:ab:b8,bridge_name='br-int',has_traffic_filtering=True,id=47e6bac4-ee17-4c84-821f-d92e0ee9aa93,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e6bac4-ee') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG os_vif [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:ab:b8,bridge_name='br-int',has_traffic_filtering=True,id=47e6bac4-ee17-4c84-821f-d92e0ee9aa93,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e6bac4-ee') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47e6bac4-ee, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90c98049-6f67-4d6f-9424-7be98f1851b7) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:25:09 user nova-compute[74039]: INFO os_vif [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:ab:b8,bridge_name='br-int',has_traffic_filtering=True,id=47e6bac4-ee17-4c84-821f-d92e0ee9aa93,network=Network(b39389ea-d5b8-4c73-8c58-17c17ff82de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e6bac4-ee')
Oct 20 09:25:09 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Deleting instance files /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b_del
Oct 20 09:25:09 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Deletion of /opt/stack/data/nova/instances/4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b_del complete
Oct 20 09:25:09 user nova-compute[74039]: INFO nova.compute.manager [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Took 0.65 seconds to destroy the instance on the hypervisor.
Oct 20 09:25:09 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:25:09 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:25:10 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:25:10 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Took 0.51 seconds to deallocate network for instance.
Oct 20 09:25:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:25:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:25:10 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:25:10 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:25:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:25:10 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Deleted allocations for instance 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b
Oct 20 09:25:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-67b50c3d-497e-450e-adf3-98e7fa96d995 tempest-ServerBootFromVolumeStableRescueTest-1728924155 tempest-ServerBootFromVolumeStableRescueTest-1728924155-project-member] Lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.513s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:25:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-bbf0faa2-e791-4f0f-89e8-6c014cb72627 req-86bf0f0a-ac64-4f96-ab1b-126a51d67950 service nova] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Received event network-vif-plugged-47e6bac4-ee17-4c84-821f-d92e0ee9aa93 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:25:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bbf0faa2-e791-4f0f-89e8-6c014cb72627 req-86bf0f0a-ac64-4f96-ab1b-126a51d67950 service nova] Acquiring lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:25:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bbf0faa2-e791-4f0f-89e8-6c014cb72627 req-86bf0f0a-ac64-4f96-ab1b-126a51d67950 service nova] Lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:25:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-bbf0faa2-e791-4f0f-89e8-6c014cb72627 req-86bf0f0a-ac64-4f96-ab1b-126a51d67950 service nova] Lock "4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:25:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-bbf0faa2-e791-4f0f-89e8-6c014cb72627 req-86bf0f0a-ac64-4f96-ab1b-126a51d67950 service nova] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] No waiting events found dispatching network-vif-plugged-47e6bac4-ee17-4c84-821f-d92e0ee9aa93 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:25:11 user nova-compute[74039]: WARNING nova.compute.manager [req-bbf0faa2-e791-4f0f-89e8-6c014cb72627 req-86bf0f0a-ac64-4f96-ab1b-126a51d67950 service nova] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Received unexpected event network-vif-plugged-47e6bac4-ee17-4c84-821f-d92e0ee9aa93 for instance with vm_state deleted and task_state None.
Oct 20 09:25:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-bbf0faa2-e791-4f0f-89e8-6c014cb72627 req-86bf0f0a-ac64-4f96-ab1b-126a51d67950 service nova] [instance: 4a4c2a7e-85ec-49d4-b5da-50167bb8ce7b] Received event network-vif-deleted-47e6bac4-ee17-4c84-821f-d92e0ee9aa93 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:25:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-6a125cf9-d8eb-4c4e-a68b-64ca250e7b4d req-87caa5cc-cb43-498b-bb2d-943aac3f46e9 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received event network-changed-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:25:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-6a125cf9-d8eb-4c4e-a68b-64ca250e7b4d req-87caa5cc-cb43-498b-bb2d-943aac3f46e9 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Refreshing instance network info cache due to event network-changed-401cb923-c809-4d13-8811-ac2e26bab571. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:25:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6a125cf9-d8eb-4c4e-a68b-64ca250e7b4d req-87caa5cc-cb43-498b-bb2d-943aac3f46e9 service nova] Acquiring lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:25:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6a125cf9-d8eb-4c4e-a68b-64ca250e7b4d req-87caa5cc-cb43-498b-bb2d-943aac3f46e9 service nova] Acquired lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:25:11 user nova-compute[74039]: DEBUG nova.network.neutron [req-6a125cf9-d8eb-4c4e-a68b-64ca250e7b4d req-87caa5cc-cb43-498b-bb2d-943aac3f46e9 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Refreshing network info cache for port 401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:25:12 user nova-compute[74039]: DEBUG nova.network.neutron [req-6a125cf9-d8eb-4c4e-a68b-64ca250e7b4d req-87caa5cc-cb43-498b-bb2d-943aac3f46e9 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Updated VIF entry in instance network info cache for port 401cb923-c809-4d13-8811-ac2e26bab571. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:25:12 user nova-compute[74039]: DEBUG nova.network.neutron [req-6a125cf9-d8eb-4c4e-a68b-64ca250e7b4d req-87caa5cc-cb43-498b-bb2d-943aac3f46e9 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Updating instance_info_cache with network_info: [{"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:25:12 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6a125cf9-d8eb-4c4e-a68b-64ca250e7b4d req-87caa5cc-cb43-498b-bb2d-943aac3f46e9 service nova] Releasing lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:25:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "1cdbf79e-90b7-4746-8286-8f69277c71c5" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:25:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:25:17 user nova-compute[74039]: INFO nova.compute.manager [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Shelving
Oct 20 09:25:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:17 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:25:17 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74039) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 09:25:18 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Instance destroyed successfully.
Oct 20 09:25:18 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Beginning cold snapshot process
Oct 20 09:25:18 user nova-compute[74039]: DEBUG nova.compute.manager [req-fe37208b-a7e1-4c33-bdfb-9b27827b0508 req-0ddd54a7-52c6-4b21-9fd3-362b39a63071 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received event network-vif-unplugged-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:25:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-fe37208b-a7e1-4c33-bdfb-9b27827b0508 req-0ddd54a7-52c6-4b21-9fd3-362b39a63071 service nova] Acquiring lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:25:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-fe37208b-a7e1-4c33-bdfb-9b27827b0508 req-0ddd54a7-52c6-4b21-9fd3-362b39a63071 service nova] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:25:18 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-fe37208b-a7e1-4c33-bdfb-9b27827b0508 req-0ddd54a7-52c6-4b21-9fd3-362b39a63071 service nova] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:25:18 user nova-compute[74039]: DEBUG nova.compute.manager [req-fe37208b-a7e1-4c33-bdfb-9b27827b0508 req-0ddd54a7-52c6-4b21-9fd3-362b39a63071 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] No waiting events found dispatching network-vif-unplugged-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:25:18 user nova-compute[74039]: WARNING nova.compute.manager [req-fe37208b-a7e1-4c33-bdfb-9b27827b0508 req-0ddd54a7-52c6-4b21-9fd3-362b39a63071 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received unexpected event network-vif-unplugged-401cb923-c809-4d13-8811-ac2e26bab571 for instance with vm_state active and task_state shelving.
Oct 20 09:25:18 user nova-compute[74039]: DEBUG nova.privsep.utils [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74039) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 09:25:18 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk /opt/stack/data/nova/instances/snapshots/tmpejd7dbvs/241e49e73f014c8495f547fa0910a6c4 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:25:19 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk /opt/stack/data/nova/instances/snapshots/tmpejd7dbvs/241e49e73f014c8495f547fa0910a6c4" returned: 0 in 0.883s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:25:19 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Snapshot extracted, beginning image upload
Oct 20 09:25:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-cf541152-0b9f-430c-ac54-6831849ed48a req-b3d7eef6-aef2-42a4-a4a7-6ffe1a8b37be service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received event network-vif-plugged-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:25:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-cf541152-0b9f-430c-ac54-6831849ed48a req-b3d7eef6-aef2-42a4-a4a7-6ffe1a8b37be service nova] Acquiring lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:25:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-cf541152-0b9f-430c-ac54-6831849ed48a req-b3d7eef6-aef2-42a4-a4a7-6ffe1a8b37be service nova] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:25:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-cf541152-0b9f-430c-ac54-6831849ed48a req-b3d7eef6-aef2-42a4-a4a7-6ffe1a8b37be service nova] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:25:20 user nova-compute[74039]: DEBUG nova.compute.manager [req-cf541152-0b9f-430c-ac54-6831849ed48a req-b3d7eef6-aef2-42a4-a4a7-6ffe1a8b37be service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] No waiting events found dispatching network-vif-plugged-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:25:20 user nova-compute[74039]: WARNING nova.compute.manager [req-cf541152-0b9f-430c-ac54-6831849ed48a req-b3d7eef6-aef2-42a4-a4a7-6ffe1a8b37be service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received unexpected event network-vif-plugged-401cb923-c809-4d13-8811-ac2e26bab571 for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 09:25:21 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Snapshot image upload complete
Oct 20 09:25:21 user nova-compute[74039]: DEBUG nova.compute.manager [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:25:21 user nova-compute[74039]: INFO nova.compute.manager [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Shelve offloading
Oct 20 09:25:21 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Instance destroyed successfully.
Oct 20 09:25:21 user nova-compute[74039]: DEBUG nova.compute.manager [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:25:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:25:21 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquired lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:25:21 user nova-compute[74039]: DEBUG nova.network.neutron [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:25:21 user nova-compute[74039]: DEBUG nova.network.neutron [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Updating instance_info_cache with network_info: [{"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Releasing lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:22 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Instance destroyed successfully.
Oct 20 09:25:22 user nova-compute[74039]: DEBUG nova.objects.instance [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'resources' on Instance uuid 1cdbf79e-90b7-4746-8286-8f69277c71c5 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:23:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-890462872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-890462872',id=48,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTYRbiu5Cmg+KEfhGZotfGpvgUcK4Dd565SZY8zSSnNi464CjCWyuaB6Fdk7pfl8N2qugu2uYO1MXw3EVvETszsJ2uFQVRR375OQj8nISw4lFiUuufNVNOw3M4sMthB5w==',key_name='tempest-keypair-931468445',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:23:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='235f30d0612f4bfba028314ba7155dcf',ramdisk_id='',reservation_id='r-4jx12o7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1190516011',owner_user_name='tempest-AttachVolumeShelveTestJSON-1190516011-project-member',shelved_at='2023-10-20T09:25:21.473911',shelved_host='user',shelved_image_id='0cf7e9a5-3ba9-4918-a2f8-210624fa8b88'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd7771575aef439ebf1d55d3c4dcc377',uuid=1cdbf79e-90b7-4746-8286-8f69277c71c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converting VIF {"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=401cb923-c809-4d13-8811-ac2e26bab571,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401cb923-c8') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG os_vif [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=401cb923-c809-4d13-8811-ac2e26bab571,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401cb923-c8') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap401cb923-c8, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d260a539-cfad-44e2-989b-64fd0da1b437) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG nova.compute.manager [req-6c4a2143-1ab2-4131-bbb7-a30fae5adea0 req-4c6647a3-afee-4552-9361-1889bd2b3533 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received event network-changed-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG nova.compute.manager [req-6c4a2143-1ab2-4131-bbb7-a30fae5adea0 req-4c6647a3-afee-4552-9361-1889bd2b3533 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Refreshing instance network info cache due to event network-changed-401cb923-c809-4d13-8811-ac2e26bab571. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6c4a2143-1ab2-4131-bbb7-a30fae5adea0 req-4c6647a3-afee-4552-9361-1889bd2b3533 service nova] Acquiring lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6c4a2143-1ab2-4131-bbb7-a30fae5adea0 req-4c6647a3-afee-4552-9361-1889bd2b3533 service nova] Acquired lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG nova.network.neutron [req-6c4a2143-1ab2-4131-bbb7-a30fae5adea0 req-4c6647a3-afee-4552-9361-1889bd2b3533 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Refreshing network info cache for port 401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:25:22 user nova-compute[74039]: INFO os_vif [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=401cb923-c809-4d13-8811-ac2e26bab571,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401cb923-c8')
Oct 20 09:25:22 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Deleting instance files /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5_del
Oct 20 09:25:22 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Deletion of /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5_del complete
Oct 20 09:25:22 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Deleted allocations for instance 1cdbf79e-90b7-4746-8286-8f69277c71c5
Oct 20 09:25:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG nova.objects.instance [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'numa_topology' on Instance uuid 1cdbf79e-90b7-4746-8286-8f69277c71c5 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG nova.objects.base [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Object Instance<1cdbf79e-90b7-4746-8286-8f69277c71c5> lazy-loaded attributes: resources,numa_topology {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG nova.network.neutron [req-6c4a2143-1ab2-4131-bbb7-a30fae5adea0 req-4c6647a3-afee-4552-9361-1889bd2b3533 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Updated VIF entry in instance network info cache for port 401cb923-c809-4d13-8811-ac2e26bab571. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG nova.network.neutron [req-6c4a2143-1ab2-4131-bbb7-a30fae5adea0 req-4c6647a3-afee-4552-9361-1889bd2b3533 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Updating instance_info_cache with network_info: [{"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap401cb923-c8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:25:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-6c4a2143-1ab2-4131-bbb7-a30fae5adea0 req-4c6647a3-afee-4552-9361-1889bd2b3533 service nova] Releasing lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:25:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-79c1506a-3eee-4303-99f1-39e3efc14dfc tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.572s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:25:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:33 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:25:33 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid 6939df16-e062-40a1-a705-fe0c03ce647e {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 09:25:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "6939df16-e062-40a1-a705-fe0c03ce647e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:25:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "6939df16-e062-40a1-a705-fe0c03ce647e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:25:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "6939df16-e062-40a1-a705-fe0c03ce647e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:25:35 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:25:35 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:25:36 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:25:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:40 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:25:40 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:25:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:43 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:25:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:44 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:25:44 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:25:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-6939df16-e062-40a1-a705-fe0c03ce647e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:25:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-6939df16-e062-40a1-a705-fe0c03ce647e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:25:44 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:25:45 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Updating instance_info_cache with network_info: [{"id": "69b9c433-1e21-4b68-a843-9866dc032a2d", "address": "fa:16:3e:66:bb:54", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9c433-1e", "ovs_interfaceid": "69b9c433-1e21-4b68-a843-9866dc032a2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:25:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-6939df16-e062-40a1-a705-fe0c03ce647e" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:25:45 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:25:46 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:25:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:48 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:25:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:25:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:25:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:25:48 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:25:48 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:25:49 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:25:49 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:25:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8862MB free_disk=25.37106704711914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:25:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:25:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:25:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 6939df16-e062-40a1-a705-fe0c03ce647e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:25:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:25:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:25:49 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:25:49 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:25:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:25:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:25:51 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:25:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "6939df16-e062-40a1-a705-fe0c03ce647e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:25:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "6939df16-e062-40a1-a705-fe0c03ce647e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:25:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "6939df16-e062-40a1-a705-fe0c03ce647e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:25:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "6939df16-e062-40a1-a705-fe0c03ce647e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:25:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "6939df16-e062-40a1-a705-fe0c03ce647e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:25:55 user nova-compute[74039]: INFO nova.compute.manager [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Terminating instance
Oct 20 09:25:55 user nova-compute[74039]: DEBUG nova.compute.manager [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:25:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-8adf72bd-2b1c-4bfa-bd0c-a8e75f451f5d req-aac6707a-07b8-43f9-93fe-b4224e3dc765 service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Received event network-vif-unplugged-69b9c433-1e21-4b68-a843-9866dc032a2d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:25:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8adf72bd-2b1c-4bfa-bd0c-a8e75f451f5d req-aac6707a-07b8-43f9-93fe-b4224e3dc765 service nova] Acquiring lock "6939df16-e062-40a1-a705-fe0c03ce647e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:25:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8adf72bd-2b1c-4bfa-bd0c-a8e75f451f5d req-aac6707a-07b8-43f9-93fe-b4224e3dc765 service nova] Lock "6939df16-e062-40a1-a705-fe0c03ce647e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:25:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8adf72bd-2b1c-4bfa-bd0c-a8e75f451f5d req-aac6707a-07b8-43f9-93fe-b4224e3dc765 service nova] Lock "6939df16-e062-40a1-a705-fe0c03ce647e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:25:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-8adf72bd-2b1c-4bfa-bd0c-a8e75f451f5d req-aac6707a-07b8-43f9-93fe-b4224e3dc765 service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] No waiting events found dispatching network-vif-unplugged-69b9c433-1e21-4b68-a843-9866dc032a2d {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:25:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-8adf72bd-2b1c-4bfa-bd0c-a8e75f451f5d req-aac6707a-07b8-43f9-93fe-b4224e3dc765 service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Received event network-vif-unplugged-69b9c433-1e21-4b68-a843-9866dc032a2d for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:56 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Instance destroyed successfully.
Oct 20 09:25:56 user nova-compute[74039]: DEBUG nova.objects.instance [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lazy-loading 'resources' on Instance uuid 6939df16-e062-40a1-a705-fe0c03ce647e {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1867896093',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1867896093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1867896093',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaWeLwEKEjPognnxfyns2mZ3K0IJ30TaUPub1gV/mB5PMJbOpI15EzRHDyhXVAA8gO8FFYXTdFr1X7vrEDLNwW5lHS7ube59zQLe469td5MVOLT4ZFy8n24UxQjSUS8yg==',key_name='tempest-keypair-1077972919',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:21:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='367334c57f8f47b696a477460afba369',ramdisk_id='',reservation_id='r-1k026v6t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1725287482',owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:21:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d68ed2131b34e57a5f10a01409fee62',uuid=6939df16-e062-40a1-a705-fe0c03ce647e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69b9c433-1e21-4b68-a843-9866dc032a2d", "address": "fa:16:3e:66:bb:54", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9c433-1e", "ovs_interfaceid": "69b9c433-1e21-4b68-a843-9866dc032a2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converting VIF {"id": "69b9c433-1e21-4b68-a843-9866dc032a2d", "address": "fa:16:3e:66:bb:54", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69b9c433-1e", "ovs_interfaceid": "69b9c433-1e21-4b68-a843-9866dc032a2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:bb:54,bridge_name='br-int',has_traffic_filtering=True,id=69b9c433-1e21-4b68-a843-9866dc032a2d,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b9c433-1e') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_vif [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:bb:54,bridge_name='br-int',has_traffic_filtering=True,id=69b9c433-1e21-4b68-a843-9866dc032a2d,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b9c433-1e') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69b9c433-1e, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12f77289-6929-4b73-b5c9-d234be558868) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:25:56 user nova-compute[74039]: INFO os_vif [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:bb:54,bridge_name='br-int',has_traffic_filtering=True,id=69b9c433-1e21-4b68-a843-9866dc032a2d,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69b9c433-1e')
Oct 20 09:25:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VxhpOsMT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:25:56 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[864eb5a6-29b5-4841-8ea4-7a334d0caeea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:25:56 user nova-compute[74039]: No targets found.
Oct 20 09:25:56 user nova-compute[74039]: iSNS:
Oct 20 09:25:56 user nova-compute[74039]: No targets found.
Oct 20 09:25:56 user nova-compute[74039]: STATIC:
Oct 20 09:25:56 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc
Oct 20 09:25:56 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:25:56 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:25:56 user nova-compute[74039]: FIRMWARE:
Oct 20 09:25:56 user nova-compute[74039]: No targets found.
Oct 20 09:25:56 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:25:56 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:25:56 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[81676b0e-3bc4-416e-840c-7de1f06c4874]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fc505a-91df-41da-962a-8bdbac2ebf1c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)
Oct 20 09:25:56 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc (non-flash)
Oct 20 09:25:56 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae845fc3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc'): ({'sdd'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Removing single pathed devices sdd {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f163f256-8002-4e7b-b64d-fa2636182e66]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[be60e327-d9bd-474f-800c-650a977264ef]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Flushing IO for device /dev/sdd {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfaec98-fe32-4399-9faf-98766f754ea3]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6026ccd-c111-4755-8bec-0318f5e95da9]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] SCSI volumes sdd have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1d6883d1-7b48cf1963aab378', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1d6883d1', '/dev/disk/by-id/scsi-23762343863663139') {{(pid=85466) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a9e97d-aea4-4529-9d46-b6ae206dd94a]: (4, None) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edb7682-63f0-4b39-9888-fb56fb36005a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[368c4cb1-ea30-417a-9d57-d4274541214e]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc, portal: 172.16.0.220,3260]
Oct 20 09:25:56 user nova-compute[74039]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc, portal: 172.16.0.220,3260] successful.
Oct 20 09:25:56 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b9dc75e-95c3-45ed-a77c-db42f186ffdc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[123e5395-6f5e-4d2c-a174-21ed618af197]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] <== disconnect_volume: return (287ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:25:56 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Deleting instance files /opt/stack/data/nova/instances/6939df16-e062-40a1-a705-fe0c03ce647e_del
Oct 20 09:25:56 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Deletion of /opt/stack/data/nova/instances/6939df16-e062-40a1-a705-fe0c03ce647e_del complete
Oct 20 09:25:56 user nova-compute[74039]: INFO nova.compute.manager [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Took 1.11 seconds to destroy the instance on the hypervisor.
Oct 20 09:25:56 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:25:56 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:25:57 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:25:57 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Took 0.69 seconds to deallocate network for instance.
Oct 20 09:25:57 user nova-compute[74039]: DEBUG nova.compute.manager [req-06d0482d-8230-4af5-8a17-e62e5357d9e3 req-bed22368-d3c5-48c7-95ea-ee8d3ee6beb8 service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Received event network-vif-deleted-69b9c433-1e21-4b68-a843-9866dc032a2d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:25:57 user nova-compute[74039]: INFO nova.compute.manager [req-06d0482d-8230-4af5-8a17-e62e5357d9e3 req-bed22368-d3c5-48c7-95ea-ee8d3ee6beb8 service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Neutron deleted interface 69b9c433-1e21-4b68-a843-9866dc032a2d; detaching it from the instance and deleting it from the info cache
Oct 20 09:25:57 user nova-compute[74039]: DEBUG nova.network.neutron [req-06d0482d-8230-4af5-8a17-e62e5357d9e3 req-bed22368-d3c5-48c7-95ea-ee8d3ee6beb8 service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:25:57 user nova-compute[74039]: DEBUG nova.compute.manager [req-06d0482d-8230-4af5-8a17-e62e5357d9e3 req-bed22368-d3c5-48c7-95ea-ee8d3ee6beb8 service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Detach interface failed, port_id=69b9c433-1e21-4b68-a843-9866dc032a2d, reason: Instance 6939df16-e062-40a1-a705-fe0c03ce647e could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 09:25:57 user nova-compute[74039]: DEBUG nova.compute.manager [req-91acff44-abdf-4622-b237-3df7846951f0 req-6fe35d3c-ea18-44b0-8b1e-76548e749549 service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Received event network-vif-plugged-69b9c433-1e21-4b68-a843-9866dc032a2d {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:25:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-91acff44-abdf-4622-b237-3df7846951f0 req-6fe35d3c-ea18-44b0-8b1e-76548e749549 service nova] Acquiring lock "6939df16-e062-40a1-a705-fe0c03ce647e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:25:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-91acff44-abdf-4622-b237-3df7846951f0 req-6fe35d3c-ea18-44b0-8b1e-76548e749549 service nova] Lock "6939df16-e062-40a1-a705-fe0c03ce647e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:25:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-91acff44-abdf-4622-b237-3df7846951f0 req-6fe35d3c-ea18-44b0-8b1e-76548e749549 service nova] Lock "6939df16-e062-40a1-a705-fe0c03ce647e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:25:57 user nova-compute[74039]: DEBUG nova.compute.manager [req-91acff44-abdf-4622-b237-3df7846951f0 req-6fe35d3c-ea18-44b0-8b1e-76548e749549 service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] No waiting events found dispatching network-vif-plugged-69b9c433-1e21-4b68-a843-9866dc032a2d {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:25:57 user nova-compute[74039]: WARNING nova.compute.manager [req-91acff44-abdf-4622-b237-3df7846951f0 req-6fe35d3c-ea18-44b0-8b1e-76548e749549 service nova] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Received unexpected event network-vif-plugged-69b9c433-1e21-4b68-a843-9866dc032a2d for instance with vm_state active and task_state deleting.
Oct 20 09:25:57 user nova-compute[74039]: INFO nova.compute.manager [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Took 0.77 seconds to detach 1 volumes for instance.
Oct 20 09:25:57 user nova-compute[74039]: DEBUG nova.compute.manager [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6939df16-e062-40a1-a705-fe0c03ce647e] Deleting volume: 8b9dc75e-95c3-45ed-a77c-db42f186ffdc {{(pid=74039) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 09:25:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:25:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:25:58 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Refreshing inventories for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 09:25:58 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Updating ProviderTree inventory for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 09:25:58 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Updating inventory in ProviderTree for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 09:25:58 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Refreshing aggregate associations for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb, aggregates: None {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 09:25:58 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Refreshing trait associations for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 09:25:58 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:25:58 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:25:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:25:58 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Deleted allocations for instance 6939df16-e062-40a1-a705-fe0c03ce647e
Oct 20 09:25:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-c0a0bd23-5a4e-4e2d-a9fb-b65bf7a29d2d tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "6939df16-e062-40a1-a705-fe0c03ce647e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.036s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:26:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:26:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:26:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:26:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:26:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:26:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:26:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:26:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:26:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:26:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:26:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:26:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:26:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:26:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:26:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:26:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:26:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:26:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:26:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:26:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:26:37 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:26:37 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:26:38 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:26:40 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:26:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:26:41 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:26:44 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:26:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:26:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:26:46 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:26:46 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:26:46 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Oct 20 09:26:46 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Didn't find any instances for network info cache update. {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 09:26:48 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:26:48 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:26:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:26:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:26:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:26:48 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:26:49 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:26:49 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:26:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=9018MB free_disk=25.36899185180664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:26:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:26:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:26:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:26:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:26:49 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:26:49 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:26:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:26:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:26:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:26:53 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:26:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:26:58 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:27:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:27:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:27:03 user nova-compute[74039]: DEBUG nova.compute.manager [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:27:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:27:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:27:03 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:27:03 user nova-compute[74039]: INFO nova.compute.claims [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Claim successful on node user
Oct 20 09:27:03 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:27:03 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:27:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.184s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:27:03 user nova-compute[74039]: DEBUG nova.compute.manager [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:27:03 user nova-compute[74039]: DEBUG nova.compute.manager [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:27:03 user nova-compute[74039]: DEBUG nova.network.neutron [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:27:03 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:27:04 user nova-compute[74039]: DEBUG nova.compute.manager [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG nova.policy [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d68ed2131b34e57a5f10a01409fee62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367334c57f8f47b696a477460afba369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:27:04 user nova-compute[74039]: INFO nova.virt.block_device [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Booting with volume c0bec70a-6857-4681-abb8-a1a367550935 at /dev/vda
Oct 20 09:27:04 user nova-compute[74039]: DEBUG os_brick.utils [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[97060f8d-de13-4b3c-bd0c-1fd6c783d00b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fae619b-e9ab-473a-90b9-0f59cb7c1d94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d500533-8094-4349-94cc-db653f09abf1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[675c63ba-6dc6-4060-808f-8950831c6011]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:27:04 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:27:04 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4233826e-f8ac-4cce-bffa-a07bf52aed5e]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG os_brick.utils [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:27:04 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Updating existing volume attachment record: 12f2f679-5e65-415c-a103-97a694e2846b {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:27:05 user nova-compute[74039]: DEBUG nova.network.neutron [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Successfully created port: 2ba79124-3bc4-41a7-9b13-523cf4bfdfb3 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:27:05 user nova-compute[74039]: DEBUG nova.network.neutron [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Successfully updated port: 2ba79124-3bc4-41a7-9b13-523cf4bfdfb3 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:27:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "refresh_cache-6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:27:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquired lock "refresh_cache-6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:27:05 user nova-compute[74039]: DEBUG nova.network.neutron [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:27:05 user nova-compute[74039]: DEBUG nova.compute.manager [req-edf9b9a7-4bf9-4411-9432-5096b106cc07 req-4d01fb2e-cf47-421a-9450-671adf4599a2 service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Received event network-changed-2ba79124-3bc4-41a7-9b13-523cf4bfdfb3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:27:05 user nova-compute[74039]: DEBUG nova.compute.manager [req-edf9b9a7-4bf9-4411-9432-5096b106cc07 req-4d01fb2e-cf47-421a-9450-671adf4599a2 service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Refreshing instance network info cache due to event network-changed-2ba79124-3bc4-41a7-9b13-523cf4bfdfb3. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:27:05 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-edf9b9a7-4bf9-4411-9432-5096b106cc07 req-4d01fb2e-cf47-421a-9450-671adf4599a2 service nova] Acquiring lock "refresh_cache-6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:27:05 user nova-compute[74039]: DEBUG nova.network.neutron [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:27:06 user nova-compute[74039]: DEBUG nova.network.neutron [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Updating instance_info_cache with network_info: [{"id": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "address": "fa:16:3e:a4:51:b9", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ba79124-3b", "ovs_interfaceid": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:27:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:27:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Releasing lock "refresh_cache-6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:27:06 user nova-compute[74039]: DEBUG nova.compute.manager [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Instance network_info: |[{"id": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "address": "fa:16:3e:a4:51:b9", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ba79124-3b", "ovs_interfaceid": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:27:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-edf9b9a7-4bf9-4411-9432-5096b106cc07 req-4d01fb2e-cf47-421a-9450-671adf4599a2 service nova] Acquired lock "refresh_cache-6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:27:06 user nova-compute[74039]: DEBUG nova.network.neutron [req-edf9b9a7-4bf9-4411-9432-5096b106cc07 req-4d01fb2e-cf47-421a-9450-671adf4599a2 service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Refreshing network info cache for port 2ba79124-3bc4-41a7-9b13-523cf4bfdfb3 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:27:06 user nova-compute[74039]: DEBUG nova.network.neutron [req-edf9b9a7-4bf9-4411-9432-5096b106cc07 req-4d01fb2e-cf47-421a-9450-671adf4599a2 service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Updated VIF entry in instance network info cache for port 2ba79124-3bc4-41a7-9b13-523cf4bfdfb3. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:27:06 user nova-compute[74039]: DEBUG nova.network.neutron [req-edf9b9a7-4bf9-4411-9432-5096b106cc07 req-4d01fb2e-cf47-421a-9450-671adf4599a2 service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Updating instance_info_cache with network_info: [{"id": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "address": "fa:16:3e:a4:51:b9", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ba79124-3b", "ovs_interfaceid": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:27:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-edf9b9a7-4bf9-4411-9432-5096b106cc07 req-4d01fb2e-cf47-421a-9450-671adf4599a2 service nova] Releasing lock "refresh_cache-6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "1cdbf79e-90b7-4746-8286-8f69277c71c5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:27:10 user nova-compute[74039]: INFO nova.compute.manager [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Unshelving
Oct 20 09:27:10 user nova-compute[74039]: INFO nova.virt.block_device [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Booting with volume d8612b3a-4b13-4246-a573-1856ba293247 at /dev/vdc
Oct 20 09:27:10 user nova-compute[74039]: DEBUG os_brick.utils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e9ac8c-e30e-41bc-b0bd-87548ef447a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ef5edd-33b4-464f-b846-9145d6c1a8ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b77e64-6363-423a-ac55-cacf2945210b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33be255-0a12-4bea-8934-21718e8ddedb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:27:10 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:27:10 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a822399-6818-44ad-a04e-8b57420e93ad]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG os_brick.utils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:27:10 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Updating existing volume attachment record: ec17ed8c-4075-43a4-bb0b-d9745f6d1d3d {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:27:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:27:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.compute.manager [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:27:20 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Creating image(s)
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Did not create local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Ensure instance console log exists: /opt/stack/data/nova/instances/6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Start _get_guest_xml network_info=[{"id": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "address": "fa:16:3e:a4:51:b9", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ba79124-3b", "ovs_interfaceid": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '12f2f679-5e65-415c-a103-97a694e2846b', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOXrxEPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0bec70a-6857-4681-abb8-a1a367550935', 'serial': 'c0bec70a-6857-4681-abb8-a1a367550935'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:27:20 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:27:20 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOXrxEPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:27:20 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:27:20 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:27:20 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d577a7-45e2-437f-ae0b-ba67f1858812]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:27:20 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[233d45ae-20e1-49d2-aff0-fbaa64d80e05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935] added
Oct 20 09:27:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[02240d22-094b-495d-981e-b2b1fa3f7202]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1566be2d-4b34-4bf9-b97a-d807f5ae9d80]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DOXrxEPl {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DOXrxEPl" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0256ca-5d40-4bb5-982c-8837011cdb75]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DOXrxEPl'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c013a1cb-3673-403d-afef-d8a4a746f139]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[596f1679-36b6-4527-b733-03a573418697]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 09:27:20 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 09:27:20 user nova-compute[74039]:  {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:27:20 user nova-compute[74039]: WARNING os_brick.initiator.connectors.iscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 09:27:20 user nova-compute[74039]: 
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eadccb-ba1a-47fa-bb63-be00f190c2f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935, portal: 172.16.0.220,3260]
Oct 20 09:27:20 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935, portal: 172.16.0.220,3260] successful.
Oct 20 09:27:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f36c558-bf38-4885-88e2-4cfb02f3defe]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e84b6ff-c9b7-458c-8942-ffc4fbf39cda]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)
Oct 20 09:27:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)
Oct 20 09:27:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ddb4ff-3594-4c81-b0ed-158306e6f662]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:27:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOXrxEPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23463386563386335', 'path': '/dev/sdb'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463386563386335', 'path': '/dev/sdb'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:27:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1159991946',display_name='tempest-TestVolumeBootPattern-server-1159991946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1159991946',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJQZqpYomopBvyPT79YeuY+pWP4JiFbz530rSSrDfMUmZXfBwTwQSswPKsBo1t1+jn1XQ66AYvtoNfJ5xebswSw6yHcnRHX1AQXk3BmN8XWO1jgu5mgBIib3k6FLvE2iA==',key_name='tempest-TestVolumeBootPattern-1653654445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='367334c57f8f47b696a477460afba369',ramdisk_id='',reservation_id='r-1hndtfdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725287482',owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:27:04Z,user_data=None,user_id='8d68ed2131b34e57a5f10a01409fee62',uuid=6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "address": "fa:16:3e:a4:51:b9", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ba79124-3b", "ovs_interfaceid": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converting VIF {"id": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "address": "fa:16:3e:a4:51:b9", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ba79124-3b", "ovs_interfaceid": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:51:b9,bridge_name='br-int',has_traffic_filtering=True,id=2ba79124-3bc4-41a7-9b13-523cf4bfdfb3,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ba79124-3b') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG nova.objects.instance [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:27:21 user nova-compute[74039]:   <uuid>6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243</uuid>
Oct 20 09:27:21 user nova-compute[74039]:   <name>instance-00000031</name>
Oct 20 09:27:21 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:27:21 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:27:21 user nova-compute[74039]:   <metadata>
Oct 20 09:27:21 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:27:21 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:27:21 user nova-compute[74039]:       <nova:name>tempest-TestVolumeBootPattern-server-1159991946</nova:name>
Oct 20 09:27:21 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:27:20</nova:creationTime>
Oct 20 09:27:21 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:27:21 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:27:21 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:27:21 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:27:21 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:27:21 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:27:21 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:27:21 user nova-compute[74039]:       <nova:owner>
Oct 20 09:27:21 user nova-compute[74039]:         <nova:user uuid="8d68ed2131b34e57a5f10a01409fee62">tempest-TestVolumeBootPattern-1725287482-project-member</nova:user>
Oct 20 09:27:21 user nova-compute[74039]:         <nova:project uuid="367334c57f8f47b696a477460afba369">tempest-TestVolumeBootPattern-1725287482</nova:project>
Oct 20 09:27:21 user nova-compute[74039]:       </nova:owner>
Oct 20 09:27:21 user nova-compute[74039]:       <nova:ports>
Oct 20 09:27:21 user nova-compute[74039]:         <nova:port uuid="2ba79124-3bc4-41a7-9b13-523cf4bfdfb3">
Oct 20 09:27:21 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 09:27:21 user nova-compute[74039]:         </nova:port>
Oct 20 09:27:21 user nova-compute[74039]:       </nova:ports>
Oct 20 09:27:21 user nova-compute[74039]:     </nova:instance>
Oct 20 09:27:21 user nova-compute[74039]:   </metadata>
Oct 20 09:27:21 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:27:21 user nova-compute[74039]:     <system>
Oct 20 09:27:21 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:27:21 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:27:21 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:27:21 user nova-compute[74039]:       <entry name="serial">6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243</entry>
Oct 20 09:27:21 user nova-compute[74039]:       <entry name="uuid">6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243</entry>
Oct 20 09:27:21 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:27:21 user nova-compute[74039]:     </system>
Oct 20 09:27:21 user nova-compute[74039]:   </sysinfo>
Oct 20 09:27:21 user nova-compute[74039]:   <os>
Oct 20 09:27:21 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:27:21 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:27:21 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:27:21 user nova-compute[74039]:   </os>
Oct 20 09:27:21 user nova-compute[74039]:   <features>
Oct 20 09:27:21 user nova-compute[74039]:     <acpi/>
Oct 20 09:27:21 user nova-compute[74039]:     <apic/>
Oct 20 09:27:21 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:27:21 user nova-compute[74039]:   </features>
Oct 20 09:27:21 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:27:21 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:27:21 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:27:21 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:27:21 user nova-compute[74039]:   </clock>
Oct 20 09:27:21 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:27:21 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:27:21 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:27:21 user nova-compute[74039]:   </cpu>
Oct 20 09:27:21 user nova-compute[74039]:   <devices>
Oct 20 09:27:21 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 09:27:21 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:27:21 user nova-compute[74039]:       <source dev="/dev/sdb"/>
Oct 20 09:27:21 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:27:21 user nova-compute[74039]:       <serial>c0bec70a-6857-4681-abb8-a1a367550935</serial>
Oct 20 09:27:21 user nova-compute[74039]:     </disk>
Oct 20 09:27:21 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:27:21 user nova-compute[74039]:       <mac address="fa:16:3e:a4:51:b9"/>
Oct 20 09:27:21 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:27:21 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:27:21 user nova-compute[74039]:       <target dev="tap2ba79124-3b"/>
Oct 20 09:27:21 user nova-compute[74039]:     </interface>
Oct 20 09:27:21 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:27:21 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243/console.log" append="off"/>
Oct 20 09:27:21 user nova-compute[74039]:     </serial>
Oct 20 09:27:21 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:27:21 user nova-compute[74039]:     <video>
Oct 20 09:27:21 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:27:21 user nova-compute[74039]:     </video>
Oct 20 09:27:21 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:27:21 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:27:21 user nova-compute[74039]:     </rng>
Oct 20 09:27:21 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:27:21 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:27:21 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:27:21 user nova-compute[74039]:     </memballoon>
Oct 20 09:27:21 user nova-compute[74039]:   </devices>
Oct 20 09:27:21 user nova-compute[74039]: </domain>
Oct 20 09:27:21 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:27:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1159991946',display_name='tempest-TestVolumeBootPattern-server-1159991946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1159991946',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJQZqpYomopBvyPT79YeuY+pWP4JiFbz530rSSrDfMUmZXfBwTwQSswPKsBo1t1+jn1XQ66AYvtoNfJ5xebswSw6yHcnRHX1AQXk3BmN8XWO1jgu5mgBIib3k6FLvE2iA==',key_name='tempest-TestVolumeBootPattern-1653654445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='367334c57f8f47b696a477460afba369',ramdisk_id='',reservation_id='r-1hndtfdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725287482',owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:27:04Z,user_data=None,user_id='8d68ed2131b34e57a5f10a01409fee62',uuid=6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "address": "fa:16:3e:a4:51:b9", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ba79124-3b", "ovs_interfaceid": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converting VIF {"id": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "address": "fa:16:3e:a4:51:b9", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ba79124-3b", "ovs_interfaceid": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:51:b9,bridge_name='br-int',has_traffic_filtering=True,id=2ba79124-3bc4-41a7-9b13-523cf4bfdfb3,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ba79124-3b') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG os_vif [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:51:b9,bridge_name='br-int',has_traffic_filtering=True,id=2ba79124-3bc4-41a7-9b13-523cf4bfdfb3,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ba79124-3b') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50822485-880d-5650-9409-65bf884f0e6c', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ba79124-3b, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ba79124-3b, col_values=(('qos', UUID('2fae3d31-648c-4069-a3e5-648ed91ec048')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ba79124-3b, col_values=(('external_ids', {'iface-id': '2ba79124-3bc4-41a7-9b13-523cf4bfdfb3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:51:b9', 'vm-uuid': '6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:21 user nova-compute[74039]: INFO os_vif [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:51:b9,bridge_name='br-int',has_traffic_filtering=True,id=2ba79124-3bc4-41a7-9b13-523cf4bfdfb3,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ba79124-3b')
Oct 20 09:27:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:27:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] No VIF found with MAC fa:16:3e:a4:51:b9, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:27:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-baa04b12-603b-413a-a7a0-fb57ad9ffac9 req-64cedc37-e75b-4171-813a-7d32e87f90c3 service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Received event network-vif-plugged-2ba79124-3bc4-41a7-9b13-523cf4bfdfb3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:27:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-baa04b12-603b-413a-a7a0-fb57ad9ffac9 req-64cedc37-e75b-4171-813a-7d32e87f90c3 service nova] Acquiring lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:27:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-baa04b12-603b-413a-a7a0-fb57ad9ffac9 req-64cedc37-e75b-4171-813a-7d32e87f90c3 service nova] Lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:27:23 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-baa04b12-603b-413a-a7a0-fb57ad9ffac9 req-64cedc37-e75b-4171-813a-7d32e87f90c3 service nova] Lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:27:23 user nova-compute[74039]: DEBUG nova.compute.manager [req-baa04b12-603b-413a-a7a0-fb57ad9ffac9 req-64cedc37-e75b-4171-813a-7d32e87f90c3 service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] No waiting events found dispatching network-vif-plugged-2ba79124-3bc4-41a7-9b13-523cf4bfdfb3 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:27:23 user nova-compute[74039]: WARNING nova.compute.manager [req-baa04b12-603b-413a-a7a0-fb57ad9ffac9 req-64cedc37-e75b-4171-813a-7d32e87f90c3 service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Received unexpected event network-vif-plugged-2ba79124-3bc4-41a7-9b13-523cf4bfdfb3 for instance with vm_state building and task_state spawning.
Oct 20 09:27:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:24 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:25 user nova-compute[74039]: DEBUG nova.compute.manager [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:27:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:27:25 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Instance spawned successfully.
Oct 20 09:27:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:27:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:27:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:27:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:27:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:27:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:27:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:27:25 user nova-compute[74039]: INFO nova.compute.manager [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Took 5.10 seconds to spawn the instance on the hypervisor.
Oct 20 09:27:25 user nova-compute[74039]: DEBUG nova.compute.manager [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:27:25 user nova-compute[74039]: INFO nova.compute.manager [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Took 21.70 seconds to build instance.
Oct 20 09:27:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-55701e2d-4312-4220-9950-c5642c34304e tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.802s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:27:25 user nova-compute[74039]: DEBUG nova.compute.manager [req-86130a00-cbf9-4581-b3c6-e217df63266c req-ff9e5a57-81b5-4fe5-90cf-d8ed5de604e4 service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Received event network-vif-plugged-2ba79124-3bc4-41a7-9b13-523cf4bfdfb3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:27:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-86130a00-cbf9-4581-b3c6-e217df63266c req-ff9e5a57-81b5-4fe5-90cf-d8ed5de604e4 service nova] Acquiring lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:27:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-86130a00-cbf9-4581-b3c6-e217df63266c req-ff9e5a57-81b5-4fe5-90cf-d8ed5de604e4 service nova] Lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:27:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-86130a00-cbf9-4581-b3c6-e217df63266c req-ff9e5a57-81b5-4fe5-90cf-d8ed5de604e4 service nova] Lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:27:25 user nova-compute[74039]: DEBUG nova.compute.manager [req-86130a00-cbf9-4581-b3c6-e217df63266c req-ff9e5a57-81b5-4fe5-90cf-d8ed5de604e4 service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] No waiting events found dispatching network-vif-plugged-2ba79124-3bc4-41a7-9b13-523cf4bfdfb3 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:27:25 user nova-compute[74039]: WARNING nova.compute.manager [req-86130a00-cbf9-4581-b3c6-e217df63266c req-ff9e5a57-81b5-4fe5-90cf-d8ed5de604e4 service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Received unexpected event network-vif-plugged-2ba79124-3bc4-41a7-9b13-523cf4bfdfb3 for instance with vm_state active and task_state None.
Oct 20 09:27:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:27:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:27:27 user nova-compute[74039]: DEBUG nova.objects.instance [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'pci_requests' on Instance uuid 1cdbf79e-90b7-4746-8286-8f69277c71c5 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:27:27 user nova-compute[74039]: DEBUG nova.objects.instance [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'numa_topology' on Instance uuid 1cdbf79e-90b7-4746-8286-8f69277c71c5 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:27:27 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:27:27 user nova-compute[74039]: INFO nova.compute.claims [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Claim successful on node user
Oct 20 09:27:27 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:27:27 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:27:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:27:27 user nova-compute[74039]: INFO nova.network.neutron [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Updating port 401cb923-c809-4d13-8811-ac2e26bab571 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 09:27:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:27:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquired lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:27:28 user nova-compute[74039]: DEBUG nova.network.neutron [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:27:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-8db1ebe4-1c3f-48db-b183-6b16698d6dc5 req-dc0b097d-c124-411d-9be7-821f72da0f55 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received event network-changed-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:27:28 user nova-compute[74039]: DEBUG nova.compute.manager [req-8db1ebe4-1c3f-48db-b183-6b16698d6dc5 req-dc0b097d-c124-411d-9be7-821f72da0f55 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Refreshing instance network info cache due to event network-changed-401cb923-c809-4d13-8811-ac2e26bab571. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:27:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8db1ebe4-1c3f-48db-b183-6b16698d6dc5 req-dc0b097d-c124-411d-9be7-821f72da0f55 service nova] Acquiring lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:27:28 user nova-compute[74039]: DEBUG nova.network.neutron [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Updating instance_info_cache with network_info: [{"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:27:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Releasing lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:27:28 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:27:28 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Creating image(s)
Oct 20 09:27:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "/opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:27:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "/opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:27:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "/opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:27:28 user nova-compute[74039]: DEBUG nova.objects.instance [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1cdbf79e-90b7-4746-8286-8f69277c71c5 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:27:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8db1ebe4-1c3f-48db-b183-6b16698d6dc5 req-dc0b097d-c124-411d-9be7-821f72da0f55 service nova] Acquired lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:27:28 user nova-compute[74039]: DEBUG nova.network.neutron [req-8db1ebe4-1c3f-48db-b183-6b16698d6dc5 req-dc0b097d-c124-411d-9be7-821f72da0f55 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Refreshing network info cache for port 401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:27:28 user nova-compute[74039]: DEBUG nova.objects.base [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Object Instance<1cdbf79e-90b7-4746-8286-8f69277c71c5> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:27:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "c8f128359c09f6007ca8c3e9df6d93668f8fae28" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:27:28 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "c8f128359c09f6007ca8c3e9df6d93668f8fae28" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:27:29 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8f128359c09f6007ca8c3e9df6d93668f8fae28.part --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8f128359c09f6007ca8c3e9df6d93668f8fae28.part --force-share --output=json" returned: 0 in 0.201s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:30 user nova-compute[74039]: DEBUG nova.virt.images [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] 0cf7e9a5-3ba9-4918-a2f8-210624fa8b88 was qcow2, converting to raw {{(pid=74039) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 09:27:30 user nova-compute[74039]: DEBUG nova.privsep.utils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74039) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 09:27:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c8f128359c09f6007ca8c3e9df6d93668f8fae28.part /opt/stack/data/nova/instances/_base/c8f128359c09f6007ca8c3e9df6d93668f8fae28.converted {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:30 user nova-compute[74039]: DEBUG nova.network.neutron [req-8db1ebe4-1c3f-48db-b183-6b16698d6dc5 req-dc0b097d-c124-411d-9be7-821f72da0f55 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Updated VIF entry in instance network info cache for port 401cb923-c809-4d13-8811-ac2e26bab571. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:27:30 user nova-compute[74039]: DEBUG nova.network.neutron [req-8db1ebe4-1c3f-48db-b183-6b16698d6dc5 req-dc0b097d-c124-411d-9be7-821f72da0f55 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Updating instance_info_cache with network_info: [{"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:27:30 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-8db1ebe4-1c3f-48db-b183-6b16698d6dc5 req-dc0b097d-c124-411d-9be7-821f72da0f55 service nova] Releasing lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:27:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c8f128359c09f6007ca8c3e9df6d93668f8fae28.part /opt/stack/data/nova/instances/_base/c8f128359c09f6007ca8c3e9df6d93668f8fae28.converted" returned: 0 in 0.684s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:30 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8f128359c09f6007ca8c3e9df6d93668f8fae28.converted --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8f128359c09f6007ca8c3e9df6d93668f8fae28.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "c8f128359c09f6007ca8c3e9df6d93668f8fae28" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.324s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:27:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8f128359c09f6007ca8c3e9df6d93668f8fae28 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8f128359c09f6007ca8c3e9df6d93668f8fae28 --force-share --output=json" returned: 0 in 0.175s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "c8f128359c09f6007ca8c3e9df6d93668f8fae28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:27:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "c8f128359c09f6007ca8c3e9df6d93668f8fae28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:27:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8f128359c09f6007ca8c3e9df6d93668f8fae28 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8f128359c09f6007ca8c3e9df6d93668f8fae28 --force-share --output=json" returned: 0 in 0.178s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8f128359c09f6007ca8c3e9df6d93668f8fae28,backing_fmt=raw /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8f128359c09f6007ca8c3e9df6d93668f8fae28,backing_fmt=raw /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk 1073741824" returned: 0 in 0.051s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:31 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "c8f128359c09f6007ca8c3e9df6d93668f8fae28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:27:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8f128359c09f6007ca8c3e9df6d93668f8fae28 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8f128359c09f6007ca8c3e9df6d93668f8fae28 --force-share --output=json" returned: 0 in 0.180s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:31 user nova-compute[74039]: DEBUG nova.objects.instance [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'migration_context' on Instance uuid 1cdbf79e-90b7-4746-8286-8f69277c71c5 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:27:31 user nova-compute[74039]: DEBUG nova.objects.base [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Object Instance<1cdbf79e-90b7-4746-8286-8f69277c71c5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:27:31 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Rebasing disk image.
Oct 20 09:27:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.187s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:31 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 -F raw /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 -F raw /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk" returned: 0 in 2.082s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Ensure instance console log exists: /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Start _get_guest_xml network_info=[{"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='7caf5d776799a06fd13188f0341c5525',container_format='bare',created_at=2023-10-20T09:25:17Z,direct_url=<?>,disk_format='qcow2',id=0cf7e9a5-3ba9-4918-a2f8-210624fa8b88,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-890462872-shelved',owner='235f30d0612f4bfba028314ba7155dcf',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T09:25:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ec17ed8c-4075-43a4-bb0b-d9745f6d1d3d', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdc', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eJREUkLQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '1cdbf79e-90b7-4746-8286-8f69277c71c5', 'attached_at': '', 'detached_at': '', 'volume_id': 'd8612b3a-4b13-4246-a573-1856ba293247', 'serial': 'd8612b3a-4b13-4246-a573-1856ba293247'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:27:33 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:27:33 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7caf5d776799a06fd13188f0341c5525',container_format='bare',created_at=2023-10-20T09:25:17Z,direct_url=<?>,disk_format='qcow2',id=0cf7e9a5-3ba9-4918-a2f8-210624fa8b88,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-890462872-shelved',owner='235f30d0612f4bfba028314ba7155dcf',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T09:25:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.objects.instance [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1cdbf79e-90b7-4746-8286-8f69277c71c5 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:27:33 user nova-compute[74039]: DEBUG nova.objects.base [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Object Instance<1cdbf79e-90b7-4746-8286-8f69277c71c5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eJREUkLQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:27:34 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:27:34 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:27:34 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c106f02-6e2d-40bc-a746-e4b0c5e3e291]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:27:34 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f67825-63e8-4df0-af38-ac317fbcac0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247] added
Oct 20 09:27:34 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5269af0-bb84-4b4c-8eb0-ff8786272459]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.128s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e7b3f5-b69c-4593-b11b-6496099f5b46]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eJREUkLQ {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eJREUkLQ" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea18ca9b-5404-4ab3-8aeb-afaed7bc349b]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eJREUkLQ'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f929116f-b9e8-4531-aebd-6f983c6f177d]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5335002c-6341-4657-9e92-6728374a9938]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)
Oct 20 09:27:34 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)
Oct 20 09:27:34 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40bfc25-f039-4574-b361-6b1f192c44fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247, portal: 172.16.0.220,3260]
Oct 20 09:27:34 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247, portal: 172.16.0.220,3260] successful.
Oct 20 09:27:34 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e1485c-e65e-42fa-bd86-04ef23465f1f]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[40020907-a1d6-415e-8b47-380fe2ddd39d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)
Oct 20 09:27:34 user nova-compute[74039]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 (non-flash)
Oct 20 09:27:34 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)
Oct 20 09:27:34 user nova-compute[74039]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 (non-flash)
Oct 20 09:27:34 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae014dc-dd83-4c89-8b15-84718e2cd499]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:27:34 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eJREUkLQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.433s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '23165663565313164', 'path': '/dev/sdc'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165663565313164', 'path': '/dev/sdc'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T09:23:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-890462872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-890462872',id=48,image_ref='0cf7e9a5-3ba9-4918-a2f8-210624fa8b88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-931468445',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:23:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='235f30d0612f4bfba028314ba7155dcf',ramdisk_id='',reservation_id='r-4jx12o7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1190516011',owner_user_name='tempest-AttachVolumeShelveTestJSON-1190516011-project-member',shelved_at='2023-10-20T09:25:21.473911',shelved_host='user',shelved_image_id='0cf7e9a5-3ba9-4918-a2f8-210624fa8b88'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:27:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd7771575aef439ebf1d55d3c4dcc377',uuid=1cdbf79e-90b7-4746-8286-8f69277c71c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converting VIF {"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=401cb923-c809-4d13-8811-ac2e26bab571,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401cb923-c8') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG nova.objects.instance [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'pci_devices' on Instance uuid 1cdbf79e-90b7-4746-8286-8f69277c71c5 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG nova.objects.base [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Object Instance<1cdbf79e-90b7-4746-8286-8f69277c71c5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:27:35 user nova-compute[74039]:   <uuid>1cdbf79e-90b7-4746-8286-8f69277c71c5</uuid>
Oct 20 09:27:35 user nova-compute[74039]:   <name>instance-00000030</name>
Oct 20 09:27:35 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:27:35 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:27:35 user nova-compute[74039]:   <metadata>
Oct 20 09:27:35 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:27:35 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:27:35 user nova-compute[74039]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-890462872</nova:name>
Oct 20 09:27:35 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:27:33</nova:creationTime>
Oct 20 09:27:35 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:27:35 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:27:35 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:27:35 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:27:35 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:27:35 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:27:35 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:27:35 user nova-compute[74039]:       <nova:owner>
Oct 20 09:27:35 user nova-compute[74039]:         <nova:user uuid="bd7771575aef439ebf1d55d3c4dcc377">tempest-AttachVolumeShelveTestJSON-1190516011-project-member</nova:user>
Oct 20 09:27:35 user nova-compute[74039]:         <nova:project uuid="235f30d0612f4bfba028314ba7155dcf">tempest-AttachVolumeShelveTestJSON-1190516011</nova:project>
Oct 20 09:27:35 user nova-compute[74039]:       </nova:owner>
Oct 20 09:27:35 user nova-compute[74039]:       <nova:root type="image" uuid="0cf7e9a5-3ba9-4918-a2f8-210624fa8b88"/>
Oct 20 09:27:35 user nova-compute[74039]:       <nova:ports>
Oct 20 09:27:35 user nova-compute[74039]:         <nova:port uuid="401cb923-c809-4d13-8811-ac2e26bab571">
Oct 20 09:27:35 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 09:27:35 user nova-compute[74039]:         </nova:port>
Oct 20 09:27:35 user nova-compute[74039]:       </nova:ports>
Oct 20 09:27:35 user nova-compute[74039]:     </nova:instance>
Oct 20 09:27:35 user nova-compute[74039]:   </metadata>
Oct 20 09:27:35 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:27:35 user nova-compute[74039]:     <system>
Oct 20 09:27:35 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:27:35 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:27:35 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:27:35 user nova-compute[74039]:       <entry name="serial">1cdbf79e-90b7-4746-8286-8f69277c71c5</entry>
Oct 20 09:27:35 user nova-compute[74039]:       <entry name="uuid">1cdbf79e-90b7-4746-8286-8f69277c71c5</entry>
Oct 20 09:27:35 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:27:35 user nova-compute[74039]:     </system>
Oct 20 09:27:35 user nova-compute[74039]:   </sysinfo>
Oct 20 09:27:35 user nova-compute[74039]:   <os>
Oct 20 09:27:35 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:27:35 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:27:35 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:27:35 user nova-compute[74039]:   </os>
Oct 20 09:27:35 user nova-compute[74039]:   <features>
Oct 20 09:27:35 user nova-compute[74039]:     <acpi/>
Oct 20 09:27:35 user nova-compute[74039]:     <apic/>
Oct 20 09:27:35 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:27:35 user nova-compute[74039]:   </features>
Oct 20 09:27:35 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:27:35 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:27:35 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:27:35 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:27:35 user nova-compute[74039]:   </clock>
Oct 20 09:27:35 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:27:35 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:27:35 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:27:35 user nova-compute[74039]:   </cpu>
Oct 20 09:27:35 user nova-compute[74039]:   <devices>
Oct 20 09:27:35 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:27:35 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:27:35 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk"/>
Oct 20 09:27:35 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:27:35 user nova-compute[74039]:     </disk>
Oct 20 09:27:35 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 09:27:35 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:27:35 user nova-compute[74039]:       <source dev="/dev/sdc"/>
Oct 20 09:27:35 user nova-compute[74039]:       <target dev="vdc" bus="virtio"/>
Oct 20 09:27:35 user nova-compute[74039]:       <serial>d8612b3a-4b13-4246-a573-1856ba293247</serial>
Oct 20 09:27:35 user nova-compute[74039]:     </disk>
Oct 20 09:27:35 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:27:35 user nova-compute[74039]:       <mac address="fa:16:3e:57:e1:1e"/>
Oct 20 09:27:35 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:27:35 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:27:35 user nova-compute[74039]:       <target dev="tap401cb923-c8"/>
Oct 20 09:27:35 user nova-compute[74039]:     </interface>
Oct 20 09:27:35 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:27:35 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/console.log" append="off"/>
Oct 20 09:27:35 user nova-compute[74039]:     </serial>
Oct 20 09:27:35 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:27:35 user nova-compute[74039]:     <video>
Oct 20 09:27:35 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:27:35 user nova-compute[74039]:     </video>
Oct 20 09:27:35 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:27:35 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:27:35 user nova-compute[74039]:     </rng>
Oct 20 09:27:35 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:27:35 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:27:35 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:27:35 user nova-compute[74039]:     </memballoon>
Oct 20 09:27:35 user nova-compute[74039]:   </devices>
Oct 20 09:27:35 user nova-compute[74039]: </domain>
Oct 20 09:27:35 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T09:23:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-890462872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-890462872',id=48,image_ref='0cf7e9a5-3ba9-4918-a2f8-210624fa8b88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-931468445',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:23:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='235f30d0612f4bfba028314ba7155dcf',ramdisk_id='',reservation_id='r-4jx12o7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1190516011',owner_user_name='tempest-AttachVolumeShelveTestJSON-1190516011-project-member',shelved_at='2023-10-20T09:25:21.473911',shelved_host='user',shelved_image_id='0cf7e9a5-3ba9-4918-a2f8-210624fa8b88'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:27:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd7771575aef439ebf1d55d3c4dcc377',uuid=1cdbf79e-90b7-4746-8286-8f69277c71c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converting VIF {"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=401cb923-c809-4d13-8811-ac2e26bab571,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401cb923-c8') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG os_vif [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=401cb923-c809-4d13-8811-ac2e26bab571,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401cb923-c8') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a92c888-46fb-574f-8ff8-27c5a3877578', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap401cb923-c8, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap401cb923-c8, col_values=(('qos', UUID('9e08b638-43c9-412b-b731-7245a147f336')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap401cb923-c8, col_values=(('external_ids', {'iface-id': '401cb923-c809-4d13-8811-ac2e26bab571', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:e1:1e', 'vm-uuid': '1cdbf79e-90b7-4746-8286-8f69277c71c5'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:35 user nova-compute[74039]: INFO os_vif [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=401cb923-c809-4d13-8811-ac2e26bab571,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401cb923-c8')
Oct 20 09:27:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:27:35 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] No VIF found with MAC fa:16:3e:57:e1:1e, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:27:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:37 user nova-compute[74039]: DEBUG nova.compute.manager [req-eb88d4d3-65b9-4b4b-9b8f-d6dee63d23ba req-8a4576b1-6772-455a-90ef-bada0283a4c3 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received event network-vif-plugged-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:27:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eb88d4d3-65b9-4b4b-9b8f-d6dee63d23ba req-8a4576b1-6772-455a-90ef-bada0283a4c3 service nova] Acquiring lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:27:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eb88d4d3-65b9-4b4b-9b8f-d6dee63d23ba req-8a4576b1-6772-455a-90ef-bada0283a4c3 service nova] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:27:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-eb88d4d3-65b9-4b4b-9b8f-d6dee63d23ba req-8a4576b1-6772-455a-90ef-bada0283a4c3 service nova] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:27:37 user nova-compute[74039]: DEBUG nova.compute.manager [req-eb88d4d3-65b9-4b4b-9b8f-d6dee63d23ba req-8a4576b1-6772-455a-90ef-bada0283a4c3 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] No waiting events found dispatching network-vif-plugged-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:27:37 user nova-compute[74039]: WARNING nova.compute.manager [req-eb88d4d3-65b9-4b4b-9b8f-d6dee63d23ba req-8a4576b1-6772-455a-90ef-bada0283a4c3 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received unexpected event network-vif-plugged-401cb923-c809-4d13-8811-ac2e26bab571 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 09:27:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:38 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:27:38 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:27:39 user nova-compute[74039]: DEBUG nova.compute.manager [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:27:39 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:27:39 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Instance spawned successfully.
Oct 20 09:27:39 user nova-compute[74039]: DEBUG nova.compute.manager [req-ec638c1c-3502-42f8-86d2-fc2e962a5139 req-212faf4c-30da-4e8e-8341-a28a66f1a5a1 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received event network-vif-plugged-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:27:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ec638c1c-3502-42f8-86d2-fc2e962a5139 req-212faf4c-30da-4e8e-8341-a28a66f1a5a1 service nova] Acquiring lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:27:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ec638c1c-3502-42f8-86d2-fc2e962a5139 req-212faf4c-30da-4e8e-8341-a28a66f1a5a1 service nova] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:27:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ec638c1c-3502-42f8-86d2-fc2e962a5139 req-212faf4c-30da-4e8e-8341-a28a66f1a5a1 service nova] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:27:39 user nova-compute[74039]: DEBUG nova.compute.manager [req-ec638c1c-3502-42f8-86d2-fc2e962a5139 req-212faf4c-30da-4e8e-8341-a28a66f1a5a1 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] No waiting events found dispatching network-vif-plugged-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:27:39 user nova-compute[74039]: WARNING nova.compute.manager [req-ec638c1c-3502-42f8-86d2-fc2e962a5139 req-212faf4c-30da-4e8e-8341-a28a66f1a5a1 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received unexpected event network-vif-plugged-401cb923-c809-4d13-8811-ac2e26bab571 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 09:27:39 user nova-compute[74039]: DEBUG nova.compute.manager [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:27:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:39 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-35a4b437-a119-4ac4-b7cf-9dbee010dec0 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 29.196s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:27:39 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:27:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:41 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:27:43 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:27:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:45 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:27:47 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:27:47 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:27:47 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Rebuilding the list of instances to heal {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 09:27:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:27:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:27:47 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:27:47 user nova-compute[74039]: DEBUG nova.objects.instance [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lazy-loading 'info_cache' on Instance uuid 1cdbf79e-90b7-4746-8286-8f69277c71c5 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:27:48 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Updating instance_info_cache with network_info: [{"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:27:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:27:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:27:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:49 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:27:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:27:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:27:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:27:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:27:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:27:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:27:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:27:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:27:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:50 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:27:50 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:27:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8752MB free_disk=25.332786560058594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:27:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:27:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:27:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:27:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 1cdbf79e-90b7-4746-8286-8f69277c71c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:27:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:27:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:27:50 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:27:50 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:27:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:27:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:27:51 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:27:52 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:27:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:27:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:28:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:28:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:39 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:28:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:40 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:28:40 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:28:42 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:28:44 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:28:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:47 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:28:47 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:28:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:28:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:28:47 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:28:48 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Updating instance_info_cache with network_info: [{"id": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "address": "fa:16:3e:a4:51:b9", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ba79124-3b", "ovs_interfaceid": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:28:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:28:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:28:48 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:28:49 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:28:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:28:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:28:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:28:49 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:28:49 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:28:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:28:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:28:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:28:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:28:50 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:28:50 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:28:50 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:28:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8784MB free_disk=25.330642700195312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:28:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:28:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:28:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:28:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 1cdbf79e-90b7-4746-8286-8f69277c71c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:28:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:28:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:28:50 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:28:50 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:28:50 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:28:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:28:51 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:28:54 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:28:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:28:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-9b08cd2a-5361-4006-8297-bd4e8f784ebb req-f571a60b-52b5-40cd-adf6-e635aacfb9fb service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Received event network-changed-2ba79124-3bc4-41a7-9b13-523cf4bfdfb3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:28:55 user nova-compute[74039]: DEBUG nova.compute.manager [req-9b08cd2a-5361-4006-8297-bd4e8f784ebb req-f571a60b-52b5-40cd-adf6-e635aacfb9fb service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Refreshing instance network info cache due to event network-changed-2ba79124-3bc4-41a7-9b13-523cf4bfdfb3. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:28:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9b08cd2a-5361-4006-8297-bd4e8f784ebb req-f571a60b-52b5-40cd-adf6-e635aacfb9fb service nova] Acquiring lock "refresh_cache-6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:28:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9b08cd2a-5361-4006-8297-bd4e8f784ebb req-f571a60b-52b5-40cd-adf6-e635aacfb9fb service nova] Acquired lock "refresh_cache-6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:28:55 user nova-compute[74039]: DEBUG nova.network.neutron [req-9b08cd2a-5361-4006-8297-bd4e8f784ebb req-f571a60b-52b5-40cd-adf6-e635aacfb9fb service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Refreshing network info cache for port 2ba79124-3bc4-41a7-9b13-523cf4bfdfb3 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:28:56 user nova-compute[74039]: DEBUG nova.network.neutron [req-9b08cd2a-5361-4006-8297-bd4e8f784ebb req-f571a60b-52b5-40cd-adf6-e635aacfb9fb service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Updated VIF entry in instance network info cache for port 2ba79124-3bc4-41a7-9b13-523cf4bfdfb3. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:28:56 user nova-compute[74039]: DEBUG nova.network.neutron [req-9b08cd2a-5361-4006-8297-bd4e8f784ebb req-f571a60b-52b5-40cd-adf6-e635aacfb9fb service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Updating instance_info_cache with network_info: [{"id": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "address": "fa:16:3e:a4:51:b9", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ba79124-3b", "ovs_interfaceid": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:28:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-9b08cd2a-5361-4006-8297-bd4e8f784ebb req-f571a60b-52b5-40cd-adf6-e635aacfb9fb service nova] Releasing lock "refresh_cache-6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:28:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:28:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:28:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:28:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:28:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:28:57 user nova-compute[74039]: INFO nova.compute.manager [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Terminating instance
Oct 20 09:28:57 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:28:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:57 user nova-compute[74039]: DEBUG nova.compute.manager [req-b6ebf3ea-c599-4dd1-bf65-d4f86eb4408b req-9127ed4a-af7f-4f36-9bb4-b97c56f61760 service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Received event network-vif-unplugged-2ba79124-3bc4-41a7-9b13-523cf4bfdfb3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:28:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b6ebf3ea-c599-4dd1-bf65-d4f86eb4408b req-9127ed4a-af7f-4f36-9bb4-b97c56f61760 service nova] Acquiring lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:28:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b6ebf3ea-c599-4dd1-bf65-d4f86eb4408b req-9127ed4a-af7f-4f36-9bb4-b97c56f61760 service nova] Lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:28:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b6ebf3ea-c599-4dd1-bf65-d4f86eb4408b req-9127ed4a-af7f-4f36-9bb4-b97c56f61760 service nova] Lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:28:57 user nova-compute[74039]: DEBUG nova.compute.manager [req-b6ebf3ea-c599-4dd1-bf65-d4f86eb4408b req-9127ed4a-af7f-4f36-9bb4-b97c56f61760 service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] No waiting events found dispatching network-vif-unplugged-2ba79124-3bc4-41a7-9b13-523cf4bfdfb3 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:28:57 user nova-compute[74039]: DEBUG nova.compute.manager [req-b6ebf3ea-c599-4dd1-bf65-d4f86eb4408b req-9127ed4a-af7f-4f36-9bb4-b97c56f61760 service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Received event network-vif-unplugged-2ba79124-3bc4-41a7-9b13-523cf4bfdfb3 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:28:58 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Instance destroyed successfully.
Oct 20 09:28:58 user nova-compute[74039]: DEBUG nova.objects.instance [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lazy-loading 'resources' on Instance uuid 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:27:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1159991946',display_name='tempest-TestVolumeBootPattern-server-1159991946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1159991946',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJQZqpYomopBvyPT79YeuY+pWP4JiFbz530rSSrDfMUmZXfBwTwQSswPKsBo1t1+jn1XQ66AYvtoNfJ5xebswSw6yHcnRHX1AQXk3BmN8XWO1jgu5mgBIib3k6FLvE2iA==',key_name='tempest-TestVolumeBootPattern-1653654445',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:27:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='367334c57f8f47b696a477460afba369',ramdisk_id='',reservation_id='r-1hndtfdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1725287482',owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:27:25Z,user_data=None,user_id='8d68ed2131b34e57a5f10a01409fee62',uuid=6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "address": "fa:16:3e:a4:51:b9", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ba79124-3b", "ovs_interfaceid": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converting VIF {"id": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "address": "fa:16:3e:a4:51:b9", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ba79124-3b", "ovs_interfaceid": "2ba79124-3bc4-41a7-9b13-523cf4bfdfb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:51:b9,bridge_name='br-int',has_traffic_filtering=True,id=2ba79124-3bc4-41a7-9b13-523cf4bfdfb3,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ba79124-3b') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_vif [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:51:b9,bridge_name='br-int',has_traffic_filtering=True,id=2ba79124-3bc4-41a7-9b13-523cf4bfdfb3,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ba79124-3b') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ba79124-3b, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2fae3d31-648c-4069-a3e5-648ed91ec048) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:58 user nova-compute[74039]: INFO os_vif [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:51:b9,bridge_name='br-int',has_traffic_filtering=True,id=2ba79124-3bc4-41a7-9b13-523cf4bfdfb3,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ba79124-3b')
Oct 20 09:28:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOXrxEPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:28:58 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e727903b-2b66-4cb1-a609-81c66beeb94f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:28:58 user nova-compute[74039]: No targets found.
Oct 20 09:28:58 user nova-compute[74039]: iSNS:
Oct 20 09:28:58 user nova-compute[74039]: No targets found.
Oct 20 09:28:58 user nova-compute[74039]: STATIC:
Oct 20 09:28:58 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935
Oct 20 09:28:58 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:28:58 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:28:58 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247
Oct 20 09:28:58 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:28:58 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:28:58 user nova-compute[74039]: FIRMWARE:
Oct 20 09:28:58 user nova-compute[74039]: No targets found.
Oct 20 09:28:58 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:28:58 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:28:58 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[61851bf3-233d-4ba7-b00c-f67928745c93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7795d4e5-aaf4-4295-a05a-f4e8d64449cf]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)
Oct 20 09:28:58 user nova-compute[74039]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 (non-flash)
Oct 20 09:28:58 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)
Oct 20 09:28:58 user nova-compute[74039]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 (non-flash)
Oct 20 09:28:58 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae84269750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935'): ({'sdb'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Removing single pathed devices sdb {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abc8934-f865-43f2-8cec-4387c3cee7f4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2c60b1-05c3-4e4b-b8e5-36d6d6912db9]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Flushing IO for device /dev/sdb {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1e959b-429b-4e6b-83d1-2e83ccdf47c6]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8823295-a925-4c5f-8a7b-5188cb9aca6c]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a78db01e',) {{(pid=85466) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ca167d-6587-47a6-9ebf-7899115b3d42]: (4, None) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce48638-a026-4808-b3ca-86f391fafbb3]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[89109019-6341-46a9-b8d1-599c93b181ef]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935, portal: 172.16.0.220,3260]
Oct 20 09:28:58 user nova-compute[74039]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935, portal: 172.16.0.220,3260] successful.
Oct 20 09:28:58 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6567a40-e66c-474e-aa60-288ab972c9f7]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] <== disconnect_volume: return (314ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:28:58 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Deleting instance files /opt/stack/data/nova/instances/6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243_del
Oct 20 09:28:58 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Deletion of /opt/stack/data/nova/instances/6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243_del complete
Oct 20 09:28:58 user nova-compute[74039]: INFO nova.compute.manager [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:28:58 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:28:59 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:28:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-03217f44-64d6-4597-b885-e44e2e598776 req-ab1f9ab5-4dcd-44c0-87b2-9516663f97b5 service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Received event network-vif-deleted-2ba79124-3bc4-41a7-9b13-523cf4bfdfb3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:28:59 user nova-compute[74039]: INFO nova.compute.manager [req-03217f44-64d6-4597-b885-e44e2e598776 req-ab1f9ab5-4dcd-44c0-87b2-9516663f97b5 service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Neutron deleted interface 2ba79124-3bc4-41a7-9b13-523cf4bfdfb3; detaching it from the instance and deleting it from the info cache
Oct 20 09:28:59 user nova-compute[74039]: DEBUG nova.network.neutron [req-03217f44-64d6-4597-b885-e44e2e598776 req-ab1f9ab5-4dcd-44c0-87b2-9516663f97b5 service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:28:59 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Took 0.76 seconds to deallocate network for instance.
Oct 20 09:28:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-03217f44-64d6-4597-b885-e44e2e598776 req-ab1f9ab5-4dcd-44c0-87b2-9516663f97b5 service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Detach interface failed, port_id=2ba79124-3bc4-41a7-9b13-523cf4bfdfb3, reason: Instance 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243 could not be found. {{(pid=74039) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 09:28:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:28:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-80e51b09-f479-4a56-9a35-806b48583468 req-90982acc-f887-4737-93dd-c39973ceac2b service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Received event network-vif-plugged-2ba79124-3bc4-41a7-9b13-523cf4bfdfb3 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:28:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-80e51b09-f479-4a56-9a35-806b48583468 req-90982acc-f887-4737-93dd-c39973ceac2b service nova] Acquiring lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:28:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-80e51b09-f479-4a56-9a35-806b48583468 req-90982acc-f887-4737-93dd-c39973ceac2b service nova] Lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:28:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-80e51b09-f479-4a56-9a35-806b48583468 req-90982acc-f887-4737-93dd-c39973ceac2b service nova] Lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:28:59 user nova-compute[74039]: DEBUG nova.compute.manager [req-80e51b09-f479-4a56-9a35-806b48583468 req-90982acc-f887-4737-93dd-c39973ceac2b service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] No waiting events found dispatching network-vif-plugged-2ba79124-3bc4-41a7-9b13-523cf4bfdfb3 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:28:59 user nova-compute[74039]: WARNING nova.compute.manager [req-80e51b09-f479-4a56-9a35-806b48583468 req-90982acc-f887-4737-93dd-c39973ceac2b service nova] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Received unexpected event network-vif-plugged-2ba79124-3bc4-41a7-9b13-523cf4bfdfb3 for instance with vm_state active and task_state deleting.
Oct 20 09:29:00 user nova-compute[74039]: INFO nova.compute.manager [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243] Took 0.90 seconds to detach 1 volumes for instance.
Oct 20 09:29:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "1cdbf79e-90b7-4746-8286-8f69277c71c5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:29:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:29:00 user nova-compute[74039]: INFO nova.compute.manager [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Detaching volume d8612b3a-4b13-4246-a573-1856ba293247
Oct 20 09:29:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:29:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:29:00 user nova-compute[74039]: INFO nova.virt.block_device [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Attempting to driver detach volume d8612b3a-4b13-4246-a573-1856ba293247 from mountpoint /dev/vdc
Oct 20 09:29:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Attempting to detach device vdc from instance 1cdbf79e-90b7-4746-8286-8f69277c71c5 from the persistent domain config. {{(pid=74039) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 09:29:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:29:00 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:29:00 user nova-compute[74039]:   <source dev="/dev/sdc"/>
Oct 20 09:29:00 user nova-compute[74039]:   <target dev="vdc" bus="virtio"/>
Oct 20 09:29:00 user nova-compute[74039]:   <serial>d8612b3a-4b13-4246-a573-1856ba293247</serial>
Oct 20 09:29:00 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 09:29:00 user nova-compute[74039]: </disk>
Oct 20 09:29:00 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:29:00 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Successfully detached device vdc from instance 1cdbf79e-90b7-4746-8286-8f69277c71c5 from the persistent domain config.
Oct 20 09:29:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1cdbf79e-90b7-4746-8286-8f69277c71c5 from the live domain config. {{(pid=74039) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 09:29:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.guest [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 09:29:00 user nova-compute[74039]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:29:00 user nova-compute[74039]:   <source dev="/dev/sdc"/>
Oct 20 09:29:00 user nova-compute[74039]:   <target dev="vdc" bus="virtio"/>
Oct 20 09:29:00 user nova-compute[74039]:   <serial>d8612b3a-4b13-4246-a573-1856ba293247</serial>
Oct 20 09:29:00 user nova-compute[74039]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 09:29:00 user nova-compute[74039]: </disk>
Oct 20 09:29:00 user nova-compute[74039]:  {{(pid=74039) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 09:29:00 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:29:00 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:29:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:29:00 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Deleted allocations for instance 6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243
Oct 20 09:29:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef8df98c-2dcf-4583-856e-859be4420d5b tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "6b6f14bf-ebbb-4ee2-b7e3-bc46b4ecf243" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.191s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:29:00 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1cdbf79e-90b7-4746-8286-8f69277c71c5 {{(pid=74039) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 09:29:03 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:08 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:13 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:18 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:20 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 1cdbf79e-90b7-4746-8286-8f69277c71c5 is timed out.
Oct 20 09:29:20 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Successfully detached device vdc from instance 1cdbf79e-90b7-4746-8286-8f69277c71c5 from the live domain config.
Oct 20 09:29:20 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:29:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eJREUkLQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:29:20 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:29:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:29:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:29:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:29:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:29:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c02aa0-67be-474f-9f24-1b72cf3aa3af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:29:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:29:20 user nova-compute[74039]: No targets found.
Oct 20 09:29:20 user nova-compute[74039]: iSNS:
Oct 20 09:29:20 user nova-compute[74039]: No targets found.
Oct 20 09:29:20 user nova-compute[74039]: STATIC:
Oct 20 09:29:20 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247
Oct 20 09:29:20 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:29:20 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:29:20 user nova-compute[74039]: FIRMWARE:
Oct 20 09:29:20 user nova-compute[74039]: No targets found.
Oct 20 09:29:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:29:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:29:20 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:29:20 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:29:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:29:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:29:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:29:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8d69f2-ddbe-4ce7-9b56-4ae696c07481]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:29:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:29:20 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:29:20 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[557b01a3-b4e0-4c7a-aae7-8581a98022d8]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:29:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 (non-flash)
Oct 20 09:29:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:29:20 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 (non-flash)
Oct 20 09:29:20 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae7c3548b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247'): ({'sdc'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Removing single pathed devices sdc {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78960f7-fe5c-40d9-ba98-dbbe3749636e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[befde6d1-7f5d-468c-8701-9590f31a052c]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Flushing IO for device /dev/sdc {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[64724146-8ddb-4336-a86d-db4283c33560]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae867e96-f556-48bc-b9ab-fd69bde02c11]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c50ea0-e40d-4e5c-ad3e-810371431f89]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fffa1ca-1cc9-4d02-8273-cae38923745d]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247, portal: 172.16.0.220,3260]
Oct 20 09:29:21 user nova-compute[74039]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247, portal: 172.16.0.220,3260] successful.
Oct 20 09:29:21 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8612b3a-4b13-4246-a573-1856ba293247 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6857b7de-89ae-420f-91b6-76ab3edac03c]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] <== disconnect_volume: return (313ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:29:21 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:29:22 user nova-compute[74039]: DEBUG nova.objects.instance [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'flavor' on Instance uuid 1cdbf79e-90b7-4746-8286-8f69277c71c5 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:29:22 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-505c78a1-588a-49be-8923-9ae841c79738 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.021s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:29:23 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:29:28 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:33 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:38 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:40 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:29:40 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:29:40 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:29:42 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:29:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:45 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:29:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:29:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:29:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:29:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:29:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:48 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:29:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:29:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Rebuilding the list of instances to heal {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 09:29:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:29:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:29:48 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:29:48 user nova-compute[74039]: DEBUG nova.objects.instance [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lazy-loading 'info_cache' on Instance uuid 1cdbf79e-90b7-4746-8286-8f69277c71c5 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Updating instance_info_cache with network_info: [{"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-1cdbf79e-90b7-4746-8286-8f69277c71c5" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:29:49 user nova-compute[74039]: INFO nova.compute.claims [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Claim successful on node user
Oct 20 09:29:49 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:29:49 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:29:49 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG nova.policy [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d68ed2131b34e57a5f10a01409fee62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367334c57f8f47b696a477460afba369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:29:49 user nova-compute[74039]: INFO nova.virt.block_device [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Booting with volume c0bec70a-6857-4681-abb8-a1a367550935 at /dev/vda
Oct 20 09:29:49 user nova-compute[74039]: DEBUG os_brick.utils [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8102e00-adc0-40d9-8406-d55b5350987f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba08d93-4b60-4162-b29d-186e1eb5ed4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b76f1a-7720-41e7-a402-71150770fceb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf7c186-eb0b-4564-9a41-c8b528813a89]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:29:49 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:29:50 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:29:50 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[06807e8b-cc68-4a01-aad3-c17620c13c75]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG os_brick.utils [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Updating existing volume attachment record: 621de4ed-144c-4e5a-ab1d-835a15a49507 {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Cleaning up deleted instances {{(pid=74039) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] There are 0 instances to clean {{(pid=74039) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "1cdbf79e-90b7-4746-8286-8f69277c71c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:29:50 user nova-compute[74039]: INFO nova.compute.manager [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Terminating instance
Oct 20 09:29:50 user nova-compute[74039]: DEBUG nova.compute.manager [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:50 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Successfully created port: 8d683a8e-79e9-4059-a878-0b6cb1bad52a {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-b0bd4aab-d6ff-4a54-b030-e6a558efe5ce req-7ab85344-c60a-4a3b-8e71-b3a54386d299 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received event network-vif-unplugged-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b0bd4aab-d6ff-4a54-b030-e6a558efe5ce req-7ab85344-c60a-4a3b-8e71-b3a54386d299 service nova] Acquiring lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b0bd4aab-d6ff-4a54-b030-e6a558efe5ce req-7ab85344-c60a-4a3b-8e71-b3a54386d299 service nova] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b0bd4aab-d6ff-4a54-b030-e6a558efe5ce req-7ab85344-c60a-4a3b-8e71-b3a54386d299 service nova] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-b0bd4aab-d6ff-4a54-b030-e6a558efe5ce req-7ab85344-c60a-4a3b-8e71-b3a54386d299 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] No waiting events found dispatching network-vif-unplugged-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-b0bd4aab-d6ff-4a54-b030-e6a558efe5ce req-7ab85344-c60a-4a3b-8e71-b3a54386d299 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received event network-vif-unplugged-401cb923-c809-4d13-8811-ac2e26bab571 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:29:51 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Instance destroyed successfully.
Oct 20 09:29:51 user nova-compute[74039]: DEBUG nova.objects.instance [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'resources' on Instance uuid 1cdbf79e-90b7-4746-8286-8f69277c71c5 {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T09:23:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-890462872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-890462872',id=48,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTYRbiu5Cmg+KEfhGZotfGpvgUcK4Dd565SZY8zSSnNi464CjCWyuaB6Fdk7pfl8N2qugu2uYO1MXw3EVvETszsJ2uFQVRR375OQj8nISw4lFiUuufNVNOw3M4sMthB5w==',key_name='tempest-keypair-931468445',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:27:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='235f30d0612f4bfba028314ba7155dcf',ramdisk_id='',reservation_id='r-4jx12o7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1190516011',owner_user_name='tempest-AttachVolumeShelveTestJSON-1190516011-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:27:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd7771575aef439ebf1d55d3c4dcc377',uuid=1cdbf79e-90b7-4746-8286-8f69277c71c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converting VIF {"id": "401cb923-c809-4d13-8811-ac2e26bab571", "address": "fa:16:3e:57:e1:1e", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401cb923-c8", "ovs_interfaceid": "401cb923-c809-4d13-8811-ac2e26bab571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=401cb923-c809-4d13-8811-ac2e26bab571,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401cb923-c8') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG os_vif [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=401cb923-c809-4d13-8811-ac2e26bab571,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401cb923-c8') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap401cb923-c8, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e08b638-43c9-412b-b731-7245a147f336) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:51 user nova-compute[74039]: INFO os_vif [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=401cb923-c809-4d13-8811-ac2e26bab571,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401cb923-c8')
Oct 20 09:29:51 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Deleting instance files /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5_del
Oct 20 09:29:51 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Deletion of /opt/stack/data/nova/instances/1cdbf79e-90b7-4746-8286-8f69277c71c5_del complete
Oct 20 09:29:51 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Successfully updated port: 8d683a8e-79e9-4059-a878-0b6cb1bad52a {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquired lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-4112675e-66ea-4816-bc9a-7a5352ea7600 req-91be7497-8122-441a-aa60-ee3e781f120f service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Received event network-changed-8d683a8e-79e9-4059-a878-0b6cb1bad52a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-4112675e-66ea-4816-bc9a-7a5352ea7600 req-91be7497-8122-441a-aa60-ee3e781f120f service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Refreshing instance network info cache due to event network-changed-8d683a8e-79e9-4059-a878-0b6cb1bad52a. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4112675e-66ea-4816-bc9a-7a5352ea7600 req-91be7497-8122-441a-aa60-ee3e781f120f service nova] Acquiring lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:29:51 user nova-compute[74039]: INFO nova.compute.manager [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 20 09:29:51 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:29:51 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG nova.network.neutron [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Updating instance_info_cache with network_info: [{"id": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "address": "fa:16:3e:08:88:64", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d683a8e-79", "ovs_interfaceid": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:29:52 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:29:52 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:29:52 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=25.356426239013672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Releasing lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Instance network_info: |[{"id": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "address": "fa:16:3e:08:88:64", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d683a8e-79", "ovs_interfaceid": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4112675e-66ea-4816-bc9a-7a5352ea7600 req-91be7497-8122-441a-aa60-ee3e781f120f service nova] Acquired lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG nova.network.neutron [req-4112675e-66ea-4816-bc9a-7a5352ea7600 req-91be7497-8122-441a-aa60-ee3e781f120f service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Refreshing network info cache for port 8d683a8e-79e9-4059-a878-0b6cb1bad52a {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 1cdbf79e-90b7-4746-8286-8f69277c71c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance ae2d9955-4612-4761-8e98-3fcd0ab007dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:29:52 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Took 0.95 seconds to deallocate network for instance.
Oct 20 09:29:52 user nova-compute[74039]: DEBUG nova.network.neutron [req-4112675e-66ea-4816-bc9a-7a5352ea7600 req-91be7497-8122-441a-aa60-ee3e781f120f service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Updated VIF entry in instance network info cache for port 8d683a8e-79e9-4059-a878-0b6cb1bad52a. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG nova.network.neutron [req-4112675e-66ea-4816-bc9a-7a5352ea7600 req-91be7497-8122-441a-aa60-ee3e781f120f service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Updating instance_info_cache with network_info: [{"id": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "address": "fa:16:3e:08:88:64", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d683a8e-79", "ovs_interfaceid": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4112675e-66ea-4816-bc9a-7a5352ea7600 req-91be7497-8122-441a-aa60-ee3e781f120f service nova] Releasing lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:29:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:29:52 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Deleted allocations for instance 1cdbf79e-90b7-4746-8286-8f69277c71c5
Oct 20 09:29:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3ac1ed6c-8081-4ddb-ae38-99d4dccbd356 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.143s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:29:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-b05f3a37-15ad-47be-a288-11f738eaf70c req-c2a69b1b-6fdc-4d01-9a4e-541b115fa3f9 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received event network-vif-plugged-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:29:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b05f3a37-15ad-47be-a288-11f738eaf70c req-c2a69b1b-6fdc-4d01-9a4e-541b115fa3f9 service nova] Acquiring lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:29:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b05f3a37-15ad-47be-a288-11f738eaf70c req-c2a69b1b-6fdc-4d01-9a4e-541b115fa3f9 service nova] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:29:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-b05f3a37-15ad-47be-a288-11f738eaf70c req-c2a69b1b-6fdc-4d01-9a4e-541b115fa3f9 service nova] Lock "1cdbf79e-90b7-4746-8286-8f69277c71c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:29:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-b05f3a37-15ad-47be-a288-11f738eaf70c req-c2a69b1b-6fdc-4d01-9a4e-541b115fa3f9 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] No waiting events found dispatching network-vif-plugged-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:29:53 user nova-compute[74039]: WARNING nova.compute.manager [req-b05f3a37-15ad-47be-a288-11f738eaf70c req-c2a69b1b-6fdc-4d01-9a4e-541b115fa3f9 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received unexpected event network-vif-plugged-401cb923-c809-4d13-8811-ac2e26bab571 for instance with vm_state deleted and task_state None.
Oct 20 09:29:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-b05f3a37-15ad-47be-a288-11f738eaf70c req-c2a69b1b-6fdc-4d01-9a4e-541b115fa3f9 service nova] [instance: 1cdbf79e-90b7-4746-8286-8f69277c71c5] Received event network-vif-deleted-401cb923-c809-4d13-8811-ac2e26bab571 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:29:53 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:29:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:29:56 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:29:56 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:30:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:30:06 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Creating image(s)
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Did not create local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Ensure instance console log exists: /opt/stack/data/nova/instances/ae2d9955-4612-4761-8e98-3fcd0ab007dd/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Start _get_guest_xml network_info=[{"id": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "address": "fa:16:3e:08:88:64", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d683a8e-79", "ovs_interfaceid": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '621de4ed-144c-4e5a-ab1d-835a15a49507', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOXrxEPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ae2d9955-4612-4761-8e98-3fcd0ab007dd', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0bec70a-6857-4681-abb8-a1a367550935', 'serial': 'c0bec70a-6857-4681-abb8-a1a367550935'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:30:06 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:30:06 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOXrxEPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:30:06 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:30:06 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:30:06 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5b3754-3e24-4b2e-97da-cbb8165887b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:30:06 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b62f053-44ee-4725-ab79-cdea1eeea312]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935] added
Oct 20 09:30:06 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ba2d98-16f6-46d0-9266-a431beb0905a]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d1a93b-44f7-4390-8a2d-05719302145c]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DOXrxEPl {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DOXrxEPl" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1fba2b-932e-417d-a2e2-2b19fccc1153]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DOXrxEPl'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bba8d5-2cf9-46f8-884b-2ea05fec7595]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf4e3aa-c1e5-4e5b-bfc6-e09fdf4942c2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 09:30:06 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 09:30:06 user nova-compute[74039]:  {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:30:06 user nova-compute[74039]: WARNING os_brick.initiator.connectors.iscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 09:30:06 user nova-compute[74039]: 
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[026627e0-857c-4636-8f51-a2b03966e7a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935, portal: 172.16.0.220,3260]
Oct 20 09:30:06 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935, portal: 172.16.0.220,3260] successful.
Oct 20 09:30:06 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cb3b9c-95d0-4d53-b525-7a95f5f71d49]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[64385fe9-df78-4079-ac6f-2abc2ea702e2]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)
Oct 20 09:30:06 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)
Oct 20 09:30:06 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.100s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4e8db3-9840-4373-a99e-82d81cead7d4]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:30:06 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOXrxEPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23463386563386335', 'path': '/dev/sdb'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463386563386335', 'path': '/dev/sdb'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-109260176',display_name='tempest-TestVolumeBootPattern-server-109260176',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-109260176',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJQZqpYomopBvyPT79YeuY+pWP4JiFbz530rSSrDfMUmZXfBwTwQSswPKsBo1t1+jn1XQ66AYvtoNfJ5xebswSw6yHcnRHX1AQXk3BmN8XWO1jgu5mgBIib3k6FLvE2iA==',key_name='tempest-TestVolumeBootPattern-1653654445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='367334c57f8f47b696a477460afba369',ramdisk_id='',reservation_id='r-57a3mudp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725287482',owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:29:50Z,user_data=None,user_id='8d68ed2131b34e57a5f10a01409fee62',uuid=ae2d9955-4612-4761-8e98-3fcd0ab007dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "address": "fa:16:3e:08:88:64", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d683a8e-79", "ovs_interfaceid": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converting VIF {"id": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "address": "fa:16:3e:08:88:64", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d683a8e-79", "ovs_interfaceid": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:88:64,bridge_name='br-int',has_traffic_filtering=True,id=8d683a8e-79e9-4059-a878-0b6cb1bad52a,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d683a8e-79') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG nova.objects.instance [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lazy-loading 'pci_devices' on Instance uuid ae2d9955-4612-4761-8e98-3fcd0ab007dd {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:30:07 user nova-compute[74039]:   <uuid>ae2d9955-4612-4761-8e98-3fcd0ab007dd</uuid>
Oct 20 09:30:07 user nova-compute[74039]:   <name>instance-00000032</name>
Oct 20 09:30:07 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:30:07 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:30:07 user nova-compute[74039]:   <metadata>
Oct 20 09:30:07 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:30:07 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:30:07 user nova-compute[74039]:       <nova:name>tempest-TestVolumeBootPattern-server-109260176</nova:name>
Oct 20 09:30:07 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:30:06</nova:creationTime>
Oct 20 09:30:07 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:30:07 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:30:07 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:30:07 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:30:07 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:30:07 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:30:07 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:30:07 user nova-compute[74039]:       <nova:owner>
Oct 20 09:30:07 user nova-compute[74039]:         <nova:user uuid="8d68ed2131b34e57a5f10a01409fee62">tempest-TestVolumeBootPattern-1725287482-project-member</nova:user>
Oct 20 09:30:07 user nova-compute[74039]:         <nova:project uuid="367334c57f8f47b696a477460afba369">tempest-TestVolumeBootPattern-1725287482</nova:project>
Oct 20 09:30:07 user nova-compute[74039]:       </nova:owner>
Oct 20 09:30:07 user nova-compute[74039]:       <nova:ports>
Oct 20 09:30:07 user nova-compute[74039]:         <nova:port uuid="8d683a8e-79e9-4059-a878-0b6cb1bad52a">
Oct 20 09:30:07 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 09:30:07 user nova-compute[74039]:         </nova:port>
Oct 20 09:30:07 user nova-compute[74039]:       </nova:ports>
Oct 20 09:30:07 user nova-compute[74039]:     </nova:instance>
Oct 20 09:30:07 user nova-compute[74039]:   </metadata>
Oct 20 09:30:07 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:30:07 user nova-compute[74039]:     <system>
Oct 20 09:30:07 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:30:07 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:30:07 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:30:07 user nova-compute[74039]:       <entry name="serial">ae2d9955-4612-4761-8e98-3fcd0ab007dd</entry>
Oct 20 09:30:07 user nova-compute[74039]:       <entry name="uuid">ae2d9955-4612-4761-8e98-3fcd0ab007dd</entry>
Oct 20 09:30:07 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:30:07 user nova-compute[74039]:     </system>
Oct 20 09:30:07 user nova-compute[74039]:   </sysinfo>
Oct 20 09:30:07 user nova-compute[74039]:   <os>
Oct 20 09:30:07 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:30:07 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:30:07 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:30:07 user nova-compute[74039]:   </os>
Oct 20 09:30:07 user nova-compute[74039]:   <features>
Oct 20 09:30:07 user nova-compute[74039]:     <acpi/>
Oct 20 09:30:07 user nova-compute[74039]:     <apic/>
Oct 20 09:30:07 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:30:07 user nova-compute[74039]:   </features>
Oct 20 09:30:07 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:30:07 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:30:07 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:30:07 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:30:07 user nova-compute[74039]:   </clock>
Oct 20 09:30:07 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:30:07 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:30:07 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:30:07 user nova-compute[74039]:   </cpu>
Oct 20 09:30:07 user nova-compute[74039]:   <devices>
Oct 20 09:30:07 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 09:30:07 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:30:07 user nova-compute[74039]:       <source dev="/dev/sdb"/>
Oct 20 09:30:07 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:30:07 user nova-compute[74039]:       <serial>c0bec70a-6857-4681-abb8-a1a367550935</serial>
Oct 20 09:30:07 user nova-compute[74039]:     </disk>
Oct 20 09:30:07 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:30:07 user nova-compute[74039]:       <mac address="fa:16:3e:08:88:64"/>
Oct 20 09:30:07 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:30:07 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:30:07 user nova-compute[74039]:       <target dev="tap8d683a8e-79"/>
Oct 20 09:30:07 user nova-compute[74039]:     </interface>
Oct 20 09:30:07 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:30:07 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/ae2d9955-4612-4761-8e98-3fcd0ab007dd/console.log" append="off"/>
Oct 20 09:30:07 user nova-compute[74039]:     </serial>
Oct 20 09:30:07 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:30:07 user nova-compute[74039]:     <video>
Oct 20 09:30:07 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:30:07 user nova-compute[74039]:     </video>
Oct 20 09:30:07 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:30:07 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:30:07 user nova-compute[74039]:     </rng>
Oct 20 09:30:07 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:30:07 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:30:07 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:30:07 user nova-compute[74039]:     </memballoon>
Oct 20 09:30:07 user nova-compute[74039]:   </devices>
Oct 20 09:30:07 user nova-compute[74039]: </domain>
Oct 20 09:30:07 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-109260176',display_name='tempest-TestVolumeBootPattern-server-109260176',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-109260176',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJQZqpYomopBvyPT79YeuY+pWP4JiFbz530rSSrDfMUmZXfBwTwQSswPKsBo1t1+jn1XQ66AYvtoNfJ5xebswSw6yHcnRHX1AQXk3BmN8XWO1jgu5mgBIib3k6FLvE2iA==',key_name='tempest-TestVolumeBootPattern-1653654445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='367334c57f8f47b696a477460afba369',ramdisk_id='',reservation_id='r-57a3mudp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725287482',owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:29:50Z,user_data=None,user_id='8d68ed2131b34e57a5f10a01409fee62',uuid=ae2d9955-4612-4761-8e98-3fcd0ab007dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "address": "fa:16:3e:08:88:64", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d683a8e-79", "ovs_interfaceid": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converting VIF {"id": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "address": "fa:16:3e:08:88:64", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d683a8e-79", "ovs_interfaceid": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:88:64,bridge_name='br-int',has_traffic_filtering=True,id=8d683a8e-79e9-4059-a878-0b6cb1bad52a,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d683a8e-79') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG os_vif [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:88:64,bridge_name='br-int',has_traffic_filtering=True,id=8d683a8e-79e9-4059-a878-0b6cb1bad52a,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d683a8e-79') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb396ed0-52aa-5563-9cb4-23537774f7cf', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d683a8e-79, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d683a8e-79, col_values=(('qos', UUID('866d70ac-25c4-4bb2-a76f-ada194a89a4b')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d683a8e-79, col_values=(('external_ids', {'iface-id': '8d683a8e-79e9-4059-a878-0b6cb1bad52a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:88:64', 'vm-uuid': 'ae2d9955-4612-4761-8e98-3fcd0ab007dd'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:07 user nova-compute[74039]: INFO os_vif [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:88:64,bridge_name='br-int',has_traffic_filtering=True,id=8d683a8e-79e9-4059-a878-0b6cb1bad52a,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d683a8e-79')
Oct 20 09:30:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:30:07 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] No VIF found with MAC fa:16:3e:08:88:64, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:30:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-e4e168c9-6863-4c6e-a66d-3685d4ad012b req-e62b0980-acd4-4319-b823-2f144080d2e5 service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Received event network-vif-plugged-8d683a8e-79e9-4059-a878-0b6cb1bad52a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:30:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e4e168c9-6863-4c6e-a66d-3685d4ad012b req-e62b0980-acd4-4319-b823-2f144080d2e5 service nova] Acquiring lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:30:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e4e168c9-6863-4c6e-a66d-3685d4ad012b req-e62b0980-acd4-4319-b823-2f144080d2e5 service nova] Lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:30:09 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e4e168c9-6863-4c6e-a66d-3685d4ad012b req-e62b0980-acd4-4319-b823-2f144080d2e5 service nova] Lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:30:09 user nova-compute[74039]: DEBUG nova.compute.manager [req-e4e168c9-6863-4c6e-a66d-3685d4ad012b req-e62b0980-acd4-4319-b823-2f144080d2e5 service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] No waiting events found dispatching network-vif-plugged-8d683a8e-79e9-4059-a878-0b6cb1bad52a {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:30:09 user nova-compute[74039]: WARNING nova.compute.manager [req-e4e168c9-6863-4c6e-a66d-3685d4ad012b req-e62b0980-acd4-4319-b823-2f144080d2e5 service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Received unexpected event network-vif-plugged-8d683a8e-79e9-4059-a878-0b6cb1bad52a for instance with vm_state building and task_state spawning.
Oct 20 09:30:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:11 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:30:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:30:11 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Instance spawned successfully.
Oct 20 09:30:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:30:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:30:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:30:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:30:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:30:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:30:11 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:30:11 user nova-compute[74039]: INFO nova.compute.manager [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Took 5.08 seconds to spawn the instance on the hypervisor.
Oct 20 09:30:11 user nova-compute[74039]: DEBUG nova.compute.manager [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:30:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-19a56196-5ed3-40ec-aef1-704cf892fcad req-5794b9db-9586-4f28-9a67-90f39b985a95 service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Received event network-vif-plugged-8d683a8e-79e9-4059-a878-0b6cb1bad52a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:30:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-19a56196-5ed3-40ec-aef1-704cf892fcad req-5794b9db-9586-4f28-9a67-90f39b985a95 service nova] Acquiring lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:30:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-19a56196-5ed3-40ec-aef1-704cf892fcad req-5794b9db-9586-4f28-9a67-90f39b985a95 service nova] Lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:30:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-19a56196-5ed3-40ec-aef1-704cf892fcad req-5794b9db-9586-4f28-9a67-90f39b985a95 service nova] Lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:30:11 user nova-compute[74039]: DEBUG nova.compute.manager [req-19a56196-5ed3-40ec-aef1-704cf892fcad req-5794b9db-9586-4f28-9a67-90f39b985a95 service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] No waiting events found dispatching network-vif-plugged-8d683a8e-79e9-4059-a878-0b6cb1bad52a {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:30:11 user nova-compute[74039]: WARNING nova.compute.manager [req-19a56196-5ed3-40ec-aef1-704cf892fcad req-5794b9db-9586-4f28-9a67-90f39b985a95 service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Received unexpected event network-vif-plugged-8d683a8e-79e9-4059-a878-0b6cb1bad52a for instance with vm_state building and task_state spawning.
Oct 20 09:30:11 user nova-compute[74039]: INFO nova.compute.manager [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Took 22.11 seconds to build instance.
Oct 20 09:30:11 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-ef2c4d34-8cb6-4b30-ac9e-51f648dead19 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.213s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:30:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:26 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:30:26 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74039) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 09:30:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:41 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:30:42 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:30:42 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:30:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:44 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG nova.compute.manager [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:30:45 user nova-compute[74039]: INFO nova.compute.claims [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Claim successful on node user
Oct 20 09:30:45 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.261s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG nova.compute.manager [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG nova.compute.manager [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG nova.network.neutron [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:30:45 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:30:45 user nova-compute[74039]: DEBUG nova.compute.manager [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG nova.policy [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd7771575aef439ebf1d55d3c4dcc377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235f30d0612f4bfba028314ba7155dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG nova.compute.manager [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:30:45 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Creating image(s)
Oct 20 09:30:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "/opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "/opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.182s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "ad6ae0cca52d348626240f5513d65f8591b19258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:30:45 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.169s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258,backing_fmt=raw /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk 1073741824" returned: 0 in 0.054s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "ad6ae0cca52d348626240f5513d65f8591b19258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG nova.network.neutron [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Successfully created port: 8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk. size=1073741824 {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG nova.virt.disk.api [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Cannot resize image /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk to a smaller size. {{(pid=74039) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Ensure instance console log exists: /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG nova.network.neutron [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Successfully updated port: 8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquired lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG nova.network.neutron [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-03b900c0-e8fc-4576-b0ea-a1628d05fabc req-b6a6ecc8-6288-4901-b0e5-28df0ab526cb service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received event network-changed-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG nova.compute.manager [req-03b900c0-e8fc-4576-b0ea-a1628d05fabc req-b6a6ecc8-6288-4901-b0e5-28df0ab526cb service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Refreshing instance network info cache due to event network-changed-8274829a-aad4-4529-817c-3c7f77ab0c87. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-03b900c0-e8fc-4576-b0ea-a1628d05fabc req-b6a6ecc8-6288-4901-b0e5-28df0ab526cb service nova] Acquiring lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:30:46 user nova-compute[74039]: DEBUG nova.network.neutron [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.network.neutron [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Updating instance_info_cache with network_info: [{"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Releasing lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.compute.manager [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Instance network_info: |[{"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-03b900c0-e8fc-4576-b0ea-a1628d05fabc req-b6a6ecc8-6288-4901-b0e5-28df0ab526cb service nova] Acquired lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.network.neutron [req-03b900c0-e8fc-4576-b0ea-a1628d05fabc req-b6a6ecc8-6288-4901-b0e5-28df0ab526cb service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Refreshing network info cache for port 8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Start _get_guest_xml network_info=[{"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:30:47 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:30:47 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T08:44:34Z,direct_url=<?>,disk_format='qcow2',id=f58b9629-4790-4951-9492-6447e1485638,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2ee7f98662b44e8cb41923dce3e240aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T08:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1879223711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1879223711',id=51,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIC6P4bigUg+cbKshQKP1+j2wpIMIpTI+VHhB8KKEetlHyMIQd+jzYXwLCG0+Hu5vAkheTNunlTBHaRXH1aKNpCzLLY86NI0bJzkVCsqrStByvLxANaY472MINupLINA6g==',key_name='tempest-keypair-1751542138',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='235f30d0612f4bfba028314ba7155dcf',ramdisk_id='',reservation_id='r-5td7wqrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1190516011',owner_user_name='tempest-AttachVolumeShelveTestJSON-1190516011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd7771575aef439ebf1d55d3c4dcc377',uuid=1fdd0502-f3cf-4353-be1c-72d8abe57f0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converting VIF {"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:3e:c7,bridge_name='br-int',has_traffic_filtering=True,id=8274829a-aad4-4529-817c-3c7f77ab0c87,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8274829a-aa') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.objects.instance [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fdd0502-f3cf-4353-be1c-72d8abe57f0a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:30:47 user nova-compute[74039]:   <uuid>1fdd0502-f3cf-4353-be1c-72d8abe57f0a</uuid>
Oct 20 09:30:47 user nova-compute[74039]:   <name>instance-00000033</name>
Oct 20 09:30:47 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:30:47 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:30:47 user nova-compute[74039]:   <metadata>
Oct 20 09:30:47 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:30:47 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:30:47 user nova-compute[74039]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1879223711</nova:name>
Oct 20 09:30:47 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:30:47</nova:creationTime>
Oct 20 09:30:47 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:30:47 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:30:47 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:30:47 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:30:47 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:30:47 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:30:47 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:30:47 user nova-compute[74039]:       <nova:owner>
Oct 20 09:30:47 user nova-compute[74039]:         <nova:user uuid="bd7771575aef439ebf1d55d3c4dcc377">tempest-AttachVolumeShelveTestJSON-1190516011-project-member</nova:user>
Oct 20 09:30:47 user nova-compute[74039]:         <nova:project uuid="235f30d0612f4bfba028314ba7155dcf">tempest-AttachVolumeShelveTestJSON-1190516011</nova:project>
Oct 20 09:30:47 user nova-compute[74039]:       </nova:owner>
Oct 20 09:30:47 user nova-compute[74039]:       <nova:root type="image" uuid="f58b9629-4790-4951-9492-6447e1485638"/>
Oct 20 09:30:47 user nova-compute[74039]:       <nova:ports>
Oct 20 09:30:47 user nova-compute[74039]:         <nova:port uuid="8274829a-aad4-4529-817c-3c7f77ab0c87">
Oct 20 09:30:47 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 09:30:47 user nova-compute[74039]:         </nova:port>
Oct 20 09:30:47 user nova-compute[74039]:       </nova:ports>
Oct 20 09:30:47 user nova-compute[74039]:     </nova:instance>
Oct 20 09:30:47 user nova-compute[74039]:   </metadata>
Oct 20 09:30:47 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:30:47 user nova-compute[74039]:     <system>
Oct 20 09:30:47 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:30:47 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:30:47 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:30:47 user nova-compute[74039]:       <entry name="serial">1fdd0502-f3cf-4353-be1c-72d8abe57f0a</entry>
Oct 20 09:30:47 user nova-compute[74039]:       <entry name="uuid">1fdd0502-f3cf-4353-be1c-72d8abe57f0a</entry>
Oct 20 09:30:47 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:30:47 user nova-compute[74039]:     </system>
Oct 20 09:30:47 user nova-compute[74039]:   </sysinfo>
Oct 20 09:30:47 user nova-compute[74039]:   <os>
Oct 20 09:30:47 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:30:47 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:30:47 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:30:47 user nova-compute[74039]:   </os>
Oct 20 09:30:47 user nova-compute[74039]:   <features>
Oct 20 09:30:47 user nova-compute[74039]:     <acpi/>
Oct 20 09:30:47 user nova-compute[74039]:     <apic/>
Oct 20 09:30:47 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:30:47 user nova-compute[74039]:   </features>
Oct 20 09:30:47 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:30:47 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:30:47 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:30:47 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:30:47 user nova-compute[74039]:   </clock>
Oct 20 09:30:47 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:30:47 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:30:47 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:30:47 user nova-compute[74039]:   </cpu>
Oct 20 09:30:47 user nova-compute[74039]:   <devices>
Oct 20 09:30:47 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:30:47 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:30:47 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk"/>
Oct 20 09:30:47 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:30:47 user nova-compute[74039]:     </disk>
Oct 20 09:30:47 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:30:47 user nova-compute[74039]:       <mac address="fa:16:3e:44:3e:c7"/>
Oct 20 09:30:47 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:30:47 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:30:47 user nova-compute[74039]:       <target dev="tap8274829a-aa"/>
Oct 20 09:30:47 user nova-compute[74039]:     </interface>
Oct 20 09:30:47 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:30:47 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/console.log" append="off"/>
Oct 20 09:30:47 user nova-compute[74039]:     </serial>
Oct 20 09:30:47 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:30:47 user nova-compute[74039]:     <video>
Oct 20 09:30:47 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:30:47 user nova-compute[74039]:     </video>
Oct 20 09:30:47 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:30:47 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:30:47 user nova-compute[74039]:     </rng>
Oct 20 09:30:47 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:30:47 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:30:47 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:30:47 user nova-compute[74039]:     </memballoon>
Oct 20 09:30:47 user nova-compute[74039]:   </devices>
Oct 20 09:30:47 user nova-compute[74039]: </domain>
Oct 20 09:30:47 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1879223711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1879223711',id=51,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIC6P4bigUg+cbKshQKP1+j2wpIMIpTI+VHhB8KKEetlHyMIQd+jzYXwLCG0+Hu5vAkheTNunlTBHaRXH1aKNpCzLLY86NI0bJzkVCsqrStByvLxANaY472MINupLINA6g==',key_name='tempest-keypair-1751542138',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='235f30d0612f4bfba028314ba7155dcf',ramdisk_id='',reservation_id='r-5td7wqrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1190516011',owner_user_name='tempest-AttachVolumeShelveTestJSON-1190516011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd7771575aef439ebf1d55d3c4dcc377',uuid=1fdd0502-f3cf-4353-be1c-72d8abe57f0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converting VIF {"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:3e:c7,bridge_name='br-int',has_traffic_filtering=True,id=8274829a-aad4-4529-817c-3c7f77ab0c87,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8274829a-aa') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG os_vif [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:3e:c7,bridge_name='br-int',has_traffic_filtering=True,id=8274829a-aad4-4529-817c-3c7f77ab0c87,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8274829a-aa') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4cf32e0f-e114-5d95-ae92-d8c4da0dafee', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8274829a-aa, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8274829a-aa, col_values=(('qos', UUID('222637fd-a778-4366-94c6-f7ab9c7624b1')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8274829a-aa, col_values=(('external_ids', {'iface-id': '8274829a-aad4-4529-817c-3c7f77ab0c87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:3e:c7', 'vm-uuid': '1fdd0502-f3cf-4353-be1c-72d8abe57f0a'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:47 user nova-compute[74039]: INFO os_vif [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:3e:c7,bridge_name='br-int',has_traffic_filtering=True,id=8274829a-aad4-4529-817c-3c7f77ab0c87,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8274829a-aa')
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] No VIF found with MAC fa:16:3e:44:3e:c7, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.network.neutron [req-03b900c0-e8fc-4576-b0ea-a1628d05fabc req-b6a6ecc8-6288-4901-b0e5-28df0ab526cb service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Updated VIF entry in instance network info cache for port 8274829a-aad4-4529-817c-3c7f77ab0c87. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG nova.network.neutron [req-03b900c0-e8fc-4576-b0ea-a1628d05fabc req-b6a6ecc8-6288-4901-b0e5-28df0ab526cb service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Updating instance_info_cache with network_info: [{"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:30:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-03b900c0-e8fc-4576-b0ea-a1628d05fabc req-b6a6ecc8-6288-4901-b0e5-28df0ab526cb service nova] Releasing lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:30:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:49 user nova-compute[74039]: DEBUG nova.compute.manager [req-f8553c8d-45e4-4cb4-b21f-226c4ca9a210 req-e84198cd-bda4-4211-9b82-c87732d96ac6 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received event network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:30:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f8553c8d-45e4-4cb4-b21f-226c4ca9a210 req-e84198cd-bda4-4211-9b82-c87732d96ac6 service nova] Acquiring lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:30:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f8553c8d-45e4-4cb4-b21f-226c4ca9a210 req-e84198cd-bda4-4211-9b82-c87732d96ac6 service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:30:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f8553c8d-45e4-4cb4-b21f-226c4ca9a210 req-e84198cd-bda4-4211-9b82-c87732d96ac6 service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:30:49 user nova-compute[74039]: DEBUG nova.compute.manager [req-f8553c8d-45e4-4cb4-b21f-226c4ca9a210 req-e84198cd-bda4-4211-9b82-c87732d96ac6 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] No waiting events found dispatching network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:30:49 user nova-compute[74039]: WARNING nova.compute.manager [req-f8553c8d-45e4-4cb4-b21f-226c4ca9a210 req-e84198cd-bda4-4211-9b82-c87732d96ac6 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received unexpected event network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 for instance with vm_state building and task_state spawning.
Oct 20 09:30:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:49 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:30:49 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:30:49 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Rebuilding the list of instances to heal {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 09:30:49 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Skipping network cache update for instance because it is Building. {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 20 09:30:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:30:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:30:49 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:30:49 user nova-compute[74039]: DEBUG nova.objects.instance [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lazy-loading 'info_cache' on Instance uuid ae2d9955-4612-4761-8e98-3fcd0ab007dd {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:30:50 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Updating instance_info_cache with network_info: [{"id": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "address": "fa:16:3e:08:88:64", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d683a8e-79", "ovs_interfaceid": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:30:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:30:50 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:30:50 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:30:51 user nova-compute[74039]: DEBUG nova.compute.manager [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:30:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:30:51 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Instance spawned successfully.
Oct 20 09:30:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:30:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:30:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:30:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:30:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:30:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:30:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:30:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-ec3524c5-bb16-4a3d-94ec-64ac57558c7d req-33a19349-50f1-4b59-acb2-703b274f588f service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received event network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:30:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ec3524c5-bb16-4a3d-94ec-64ac57558c7d req-33a19349-50f1-4b59-acb2-703b274f588f service nova] Acquiring lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:30:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ec3524c5-bb16-4a3d-94ec-64ac57558c7d req-33a19349-50f1-4b59-acb2-703b274f588f service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:30:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-ec3524c5-bb16-4a3d-94ec-64ac57558c7d req-33a19349-50f1-4b59-acb2-703b274f588f service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:30:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-ec3524c5-bb16-4a3d-94ec-64ac57558c7d req-33a19349-50f1-4b59-acb2-703b274f588f service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] No waiting events found dispatching network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:30:51 user nova-compute[74039]: WARNING nova.compute.manager [req-ec3524c5-bb16-4a3d-94ec-64ac57558c7d req-33a19349-50f1-4b59-acb2-703b274f588f service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received unexpected event network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 for instance with vm_state building and task_state spawning.
Oct 20 09:30:51 user nova-compute[74039]: INFO nova.compute.manager [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Took 5.41 seconds to spawn the instance on the hypervisor.
Oct 20 09:30:51 user nova-compute[74039]: DEBUG nova.compute.manager [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:30:51 user nova-compute[74039]: INFO nova.compute.manager [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Took 6.05 seconds to build instance.
Oct 20 09:30:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-cc78d671-5f2d-48ea-aee2-abd29e0c1048 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.162s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:30:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:52 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:30:53 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:30:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:30:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:30:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:30:53 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:30:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:30:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:30:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:30:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:30:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:30:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:54 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:30:54 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:30:54 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8743MB free_disk=25.345291137695312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:30:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:30:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:30:54 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance ae2d9955-4612-4761-8e98-3fcd0ab007dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:30:54 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 1fdd0502-f3cf-4353-be1c-72d8abe57f0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:30:54 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:30:54 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:30:54 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:30:54 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:30:54 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:30:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:30:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:30:59 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:31:00 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:31:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:31:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:31:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:31:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:31:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:31:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:31:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:31:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:31:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:31:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:31:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:31:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:31:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:31:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:40 user nova-compute[74039]: DEBUG nova.compute.manager [req-befcf2d7-0ebe-4a7c-b000-da34706c565d req-2ab34f62-d3c5-495f-a3b7-1f6835685d4b service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Received event network-changed-8d683a8e-79e9-4059-a878-0b6cb1bad52a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:31:40 user nova-compute[74039]: DEBUG nova.compute.manager [req-befcf2d7-0ebe-4a7c-b000-da34706c565d req-2ab34f62-d3c5-495f-a3b7-1f6835685d4b service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Refreshing instance network info cache due to event network-changed-8d683a8e-79e9-4059-a878-0b6cb1bad52a. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:31:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-befcf2d7-0ebe-4a7c-b000-da34706c565d req-2ab34f62-d3c5-495f-a3b7-1f6835685d4b service nova] Acquiring lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:31:40 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-befcf2d7-0ebe-4a7c-b000-da34706c565d req-2ab34f62-d3c5-495f-a3b7-1f6835685d4b service nova] Acquired lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:31:40 user nova-compute[74039]: DEBUG nova.network.neutron [req-befcf2d7-0ebe-4a7c-b000-da34706c565d req-2ab34f62-d3c5-495f-a3b7-1f6835685d4b service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Refreshing network info cache for port 8d683a8e-79e9-4059-a878-0b6cb1bad52a {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:31:41 user nova-compute[74039]: DEBUG nova.network.neutron [req-befcf2d7-0ebe-4a7c-b000-da34706c565d req-2ab34f62-d3c5-495f-a3b7-1f6835685d4b service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Updated VIF entry in instance network info cache for port 8d683a8e-79e9-4059-a878-0b6cb1bad52a. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:31:41 user nova-compute[74039]: DEBUG nova.network.neutron [req-befcf2d7-0ebe-4a7c-b000-da34706c565d req-2ab34f62-d3c5-495f-a3b7-1f6835685d4b service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Updating instance_info_cache with network_info: [{"id": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "address": "fa:16:3e:08:88:64", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d683a8e-79", "ovs_interfaceid": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:31:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-befcf2d7-0ebe-4a7c-b000-da34706c565d req-2ab34f62-d3c5-495f-a3b7-1f6835685d4b service nova] Releasing lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:31:41 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:31:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:31:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:31:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:31:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:31:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:44 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:31:44 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:31:46 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:31:46 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:31:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:50 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:31:50 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:31:50 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Rebuilding the list of instances to heal {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 09:31:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:31:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:31:50 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:31:50 user nova-compute[74039]: DEBUG nova.objects.instance [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lazy-loading 'info_cache' on Instance uuid ae2d9955-4612-4761-8e98-3fcd0ab007dd {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:31:51 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Updating instance_info_cache with network_info: [{"id": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "address": "fa:16:3e:08:88:64", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d683a8e-79", "ovs_interfaceid": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:31:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:31:51 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:31:51 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:31:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:53 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:31:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:31:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:31:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:31:53 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:31:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:31:53 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:31:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:31:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:31:54 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:31:54 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:31:54 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:31:54 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8771MB free_disk=25.315921783447266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:31:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:31:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:31:54 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance ae2d9955-4612-4761-8e98-3fcd0ab007dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:31:54 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 1fdd0502-f3cf-4353-be1c-72d8abe57f0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:31:54 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:31:54 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:31:54 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing inventories for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 09:31:54 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Updating ProviderTree inventory for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 09:31:54 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Updating inventory in ProviderTree for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 09:31:54 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing aggregate associations for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb, aggregates: None {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 09:31:54 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing trait associations for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 09:31:54 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:31:54 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:31:54 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:31:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:31:55 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:31:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:31:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "c8339229-e4de-4f89-9079-b5386d8398ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:31:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "c8339229-e4de-4f89-9079-b5386d8398ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:31:57 user nova-compute[74039]: DEBUG nova.compute.manager [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Starting instance... {{(pid=74039) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 09:31:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:31:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:31:57 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:31:57 user nova-compute[74039]: INFO nova.compute.claims [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Claim successful on node user
Oct 20 09:31:58 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG nova.compute.manager [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Start building networks asynchronously for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG nova.compute.manager [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Allocating IP information in the background. {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG nova.network.neutron [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] allocate_for_instance() {{(pid=74039) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 09:31:58 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 09:31:58 user nova-compute[74039]: DEBUG nova.compute.manager [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Start building block device mappings for instance. {{(pid=74039) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG nova.policy [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d68ed2131b34e57a5f10a01409fee62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367334c57f8f47b696a477460afba369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74039) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 09:31:58 user nova-compute[74039]: INFO nova.virt.block_device [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Booting with volume 62acc644-31d4-4656-b444-dcb34d4cea20 at /dev/vda
Oct 20 09:31:58 user nova-compute[74039]: DEBUG os_brick.utils [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5917e88d-879d-4b55-94d7-f6b6ac24c63e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4b9ceaabe2e\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[988fa757-1f4a-48c9-9b8f-d2bdaef3e206]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b775dd90-a61b-400f-8f04-bad6fd5dda7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc61906-7f1d-4f3b-9e62-78941946e9e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Running cmd (subprocess): nvme version {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] 'nvme version' failed. Not Retrying. {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.nvmeof [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] nvme not present on system {{(pid=74039) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 09:31:58 user nova-compute[74039]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 09:31:58 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f1cf35-8e88-4176-8542-351ae7189cd6]: (4, '') {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74039) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.lightos [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] LIGHTOS: no hostnqn found. {{(pid=74039) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG os_brick.utils [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4b9ceaabe2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:31:58 user nova-compute[74039]: DEBUG nova.virt.block_device [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Updating existing volume attachment record: 8048d3dd-015d-438d-ae2d-1320b4deea9f {{(pid=74039) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 09:31:59 user nova-compute[74039]: DEBUG nova.network.neutron [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Successfully created port: 2661cb0d-6ebd-48ac-ae42-0640d779bf6a {{(pid=74039) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 09:31:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:31:59 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:32:00 user nova-compute[74039]: DEBUG nova.network.neutron [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Successfully updated port: 2661cb0d-6ebd-48ac-ae42-0640d779bf6a {{(pid=74039) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 09:32:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "refresh_cache-c8339229-e4de-4f89-9079-b5386d8398ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:32:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquired lock "refresh_cache-c8339229-e4de-4f89-9079-b5386d8398ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:32:00 user nova-compute[74039]: DEBUG nova.network.neutron [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:32:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-35604664-171b-4650-9f09-96c1d1c80745 req-24306a55-593a-4862-a6d2-9669046ac3da service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Received event network-changed-2661cb0d-6ebd-48ac-ae42-0640d779bf6a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:32:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-35604664-171b-4650-9f09-96c1d1c80745 req-24306a55-593a-4862-a6d2-9669046ac3da service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Refreshing instance network info cache due to event network-changed-2661cb0d-6ebd-48ac-ae42-0640d779bf6a. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:32:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-35604664-171b-4650-9f09-96c1d1c80745 req-24306a55-593a-4862-a6d2-9669046ac3da service nova] Acquiring lock "refresh_cache-c8339229-e4de-4f89-9079-b5386d8398ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:32:00 user nova-compute[74039]: DEBUG nova.network.neutron [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Instance cache missing network info. {{(pid=74039) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 09:32:00 user nova-compute[74039]: DEBUG nova.network.neutron [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Updating instance_info_cache with network_info: [{"id": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "address": "fa:16:3e:9f:d9:7b", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2661cb0d-6e", "ovs_interfaceid": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:32:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Releasing lock "refresh_cache-c8339229-e4de-4f89-9079-b5386d8398ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:32:00 user nova-compute[74039]: DEBUG nova.compute.manager [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Instance network_info: |[{"id": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "address": "fa:16:3e:9f:d9:7b", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2661cb0d-6e", "ovs_interfaceid": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74039) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 09:32:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-35604664-171b-4650-9f09-96c1d1c80745 req-24306a55-593a-4862-a6d2-9669046ac3da service nova] Acquired lock "refresh_cache-c8339229-e4de-4f89-9079-b5386d8398ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:32:00 user nova-compute[74039]: DEBUG nova.network.neutron [req-35604664-171b-4650-9f09-96c1d1c80745 req-24306a55-593a-4862-a6d2-9669046ac3da service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Refreshing network info cache for port 2661cb0d-6ebd-48ac-ae42-0640d779bf6a {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:32:00 user nova-compute[74039]: DEBUG nova.network.neutron [req-35604664-171b-4650-9f09-96c1d1c80745 req-24306a55-593a-4862-a6d2-9669046ac3da service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Updated VIF entry in instance network info cache for port 2661cb0d-6ebd-48ac-ae42-0640d779bf6a. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:32:00 user nova-compute[74039]: DEBUG nova.network.neutron [req-35604664-171b-4650-9f09-96c1d1c80745 req-24306a55-593a-4862-a6d2-9669046ac3da service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Updating instance_info_cache with network_info: [{"id": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "address": "fa:16:3e:9f:d9:7b", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2661cb0d-6e", "ovs_interfaceid": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:32:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-35604664-171b-4650-9f09-96c1d1c80745 req-24306a55-593a-4862-a6d2-9669046ac3da service nova] Releasing lock "refresh_cache-c8339229-e4de-4f89-9079-b5386d8398ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:32:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:32:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:32:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:32:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:32:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:32:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.compute.manager [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Start spawning the instance on the hypervisor. {{(pid=74039) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:32:14 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Creating image(s)
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Did not create local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Ensure instance console log exists: /opt/stack/data/nova/instances/c8339229-e4de-4f89-9079-b5386d8398ed/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Start _get_guest_xml network_info=[{"id": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "address": "fa:16:3e:9f:d9:7b", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2661cb0d-6e", "ovs_interfaceid": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8048d3dd-015d-438d-ae2d-1320b4deea9f', 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YskNjFLU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c8339229-e4de-4f89-9079-b5386d8398ed', 'attached_at': '', 'detached_at': '', 'volume_id': '62acc644-31d4-4656-b444-dcb34d4cea20', 'serial': '62acc644-31d4-4656-b444-dcb34d4cea20'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:32:14 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:32:14 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Calling os-brick to attach iSCSI Volume {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YskNjFLU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:32:14 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:32:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:32:14 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:32:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:32:14 user nova-compute[74039]: INFO os_brick.initiator.connectors.iscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74599b9-fd15-4d4e-9663-28dac40dfcf1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 09:32:14 user nova-compute[74039]:  {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 --interface default --op new {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8f841d-9867-45f4-8dd4-54647d281ded]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20] added\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20] added
Oct 20 09:32:14 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[08982b51-329f-40f1-8728-ea46ced10b73]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77dbda9-c6ff-49c5-a5c8-effaa40867fd]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YskNjFLU {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YskNjFLU" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a88a57-f6de-485c-8663-0059a58b9881]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YskNjFLU'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[490f2ef8-4f9b-4fc0-8079-641f3d69c9e7]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e956cda2-be3b-4682-a677-a9a4c7072bf7]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)
Oct 20 09:32:14 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)
Oct 20 09:32:14 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:32:14 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 --login {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:32:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:32:15 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9670fe45-4d60-40e6-b8ca-9190adc85bc4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:32:15 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20, portal: 172.16.0.220,3260]
Oct 20 09:32:15 user nova-compute[74039]: Login to [iface: default, target: iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20, portal: 172.16.0.220,3260] successful.
Oct 20 09:32:15 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:32:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:32:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:32:15 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf03b7c-85b1-40ea-bae2-b0e9833ec92d]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:32:15 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:32:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:32:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:32:15 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5573b16a-7759-48e1-8f7c-a6d90045800d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:32:15 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)
Oct 20 09:32:15 user nova-compute[74039]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 (non-flash)
Oct 20 09:32:15 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:32:15 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)
Oct 20 09:32:15 user nova-compute[74039]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 (non-flash)
Oct 20 09:32:15 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:32:15 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:32:15 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Connected to 172.16.0.220:3260 {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 09:32:15 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=74039) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 09:32:15 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74039) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 09:32:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:32:15 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:32:15 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[88952727-fae3-4dcb-998b-ee065ccd8427]: (4, ('- - 0', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:32:15 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: None {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74039) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YskNjFLU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74039) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26263353865336564', 'path': '/dev/sdc'} {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263353865336564', 'path': '/dev/sdc'} {{(pid=74039) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-369308730',display_name='tempest-TestVolumeBootPattern-server-369308730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-369308730',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJQZqpYomopBvyPT79YeuY+pWP4JiFbz530rSSrDfMUmZXfBwTwQSswPKsBo1t1+jn1XQ66AYvtoNfJ5xebswSw6yHcnRHX1AQXk3BmN8XWO1jgu5mgBIib3k6FLvE2iA==',key_name='tempest-TestVolumeBootPattern-1653654445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='367334c57f8f47b696a477460afba369',ramdisk_id='',reservation_id='r-q28x8x4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725287482',owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:31:59Z,user_data=None,user_id='8d68ed2131b34e57a5f10a01409fee62',uuid=c8339229-e4de-4f89-9079-b5386d8398ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "address": "fa:16:3e:9f:d9:7b", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2661cb0d-6e", "ovs_interfaceid": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converting VIF {"id": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "address": "fa:16:3e:9f:d9:7b", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2661cb0d-6e", "ovs_interfaceid": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d9:7b,bridge_name='br-int',has_traffic_filtering=True,id=2661cb0d-6ebd-48ac-ae42-0640d779bf6a,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2661cb0d-6e') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG nova.objects.instance [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lazy-loading 'pci_devices' on Instance uuid c8339229-e4de-4f89-9079-b5386d8398ed {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:32:16 user nova-compute[74039]:   <uuid>c8339229-e4de-4f89-9079-b5386d8398ed</uuid>
Oct 20 09:32:16 user nova-compute[74039]:   <name>instance-00000034</name>
Oct 20 09:32:16 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:32:16 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:32:16 user nova-compute[74039]:   <metadata>
Oct 20 09:32:16 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:32:16 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:32:16 user nova-compute[74039]:       <nova:name>tempest-TestVolumeBootPattern-server-369308730</nova:name>
Oct 20 09:32:16 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:32:14</nova:creationTime>
Oct 20 09:32:16 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:32:16 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:32:16 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:32:16 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:32:16 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:32:16 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:32:16 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:32:16 user nova-compute[74039]:       <nova:owner>
Oct 20 09:32:16 user nova-compute[74039]:         <nova:user uuid="8d68ed2131b34e57a5f10a01409fee62">tempest-TestVolumeBootPattern-1725287482-project-member</nova:user>
Oct 20 09:32:16 user nova-compute[74039]:         <nova:project uuid="367334c57f8f47b696a477460afba369">tempest-TestVolumeBootPattern-1725287482</nova:project>
Oct 20 09:32:16 user nova-compute[74039]:       </nova:owner>
Oct 20 09:32:16 user nova-compute[74039]:       <nova:ports>
Oct 20 09:32:16 user nova-compute[74039]:         <nova:port uuid="2661cb0d-6ebd-48ac-ae42-0640d779bf6a">
Oct 20 09:32:16 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 09:32:16 user nova-compute[74039]:         </nova:port>
Oct 20 09:32:16 user nova-compute[74039]:       </nova:ports>
Oct 20 09:32:16 user nova-compute[74039]:     </nova:instance>
Oct 20 09:32:16 user nova-compute[74039]:   </metadata>
Oct 20 09:32:16 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:32:16 user nova-compute[74039]:     <system>
Oct 20 09:32:16 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:32:16 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:32:16 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:32:16 user nova-compute[74039]:       <entry name="serial">c8339229-e4de-4f89-9079-b5386d8398ed</entry>
Oct 20 09:32:16 user nova-compute[74039]:       <entry name="uuid">c8339229-e4de-4f89-9079-b5386d8398ed</entry>
Oct 20 09:32:16 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:32:16 user nova-compute[74039]:     </system>
Oct 20 09:32:16 user nova-compute[74039]:   </sysinfo>
Oct 20 09:32:16 user nova-compute[74039]:   <os>
Oct 20 09:32:16 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:32:16 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:32:16 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:32:16 user nova-compute[74039]:   </os>
Oct 20 09:32:16 user nova-compute[74039]:   <features>
Oct 20 09:32:16 user nova-compute[74039]:     <acpi/>
Oct 20 09:32:16 user nova-compute[74039]:     <apic/>
Oct 20 09:32:16 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:32:16 user nova-compute[74039]:   </features>
Oct 20 09:32:16 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:32:16 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:32:16 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:32:16 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:32:16 user nova-compute[74039]:   </clock>
Oct 20 09:32:16 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:32:16 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:32:16 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:32:16 user nova-compute[74039]:   </cpu>
Oct 20 09:32:16 user nova-compute[74039]:   <devices>
Oct 20 09:32:16 user nova-compute[74039]:     <disk type="block" device="disk">
Oct 20 09:32:16 user nova-compute[74039]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 09:32:16 user nova-compute[74039]:       <source dev="/dev/sdc"/>
Oct 20 09:32:16 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:32:16 user nova-compute[74039]:       <serial>62acc644-31d4-4656-b444-dcb34d4cea20</serial>
Oct 20 09:32:16 user nova-compute[74039]:     </disk>
Oct 20 09:32:16 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:32:16 user nova-compute[74039]:       <mac address="fa:16:3e:9f:d9:7b"/>
Oct 20 09:32:16 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:32:16 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:32:16 user nova-compute[74039]:       <target dev="tap2661cb0d-6e"/>
Oct 20 09:32:16 user nova-compute[74039]:     </interface>
Oct 20 09:32:16 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:32:16 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/c8339229-e4de-4f89-9079-b5386d8398ed/console.log" append="off"/>
Oct 20 09:32:16 user nova-compute[74039]:     </serial>
Oct 20 09:32:16 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:32:16 user nova-compute[74039]:     <video>
Oct 20 09:32:16 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:32:16 user nova-compute[74039]:     </video>
Oct 20 09:32:16 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:32:16 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:32:16 user nova-compute[74039]:     </rng>
Oct 20 09:32:16 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:32:16 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:32:16 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:32:16 user nova-compute[74039]:     </memballoon>
Oct 20 09:32:16 user nova-compute[74039]:   </devices>
Oct 20 09:32:16 user nova-compute[74039]: </domain>
Oct 20 09:32:16 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-369308730',display_name='tempest-TestVolumeBootPattern-server-369308730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-369308730',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJQZqpYomopBvyPT79YeuY+pWP4JiFbz530rSSrDfMUmZXfBwTwQSswPKsBo1t1+jn1XQ66AYvtoNfJ5xebswSw6yHcnRHX1AQXk3BmN8XWO1jgu5mgBIib3k6FLvE2iA==',key_name='tempest-TestVolumeBootPattern-1653654445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='367334c57f8f47b696a477460afba369',ramdisk_id='',reservation_id='r-q28x8x4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1725287482',owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:31:59Z,user_data=None,user_id='8d68ed2131b34e57a5f10a01409fee62',uuid=c8339229-e4de-4f89-9079-b5386d8398ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "address": "fa:16:3e:9f:d9:7b", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2661cb0d-6e", "ovs_interfaceid": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converting VIF {"id": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "address": "fa:16:3e:9f:d9:7b", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2661cb0d-6e", "ovs_interfaceid": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d9:7b,bridge_name='br-int',has_traffic_filtering=True,id=2661cb0d-6ebd-48ac-ae42-0640d779bf6a,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2661cb0d-6e') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG os_vif [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d9:7b,bridge_name='br-int',has_traffic_filtering=True,id=2661cb0d-6ebd-48ac-ae42-0640d779bf6a,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2661cb0d-6e') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a09b1608-d32c-5db2-b03a-3a958a95684c', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2661cb0d-6e, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2661cb0d-6e, col_values=(('qos', UUID('d689c965-c6b1-46ca-bb49-59c73215dffd')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2661cb0d-6e, col_values=(('external_ids', {'iface-id': '2661cb0d-6ebd-48ac-ae42-0640d779bf6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:d9:7b', 'vm-uuid': 'c8339229-e4de-4f89-9079-b5386d8398ed'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:16 user nova-compute[74039]: INFO os_vif [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d9:7b,bridge_name='br-int',has_traffic_filtering=True,id=2661cb0d-6ebd-48ac-ae42-0640d779bf6a,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2661cb0d-6e')
Oct 20 09:32:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:32:16 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] No VIF found with MAC fa:16:3e:9f:d9:7b, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:32:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:17 user nova-compute[74039]: DEBUG nova.compute.manager [req-e2c6b8b5-8a3c-4483-be0c-b7d51478dd62 req-514aca0d-8c49-46dc-863f-c3c3e7791c41 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Received event network-vif-plugged-2661cb0d-6ebd-48ac-ae42-0640d779bf6a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:32:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e2c6b8b5-8a3c-4483-be0c-b7d51478dd62 req-514aca0d-8c49-46dc-863f-c3c3e7791c41 service nova] Acquiring lock "c8339229-e4de-4f89-9079-b5386d8398ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:32:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e2c6b8b5-8a3c-4483-be0c-b7d51478dd62 req-514aca0d-8c49-46dc-863f-c3c3e7791c41 service nova] Lock "c8339229-e4de-4f89-9079-b5386d8398ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:32:17 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-e2c6b8b5-8a3c-4483-be0c-b7d51478dd62 req-514aca0d-8c49-46dc-863f-c3c3e7791c41 service nova] Lock "c8339229-e4de-4f89-9079-b5386d8398ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:32:17 user nova-compute[74039]: DEBUG nova.compute.manager [req-e2c6b8b5-8a3c-4483-be0c-b7d51478dd62 req-514aca0d-8c49-46dc-863f-c3c3e7791c41 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] No waiting events found dispatching network-vif-plugged-2661cb0d-6ebd-48ac-ae42-0640d779bf6a {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:32:17 user nova-compute[74039]: WARNING nova.compute.manager [req-e2c6b8b5-8a3c-4483-be0c-b7d51478dd62 req-514aca0d-8c49-46dc-863f-c3c3e7791c41 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Received unexpected event network-vif-plugged-2661cb0d-6ebd-48ac-ae42-0640d779bf6a for instance with vm_state building and task_state spawning.
Oct 20 09:32:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:19 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:19 user nova-compute[74039]: DEBUG nova.compute.manager [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:32:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:32:19 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Instance spawned successfully.
Oct 20 09:32:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 09:32:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Found default for hw_cdrom_bus of ide {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:32:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Found default for hw_disk_bus of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:32:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Found default for hw_input_bus of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:32:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Found default for hw_pointer_model of None {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:32:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Found default for hw_video_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:32:19 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Found default for hw_vif_model of virtio {{(pid=74039) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 09:32:19 user nova-compute[74039]: INFO nova.compute.manager [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Took 5.07 seconds to spawn the instance on the hypervisor.
Oct 20 09:32:19 user nova-compute[74039]: DEBUG nova.compute.manager [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:32:19 user nova-compute[74039]: DEBUG nova.compute.manager [req-4a3ee3b0-3e9b-4708-81c7-d8d7a1786e56 req-d203108b-b485-49a3-a539-a3bc962e62f2 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Received event network-vif-plugged-2661cb0d-6ebd-48ac-ae42-0640d779bf6a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:32:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a3ee3b0-3e9b-4708-81c7-d8d7a1786e56 req-d203108b-b485-49a3-a539-a3bc962e62f2 service nova] Acquiring lock "c8339229-e4de-4f89-9079-b5386d8398ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:32:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a3ee3b0-3e9b-4708-81c7-d8d7a1786e56 req-d203108b-b485-49a3-a539-a3bc962e62f2 service nova] Lock "c8339229-e4de-4f89-9079-b5386d8398ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:32:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-4a3ee3b0-3e9b-4708-81c7-d8d7a1786e56 req-d203108b-b485-49a3-a539-a3bc962e62f2 service nova] Lock "c8339229-e4de-4f89-9079-b5386d8398ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:32:19 user nova-compute[74039]: DEBUG nova.compute.manager [req-4a3ee3b0-3e9b-4708-81c7-d8d7a1786e56 req-d203108b-b485-49a3-a539-a3bc962e62f2 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] No waiting events found dispatching network-vif-plugged-2661cb0d-6ebd-48ac-ae42-0640d779bf6a {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:32:19 user nova-compute[74039]: WARNING nova.compute.manager [req-4a3ee3b0-3e9b-4708-81c7-d8d7a1786e56 req-d203108b-b485-49a3-a539-a3bc962e62f2 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Received unexpected event network-vif-plugged-2661cb0d-6ebd-48ac-ae42-0640d779bf6a for instance with vm_state building and task_state spawning.
Oct 20 09:32:19 user nova-compute[74039]: INFO nova.compute.manager [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Took 22.04 seconds to build instance.
Oct 20 09:32:19 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-783ec4fb-7037-4045-a1c9-e7936f50f291 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "c8339229-e4de-4f89-9079-b5386d8398ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.131s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:32:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:32:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:34 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:36 user nova-compute[74039]: DEBUG nova.compute.manager [req-26ba3d66-c79f-4be8-9ce7-953d667c3fa3 req-3da24a79-70e3-4f16-b93f-3341fa3605d0 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received event network-changed-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:32:36 user nova-compute[74039]: DEBUG nova.compute.manager [req-26ba3d66-c79f-4be8-9ce7-953d667c3fa3 req-3da24a79-70e3-4f16-b93f-3341fa3605d0 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Refreshing instance network info cache due to event network-changed-8274829a-aad4-4529-817c-3c7f77ab0c87. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:32:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-26ba3d66-c79f-4be8-9ce7-953d667c3fa3 req-3da24a79-70e3-4f16-b93f-3341fa3605d0 service nova] Acquiring lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:32:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-26ba3d66-c79f-4be8-9ce7-953d667c3fa3 req-3da24a79-70e3-4f16-b93f-3341fa3605d0 service nova] Acquired lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:32:36 user nova-compute[74039]: DEBUG nova.network.neutron [req-26ba3d66-c79f-4be8-9ce7-953d667c3fa3 req-3da24a79-70e3-4f16-b93f-3341fa3605d0 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Refreshing network info cache for port 8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:32:36 user nova-compute[74039]: DEBUG nova.network.neutron [req-26ba3d66-c79f-4be8-9ce7-953d667c3fa3 req-3da24a79-70e3-4f16-b93f-3341fa3605d0 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Updated VIF entry in instance network info cache for port 8274829a-aad4-4529-817c-3c7f77ab0c87. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:32:36 user nova-compute[74039]: DEBUG nova.network.neutron [req-26ba3d66-c79f-4be8-9ce7-953d667c3fa3 req-3da24a79-70e3-4f16-b93f-3341fa3605d0 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Updating instance_info_cache with network_info: [{"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:32:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-26ba3d66-c79f-4be8-9ce7-953d667c3fa3 req-3da24a79-70e3-4f16-b93f-3341fa3605d0 service nova] Releasing lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:32:39 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:41 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:32:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:32:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:32:42 user nova-compute[74039]: INFO nova.compute.manager [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Shelving
Oct 20 09:32:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:42 user nova-compute[74039]: DEBUG nova.compute.manager [req-7f2b5c7e-b78f-4ddd-b17e-085668eff227 req-a29bd43c-86a8-4330-8647-a9856711ed09 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received event network-vif-unplugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:32:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7f2b5c7e-b78f-4ddd-b17e-085668eff227 req-a29bd43c-86a8-4330-8647-a9856711ed09 service nova] Acquiring lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:32:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7f2b5c7e-b78f-4ddd-b17e-085668eff227 req-a29bd43c-86a8-4330-8647-a9856711ed09 service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:32:42 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-7f2b5c7e-b78f-4ddd-b17e-085668eff227 req-a29bd43c-86a8-4330-8647-a9856711ed09 service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:32:42 user nova-compute[74039]: DEBUG nova.compute.manager [req-7f2b5c7e-b78f-4ddd-b17e-085668eff227 req-a29bd43c-86a8-4330-8647-a9856711ed09 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] No waiting events found dispatching network-vif-unplugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:32:42 user nova-compute[74039]: WARNING nova.compute.manager [req-7f2b5c7e-b78f-4ddd-b17e-085668eff227 req-a29bd43c-86a8-4330-8647-a9856711ed09 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received unexpected event network-vif-unplugged-8274829a-aad4-4529-817c-3c7f77ab0c87 for instance with vm_state active and task_state shelving.
Oct 20 09:32:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:43 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Instance destroyed successfully.
Oct 20 09:32:43 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Beginning cold snapshot process
Oct 20 09:32:43 user nova-compute[74039]: DEBUG nova.privsep.utils [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74039) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 09:32:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk /opt/stack/data/nova/instances/snapshots/tmpxkz4njo4/db268fa24c044494a86cc4148444fc15 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:32:43 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk /opt/stack/data/nova/instances/snapshots/tmpxkz4njo4/db268fa24c044494a86cc4148444fc15" returned: 0 in 0.671s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:32:43 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Snapshot extracted, beginning image upload
Oct 20 09:32:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:44 user nova-compute[74039]: DEBUG nova.compute.manager [req-253bf10e-edb9-4bed-9e5d-0076e688722c req-fcee95e3-138d-47a5-8f25-1008ab62b260 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received event network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:32:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-253bf10e-edb9-4bed-9e5d-0076e688722c req-fcee95e3-138d-47a5-8f25-1008ab62b260 service nova] Acquiring lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:32:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-253bf10e-edb9-4bed-9e5d-0076e688722c req-fcee95e3-138d-47a5-8f25-1008ab62b260 service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:32:44 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-253bf10e-edb9-4bed-9e5d-0076e688722c req-fcee95e3-138d-47a5-8f25-1008ab62b260 service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:32:44 user nova-compute[74039]: DEBUG nova.compute.manager [req-253bf10e-edb9-4bed-9e5d-0076e688722c req-fcee95e3-138d-47a5-8f25-1008ab62b260 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] No waiting events found dispatching network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:32:44 user nova-compute[74039]: WARNING nova.compute.manager [req-253bf10e-edb9-4bed-9e5d-0076e688722c req-fcee95e3-138d-47a5-8f25-1008ab62b260 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received unexpected event network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 09:32:45 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:32:45 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:32:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:46 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Snapshot image upload complete
Oct 20 09:32:46 user nova-compute[74039]: DEBUG nova.compute.manager [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:32:46 user nova-compute[74039]: INFO nova.compute.manager [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Shelve offloading
Oct 20 09:32:46 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Instance destroyed successfully.
Oct 20 09:32:46 user nova-compute[74039]: DEBUG nova.compute.manager [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:32:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:32:46 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquired lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:32:46 user nova-compute[74039]: DEBUG nova.network.neutron [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:32:46 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG nova.network.neutron [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Updating instance_info_cache with network_info: [{"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Releasing lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:32:47 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Instance destroyed successfully.
Oct 20 09:32:47 user nova-compute[74039]: DEBUG nova.objects.instance [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'resources' on Instance uuid 1fdd0502-f3cf-4353-be1c-72d8abe57f0a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1879223711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1879223711',id=51,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIC6P4bigUg+cbKshQKP1+j2wpIMIpTI+VHhB8KKEetlHyMIQd+jzYXwLCG0+Hu5vAkheTNunlTBHaRXH1aKNpCzLLY86NI0bJzkVCsqrStByvLxANaY472MINupLINA6g==',key_name='tempest-keypair-1751542138',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:30:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='235f30d0612f4bfba028314ba7155dcf',ramdisk_id='',reservation_id='r-5td7wqrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1190516011',owner_user_name='tempest-AttachVolumeShelveTestJSON-1190516011-project-member',shelved_at='2023-10-20T09:32:46.629213',shelved_host='user',shelved_image_id='521da64d-e312-4568-b543-0fb61e4d10ac'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:32:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd7771575aef439ebf1d55d3c4dcc377',uuid=1fdd0502-f3cf-4353-be1c-72d8abe57f0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converting VIF {"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:3e:c7,bridge_name='br-int',has_traffic_filtering=True,id=8274829a-aad4-4529-817c-3c7f77ab0c87,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8274829a-aa') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG os_vif [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:3e:c7,bridge_name='br-int',has_traffic_filtering=True,id=8274829a-aad4-4529-817c-3c7f77ab0c87,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8274829a-aa') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8274829a-aa, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG nova.compute.manager [req-364395a6-afdf-48b3-b1ac-3cc8bd976ccd req-7f9f3697-b66c-4a6f-a437-85c1636e58b2 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received event network-changed-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG nova.compute.manager [req-364395a6-afdf-48b3-b1ac-3cc8bd976ccd req-7f9f3697-b66c-4a6f-a437-85c1636e58b2 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Refreshing instance network info cache due to event network-changed-8274829a-aad4-4529-817c-3c7f77ab0c87. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-364395a6-afdf-48b3-b1ac-3cc8bd976ccd req-7f9f3697-b66c-4a6f-a437-85c1636e58b2 service nova] Acquiring lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-364395a6-afdf-48b3-b1ac-3cc8bd976ccd req-7f9f3697-b66c-4a6f-a437-85c1636e58b2 service nova] Acquired lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG nova.network.neutron [req-364395a6-afdf-48b3-b1ac-3cc8bd976ccd req-7f9f3697-b66c-4a6f-a437-85c1636e58b2 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Refreshing network info cache for port 8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=222637fd-a778-4366-94c6-f7ab9c7624b1) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:32:47 user nova-compute[74039]: INFO os_vif [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:3e:c7,bridge_name='br-int',has_traffic_filtering=True,id=8274829a-aad4-4529-817c-3c7f77ab0c87,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8274829a-aa')
Oct 20 09:32:47 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Deleting instance files /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a_del
Oct 20 09:32:47 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Deletion of /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a_del complete
Oct 20 09:32:47 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Deleted allocations for instance 1fdd0502-f3cf-4353-be1c-72d8abe57f0a
Oct 20 09:32:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG nova.objects.instance [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'numa_topology' on Instance uuid 1fdd0502-f3cf-4353-be1c-72d8abe57f0a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:32:47 user nova-compute[74039]: DEBUG nova.objects.base [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Object Instance<1fdd0502-f3cf-4353-be1c-72d8abe57f0a> lazy-loaded attributes: resources,numa_topology {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:32:48 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:32:48 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:32:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:32:48 user nova-compute[74039]: DEBUG nova.network.neutron [req-364395a6-afdf-48b3-b1ac-3cc8bd976ccd req-7f9f3697-b66c-4a6f-a437-85c1636e58b2 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Updated VIF entry in instance network info cache for port 8274829a-aad4-4529-817c-3c7f77ab0c87. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:32:48 user nova-compute[74039]: DEBUG nova.network.neutron [req-364395a6-afdf-48b3-b1ac-3cc8bd976ccd req-7f9f3697-b66c-4a6f-a437-85c1636e58b2 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Updating instance_info_cache with network_info: [{"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8274829a-aa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:32:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-7837fe4b-293a-42ab-8e2c-dc6a42cec9c3 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.781s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:32:48 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-364395a6-afdf-48b3-b1ac-3cc8bd976ccd req-7f9f3697-b66c-4a6f-a437-85c1636e58b2 service nova] Releasing lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:32:48 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:32:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:52 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:32:52 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:32:52 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:52 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Oct 20 09:32:52 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Didn't find any instances for network info cache update. {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 09:32:52 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:32:53 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:32:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:32:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:32:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:32:53 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:32:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:32:53 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:32:54 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:32:54 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:32:54 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8780MB free_disk=25.292831420898438GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:32:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:32:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:32:54 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance ae2d9955-4612-4761-8e98-3fcd0ab007dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:32:54 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance c8339229-e4de-4f89-9079-b5386d8398ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:32:54 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:32:54 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:32:54 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:32:54 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:32:54 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:32:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:32:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:32:55 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:32:57 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:01 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:33:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:33:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:33:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:33:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:33:02 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:04 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:33:07 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:17 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:33:22 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:33:27 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:33:32 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:41 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:33:42 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:46 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:33:46 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:33:47 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:33:47 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:33:48 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:48 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:33:49 user nova-compute[74039]: DEBUG nova.compute.manager [req-d27e0d0f-a2eb-4608-b486-d308a46f2c4f req-fad994d7-01b3-4e7a-a00c-9465be83ac48 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Received event network-changed-2661cb0d-6ebd-48ac-ae42-0640d779bf6a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:33:49 user nova-compute[74039]: DEBUG nova.compute.manager [req-d27e0d0f-a2eb-4608-b486-d308a46f2c4f req-fad994d7-01b3-4e7a-a00c-9465be83ac48 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Refreshing instance network info cache due to event network-changed-2661cb0d-6ebd-48ac-ae42-0640d779bf6a. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:33:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d27e0d0f-a2eb-4608-b486-d308a46f2c4f req-fad994d7-01b3-4e7a-a00c-9465be83ac48 service nova] Acquiring lock "refresh_cache-c8339229-e4de-4f89-9079-b5386d8398ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:33:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d27e0d0f-a2eb-4608-b486-d308a46f2c4f req-fad994d7-01b3-4e7a-a00c-9465be83ac48 service nova] Acquired lock "refresh_cache-c8339229-e4de-4f89-9079-b5386d8398ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:33:49 user nova-compute[74039]: DEBUG nova.network.neutron [req-d27e0d0f-a2eb-4608-b486-d308a46f2c4f req-fad994d7-01b3-4e7a-a00c-9465be83ac48 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Refreshing network info cache for port 2661cb0d-6ebd-48ac-ae42-0640d779bf6a {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:33:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:49 user nova-compute[74039]: DEBUG nova.network.neutron [req-d27e0d0f-a2eb-4608-b486-d308a46f2c4f req-fad994d7-01b3-4e7a-a00c-9465be83ac48 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Updated VIF entry in instance network info cache for port 2661cb0d-6ebd-48ac-ae42-0640d779bf6a. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:33:49 user nova-compute[74039]: DEBUG nova.network.neutron [req-d27e0d0f-a2eb-4608-b486-d308a46f2c4f req-fad994d7-01b3-4e7a-a00c-9465be83ac48 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Updating instance_info_cache with network_info: [{"id": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "address": "fa:16:3e:9f:d9:7b", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2661cb0d-6e", "ovs_interfaceid": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:33:49 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d27e0d0f-a2eb-4608-b486-d308a46f2c4f req-fad994d7-01b3-4e7a-a00c-9465be83ac48 service nova] Releasing lock "refresh_cache-c8339229-e4de-4f89-9079-b5386d8398ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:33:50 user nova-compute[74039]: DEBUG nova.compute.manager [req-d1c40f7e-6b8c-4c40-93d9-5710021c3a9d req-403ec1ad-226a-4c3d-b7eb-144692e64122 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Received event network-changed-2661cb0d-6ebd-48ac-ae42-0640d779bf6a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:33:50 user nova-compute[74039]: DEBUG nova.compute.manager [req-d1c40f7e-6b8c-4c40-93d9-5710021c3a9d req-403ec1ad-226a-4c3d-b7eb-144692e64122 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Refreshing instance network info cache due to event network-changed-2661cb0d-6ebd-48ac-ae42-0640d779bf6a. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:33:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d1c40f7e-6b8c-4c40-93d9-5710021c3a9d req-403ec1ad-226a-4c3d-b7eb-144692e64122 service nova] Acquiring lock "refresh_cache-c8339229-e4de-4f89-9079-b5386d8398ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:33:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d1c40f7e-6b8c-4c40-93d9-5710021c3a9d req-403ec1ad-226a-4c3d-b7eb-144692e64122 service nova] Acquired lock "refresh_cache-c8339229-e4de-4f89-9079-b5386d8398ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:33:50 user nova-compute[74039]: DEBUG nova.network.neutron [req-d1c40f7e-6b8c-4c40-93d9-5710021c3a9d req-403ec1ad-226a-4c3d-b7eb-144692e64122 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Refreshing network info cache for port 2661cb0d-6ebd-48ac-ae42-0640d779bf6a {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:33:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "c8339229-e4de-4f89-9079-b5386d8398ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:33:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "c8339229-e4de-4f89-9079-b5386d8398ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:33:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "c8339229-e4de-4f89-9079-b5386d8398ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:33:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "c8339229-e4de-4f89-9079-b5386d8398ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:33:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "c8339229-e4de-4f89-9079-b5386d8398ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:33:50 user nova-compute[74039]: INFO nova.compute.manager [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Terminating instance
Oct 20 09:33:50 user nova-compute[74039]: DEBUG nova.compute.manager [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:33:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:50 user nova-compute[74039]: DEBUG nova.network.neutron [req-d1c40f7e-6b8c-4c40-93d9-5710021c3a9d req-403ec1ad-226a-4c3d-b7eb-144692e64122 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Updated VIF entry in instance network info cache for port 2661cb0d-6ebd-48ac-ae42-0640d779bf6a. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:33:50 user nova-compute[74039]: DEBUG nova.network.neutron [req-d1c40f7e-6b8c-4c40-93d9-5710021c3a9d req-403ec1ad-226a-4c3d-b7eb-144692e64122 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Updating instance_info_cache with network_info: [{"id": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "address": "fa:16:3e:9f:d9:7b", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2661cb0d-6e", "ovs_interfaceid": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:33:50 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d1c40f7e-6b8c-4c40-93d9-5710021c3a9d req-403ec1ad-226a-4c3d-b7eb-144692e64122 service nova] Releasing lock "refresh_cache-c8339229-e4de-4f89-9079-b5386d8398ed" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:33:51 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Instance destroyed successfully.
Oct 20 09:33:51 user nova-compute[74039]: DEBUG nova.objects.instance [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lazy-loading 'resources' on Instance uuid c8339229-e4de-4f89-9079-b5386d8398ed {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-369308730',display_name='tempest-TestVolumeBootPattern-server-369308730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-369308730',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJQZqpYomopBvyPT79YeuY+pWP4JiFbz530rSSrDfMUmZXfBwTwQSswPKsBo1t1+jn1XQ66AYvtoNfJ5xebswSw6yHcnRHX1AQXk3BmN8XWO1jgu5mgBIib3k6FLvE2iA==',key_name='tempest-TestVolumeBootPattern-1653654445',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:32:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='367334c57f8f47b696a477460afba369',ramdisk_id='',reservation_id='r-q28x8x4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1725287482',owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:32:20Z,user_data=None,user_id='8d68ed2131b34e57a5f10a01409fee62',uuid=c8339229-e4de-4f89-9079-b5386d8398ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "address": "fa:16:3e:9f:d9:7b", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2661cb0d-6e", "ovs_interfaceid": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converting VIF {"id": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "address": "fa:16:3e:9f:d9:7b", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2661cb0d-6e", "ovs_interfaceid": "2661cb0d-6ebd-48ac-ae42-0640d779bf6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:d9:7b,bridge_name='br-int',has_traffic_filtering=True,id=2661cb0d-6ebd-48ac-ae42-0640d779bf6a,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2661cb0d-6e') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_vif [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:d9:7b,bridge_name='br-int',has_traffic_filtering=True,id=2661cb0d-6ebd-48ac-ae42-0640d779bf6a,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2661cb0d-6e') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2661cb0d-6e, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d689c965-c6b1-46ca-bb49-59c73215dffd) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:51 user nova-compute[74039]: INFO os_vif [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:d9:7b,bridge_name='br-int',has_traffic_filtering=True,id=2661cb0d-6ebd-48ac-ae42-0640d779bf6a,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2661cb0d-6e')
Oct 20 09:33:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YskNjFLU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:33:51 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a212134-f01b-43b7-896e-9ce553214c4c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:33:51 user nova-compute[74039]: No targets found.
Oct 20 09:33:51 user nova-compute[74039]: iSNS:
Oct 20 09:33:51 user nova-compute[74039]: No targets found.
Oct 20 09:33:51 user nova-compute[74039]: STATIC:
Oct 20 09:33:51 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935
Oct 20 09:33:51 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:33:51 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:33:51 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20
Oct 20 09:33:51 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:33:51 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:33:51 user nova-compute[74039]: FIRMWARE:
Oct 20 09:33:51 user nova-compute[74039]: No targets found.
Oct 20 09:33:51 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:33:51 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:33:51 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8194290-405e-44a7-b754-5c71bb39ff44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75a2b94-e4e3-4d4c-8654-8e830e7d3bee]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)
Oct 20 09:33:51 user nova-compute[74039]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 (non-flash)
Oct 20 09:33:51 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)
Oct 20 09:33:51 user nova-compute[74039]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 (non-flash)
Oct 20 09:33:51 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae7c18ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20'): ({'sdc'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Removing single pathed devices sdc {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[be968644-0550-4a94-9b34-2c39f4cfedf8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9bcbf7-7881-41bd-b49b-6c4996e6560c]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Flushing IO for device /dev/sdc {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[38646627-3f86-4ba8-93ca-8cbc27e217ae]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[89913495-6a55-46fb-8af9-8c8a18729c50]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] SCSI volumes sdc have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4c00c6-5da1-4372-9cfa-70c53322929c]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28056a7-a01b-4b9f-9f19-9fd50ab42046]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20, portal: 172.16.0.220,3260]
Oct 20 09:33:51 user nova-compute[74039]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20, portal: 172.16.0.220,3260] successful.
Oct 20 09:33:51 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62acc644-31d4-4656-b444-dcb34d4cea20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61cec0d-b2a3-4566-9b49-2540ca313c6d]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] <== disconnect_volume: return (322ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:33:51 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Deleting instance files /opt/stack/data/nova/instances/c8339229-e4de-4f89-9079-b5386d8398ed_del
Oct 20 09:33:51 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Deletion of /opt/stack/data/nova/instances/c8339229-e4de-4f89-9079-b5386d8398ed_del complete
Oct 20 09:33:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-83a7e7a8-9211-4f8e-b5d3-256fd8de5008 req-473a87ba-e32a-4c22-b0e7-11580132b665 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Received event network-vif-unplugged-2661cb0d-6ebd-48ac-ae42-0640d779bf6a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-83a7e7a8-9211-4f8e-b5d3-256fd8de5008 req-473a87ba-e32a-4c22-b0e7-11580132b665 service nova] Acquiring lock "c8339229-e4de-4f89-9079-b5386d8398ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-83a7e7a8-9211-4f8e-b5d3-256fd8de5008 req-473a87ba-e32a-4c22-b0e7-11580132b665 service nova] Lock "c8339229-e4de-4f89-9079-b5386d8398ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-83a7e7a8-9211-4f8e-b5d3-256fd8de5008 req-473a87ba-e32a-4c22-b0e7-11580132b665 service nova] Lock "c8339229-e4de-4f89-9079-b5386d8398ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-83a7e7a8-9211-4f8e-b5d3-256fd8de5008 req-473a87ba-e32a-4c22-b0e7-11580132b665 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] No waiting events found dispatching network-vif-unplugged-2661cb0d-6ebd-48ac-ae42-0640d779bf6a {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-83a7e7a8-9211-4f8e-b5d3-256fd8de5008 req-473a87ba-e32a-4c22-b0e7-11580132b665 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Received event network-vif-unplugged-2661cb0d-6ebd-48ac-ae42-0640d779bf6a for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-83a7e7a8-9211-4f8e-b5d3-256fd8de5008 req-473a87ba-e32a-4c22-b0e7-11580132b665 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Received event network-vif-plugged-2661cb0d-6ebd-48ac-ae42-0640d779bf6a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-83a7e7a8-9211-4f8e-b5d3-256fd8de5008 req-473a87ba-e32a-4c22-b0e7-11580132b665 service nova] Acquiring lock "c8339229-e4de-4f89-9079-b5386d8398ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-83a7e7a8-9211-4f8e-b5d3-256fd8de5008 req-473a87ba-e32a-4c22-b0e7-11580132b665 service nova] Lock "c8339229-e4de-4f89-9079-b5386d8398ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-83a7e7a8-9211-4f8e-b5d3-256fd8de5008 req-473a87ba-e32a-4c22-b0e7-11580132b665 service nova] Lock "c8339229-e4de-4f89-9079-b5386d8398ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG nova.compute.manager [req-83a7e7a8-9211-4f8e-b5d3-256fd8de5008 req-473a87ba-e32a-4c22-b0e7-11580132b665 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] No waiting events found dispatching network-vif-plugged-2661cb0d-6ebd-48ac-ae42-0640d779bf6a {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:33:51 user nova-compute[74039]: WARNING nova.compute.manager [req-83a7e7a8-9211-4f8e-b5d3-256fd8de5008 req-473a87ba-e32a-4c22-b0e7-11580132b665 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Received unexpected event network-vif-plugged-2661cb0d-6ebd-48ac-ae42-0640d779bf6a for instance with vm_state active and task_state deleting.
Oct 20 09:33:51 user nova-compute[74039]: INFO nova.compute.manager [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 20 09:33:51 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:33:51 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:33:51 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Took 0.44 seconds to deallocate network for instance.
Oct 20 09:33:52 user nova-compute[74039]: INFO nova.compute.manager [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Took 0.78 seconds to detach 1 volumes for instance.
Oct 20 09:33:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:33:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:33:52 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:33:52 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:33:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:33:53 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Deleted allocations for instance c8339229-e4de-4f89-9079-b5386d8398ed
Oct 20 09:33:53 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-e2631a5e-46df-4374-a9c5-441b8fa44ae3 tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "c8339229-e4de-4f89-9079-b5386d8398ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.728s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:33:53 user nova-compute[74039]: DEBUG nova.compute.manager [req-974a5356-dd32-4091-ac37-a0f41516eeac req-9ea09bdc-8488-4d41-bbea-e93a485f7fe9 service nova] [instance: c8339229-e4de-4f89-9079-b5386d8398ed] Received event network-vif-deleted-2661cb0d-6ebd-48ac-ae42-0640d779bf6a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:33:54 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:54 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:33:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:33:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Rebuilding the list of instances to heal {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 09:33:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:33:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:33:54 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:33:54 user nova-compute[74039]: DEBUG nova.objects.instance [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lazy-loading 'info_cache' on Instance uuid ae2d9955-4612-4761-8e98-3fcd0ab007dd {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:33:55 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Updating instance_info_cache with network_info: [{"id": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "address": "fa:16:3e:08:88:64", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d683a8e-79", "ovs_interfaceid": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:33:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:33:55 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:33:55 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:33:55 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:33:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:33:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:33:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:33:55 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:33:55 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:33:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:33:56 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:33:56 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:33:56 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8904MB free_disk=25.291934967041016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:33:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:33:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:33:56 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance ae2d9955-4612-4761-8e98-3fcd0ab007dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:33:56 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:33:56 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:33:56 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:33:56 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:33:56 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:33:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:33:57 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:34:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:34:01 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:34:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:34:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:34:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:34:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:34:35 user nova-compute[74039]: INFO nova.compute.manager [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Unshelving
Oct 20 09:34:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:34:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:34:35 user nova-compute[74039]: DEBUG nova.objects.instance [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'pci_requests' on Instance uuid 1fdd0502-f3cf-4353-be1c-72d8abe57f0a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:34:35 user nova-compute[74039]: DEBUG nova.objects.instance [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'numa_topology' on Instance uuid 1fdd0502-f3cf-4353-be1c-72d8abe57f0a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:34:35 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74039) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 09:34:35 user nova-compute[74039]: INFO nova.compute.claims [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Claim successful on node user
Oct 20 09:34:35 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:34:35 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:34:35 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:34:35 user nova-compute[74039]: INFO nova.network.neutron [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Updating port 8274829a-aad4-4529-817c-3c7f77ab0c87 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 09:34:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:34:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquired lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:34:36 user nova-compute[74039]: DEBUG nova.network.neutron [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Building network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 09:34:36 user nova-compute[74039]: DEBUG nova.compute.manager [req-d08125ef-c8cc-4333-8802-996ba6f03dfa req-080d9a16-43a1-40ad-be7a-df205a3c7972 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received event network-changed-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:34:36 user nova-compute[74039]: DEBUG nova.compute.manager [req-d08125ef-c8cc-4333-8802-996ba6f03dfa req-080d9a16-43a1-40ad-be7a-df205a3c7972 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Refreshing instance network info cache due to event network-changed-8274829a-aad4-4529-817c-3c7f77ab0c87. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:34:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d08125ef-c8cc-4333-8802-996ba6f03dfa req-080d9a16-43a1-40ad-be7a-df205a3c7972 service nova] Acquiring lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:34:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:36 user nova-compute[74039]: DEBUG nova.network.neutron [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Updating instance_info_cache with network_info: [{"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:34:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Releasing lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:34:36 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Creating instance directory {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 09:34:36 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Creating image(s)
Oct 20 09:34:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:34:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "/opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:34:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "/opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:34:36 user nova-compute[74039]: DEBUG nova.objects.instance [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1fdd0502-f3cf-4353-be1c-72d8abe57f0a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:34:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d08125ef-c8cc-4333-8802-996ba6f03dfa req-080d9a16-43a1-40ad-be7a-df205a3c7972 service nova] Acquired lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:34:36 user nova-compute[74039]: DEBUG nova.network.neutron [req-d08125ef-c8cc-4333-8802-996ba6f03dfa req-080d9a16-43a1-40ad-be7a-df205a3c7972 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Refreshing network info cache for port 8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:34:36 user nova-compute[74039]: DEBUG nova.objects.base [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Object Instance<1fdd0502-f3cf-4353-be1c-72d8abe57f0a> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:34:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "69d6f0459af3fcf33e150066ba0daae2474be8fe" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:34:36 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "69d6f0459af3fcf33e150066ba0daae2474be8fe" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:34:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69d6f0459af3fcf33e150066ba0daae2474be8fe.part --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:34:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69d6f0459af3fcf33e150066ba0daae2474be8fe.part --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:34:37 user nova-compute[74039]: DEBUG nova.virt.images [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] 521da64d-e312-4568-b543-0fb61e4d10ac was qcow2, converting to raw {{(pid=74039) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 09:34:37 user nova-compute[74039]: DEBUG nova.privsep.utils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74039) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 09:34:37 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/69d6f0459af3fcf33e150066ba0daae2474be8fe.part /opt/stack/data/nova/instances/_base/69d6f0459af3fcf33e150066ba0daae2474be8fe.converted {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:34:37 user nova-compute[74039]: DEBUG nova.network.neutron [req-d08125ef-c8cc-4333-8802-996ba6f03dfa req-080d9a16-43a1-40ad-be7a-df205a3c7972 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Updated VIF entry in instance network info cache for port 8274829a-aad4-4529-817c-3c7f77ab0c87. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:34:37 user nova-compute[74039]: DEBUG nova.network.neutron [req-d08125ef-c8cc-4333-8802-996ba6f03dfa req-080d9a16-43a1-40ad-be7a-df205a3c7972 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Updating instance_info_cache with network_info: [{"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:34:37 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-d08125ef-c8cc-4333-8802-996ba6f03dfa req-080d9a16-43a1-40ad-be7a-df205a3c7972 service nova] Releasing lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:34:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/69d6f0459af3fcf33e150066ba0daae2474be8fe.part /opt/stack/data/nova/instances/_base/69d6f0459af3fcf33e150066ba0daae2474be8fe.converted" returned: 0 in 0.559s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:34:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69d6f0459af3fcf33e150066ba0daae2474be8fe.converted --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:34:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69d6f0459af3fcf33e150066ba0daae2474be8fe.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:34:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "69d6f0459af3fcf33e150066ba0daae2474be8fe" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.963s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:34:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69d6f0459af3fcf33e150066ba0daae2474be8fe --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:34:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69d6f0459af3fcf33e150066ba0daae2474be8fe --force-share --output=json" returned: 0 in 0.194s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:34:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "69d6f0459af3fcf33e150066ba0daae2474be8fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:34:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "69d6f0459af3fcf33e150066ba0daae2474be8fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:34:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69d6f0459af3fcf33e150066ba0daae2474be8fe --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:34:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69d6f0459af3fcf33e150066ba0daae2474be8fe --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:34:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69d6f0459af3fcf33e150066ba0daae2474be8fe,backing_fmt=raw /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk 1073741824 {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:34:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69d6f0459af3fcf33e150066ba0daae2474be8fe,backing_fmt=raw /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk 1073741824" returned: 0 in 0.049s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:34:38 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "69d6f0459af3fcf33e150066ba0daae2474be8fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:34:38 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69d6f0459af3fcf33e150066ba0daae2474be8fe --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:34:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69d6f0459af3fcf33e150066ba0daae2474be8fe --force-share --output=json" returned: 0 in 0.172s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:34:39 user nova-compute[74039]: DEBUG nova.objects.instance [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'migration_context' on Instance uuid 1fdd0502-f3cf-4353-be1c-72d8abe57f0a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:34:39 user nova-compute[74039]: DEBUG nova.objects.base [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Object Instance<1fdd0502-f3cf-4353-be1c-72d8abe57f0a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:34:39 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Rebasing disk image.
Oct 20 09:34:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:34:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 --force-share --output=json" returned: 0 in 0.173s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:34:39 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 -F raw /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/ad6ae0cca52d348626240f5513d65f8591b19258 -F raw /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk" returned: 0 in 2.073s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Created local disks {{(pid=74039) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Ensure instance console log exists: /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/console.log {{(pid=74039) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Start _get_guest_xml network_info=[{"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b7b59af030a321b367c778a7bd94317c',container_format='bare',created_at=2023-10-20T09:32:42Z,direct_url=<?>,disk_format='qcow2',id=521da64d-e312-4568-b543-0fb61e4d10ac,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1879223711-shelved',owner='235f30d0612f4bfba028314ba7155dcf',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T09:32:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f58b9629-4790-4951-9492-6447e1485638'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 09:34:41 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:34:41 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CPU controller missing on host. {{(pid=74039) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.host [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CPU controller found on host. {{(pid=74039) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74039) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T08:44:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b7b59af030a321b367c778a7bd94317c',container_format='bare',created_at=2023-10-20T09:32:42Z,direct_url=<?>,disk_format='qcow2',id=521da64d-e312-4568-b543-0fb61e4d10ac,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1879223711-shelved',owner='235f30d0612f4bfba028314ba7155dcf',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T09:32:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Flavor limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Image limits 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Flavor pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Image pref 0:0:0 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Got 1 possible topologies {{(pid=74039) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.hardware [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74039) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.objects.instance [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1fdd0502-f3cf-4353-be1c-72d8abe57f0a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.objects.base [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Object Instance<1fdd0502-f3cf-4353-be1c-72d8abe57f0a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1879223711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1879223711',id=51,image_ref='521da64d-e312-4568-b543-0fb61e4d10ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1751542138',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:30:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='235f30d0612f4bfba028314ba7155dcf',ramdisk_id='',reservation_id='r-5td7wqrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1190516011',owner_user_name='tempest-AttachVolumeShelveTestJSON-1190516011-project-member',shelved_at='2023-10-20T09:32:46.629213',shelved_host='user',shelved_image_id='521da64d-e312-4568-b543-0fb61e4d10ac'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd7771575aef439ebf1d55d3c4dcc377',uuid=1fdd0502-f3cf-4353-be1c-72d8abe57f0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74039) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converting VIF {"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:3e:c7,bridge_name='br-int',has_traffic_filtering=True,id=8274829a-aad4-4529-817c-3c7f77ab0c87,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8274829a-aa') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.objects.instance [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fdd0502-f3cf-4353-be1c-72d8abe57f0a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.objects.base [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Object Instance<1fdd0502-f3cf-4353-be1c-72d8abe57f0a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74039) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 09:34:41 user nova-compute[74039]:   <uuid>1fdd0502-f3cf-4353-be1c-72d8abe57f0a</uuid>
Oct 20 09:34:41 user nova-compute[74039]:   <name>instance-00000033</name>
Oct 20 09:34:41 user nova-compute[74039]:   <memory>524288</memory>
Oct 20 09:34:41 user nova-compute[74039]:   <vcpu>1</vcpu>
Oct 20 09:34:41 user nova-compute[74039]:   <metadata>
Oct 20 09:34:41 user nova-compute[74039]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 09:34:41 user nova-compute[74039]:       <nova:package version="0.0.0"/>
Oct 20 09:34:41 user nova-compute[74039]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1879223711</nova:name>
Oct 20 09:34:41 user nova-compute[74039]:       <nova:creationTime>2023-10-20 09:34:41</nova:creationTime>
Oct 20 09:34:41 user nova-compute[74039]:       <nova:flavor name="m1.tiny">
Oct 20 09:34:41 user nova-compute[74039]:         <nova:memory>512</nova:memory>
Oct 20 09:34:41 user nova-compute[74039]:         <nova:disk>1</nova:disk>
Oct 20 09:34:41 user nova-compute[74039]:         <nova:swap>0</nova:swap>
Oct 20 09:34:41 user nova-compute[74039]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 09:34:41 user nova-compute[74039]:         <nova:vcpus>1</nova:vcpus>
Oct 20 09:34:41 user nova-compute[74039]:       </nova:flavor>
Oct 20 09:34:41 user nova-compute[74039]:       <nova:owner>
Oct 20 09:34:41 user nova-compute[74039]:         <nova:user uuid="bd7771575aef439ebf1d55d3c4dcc377">tempest-AttachVolumeShelveTestJSON-1190516011-project-member</nova:user>
Oct 20 09:34:41 user nova-compute[74039]:         <nova:project uuid="235f30d0612f4bfba028314ba7155dcf">tempest-AttachVolumeShelveTestJSON-1190516011</nova:project>
Oct 20 09:34:41 user nova-compute[74039]:       </nova:owner>
Oct 20 09:34:41 user nova-compute[74039]:       <nova:root type="image" uuid="521da64d-e312-4568-b543-0fb61e4d10ac"/>
Oct 20 09:34:41 user nova-compute[74039]:       <nova:ports>
Oct 20 09:34:41 user nova-compute[74039]:         <nova:port uuid="8274829a-aad4-4529-817c-3c7f77ab0c87">
Oct 20 09:34:41 user nova-compute[74039]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 09:34:41 user nova-compute[74039]:         </nova:port>
Oct 20 09:34:41 user nova-compute[74039]:       </nova:ports>
Oct 20 09:34:41 user nova-compute[74039]:     </nova:instance>
Oct 20 09:34:41 user nova-compute[74039]:   </metadata>
Oct 20 09:34:41 user nova-compute[74039]:   <sysinfo type="smbios">
Oct 20 09:34:41 user nova-compute[74039]:     <system>
Oct 20 09:34:41 user nova-compute[74039]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 09:34:41 user nova-compute[74039]:       <entry name="product">OpenStack Nova</entry>
Oct 20 09:34:41 user nova-compute[74039]:       <entry name="version">0.0.0</entry>
Oct 20 09:34:41 user nova-compute[74039]:       <entry name="serial">1fdd0502-f3cf-4353-be1c-72d8abe57f0a</entry>
Oct 20 09:34:41 user nova-compute[74039]:       <entry name="uuid">1fdd0502-f3cf-4353-be1c-72d8abe57f0a</entry>
Oct 20 09:34:41 user nova-compute[74039]:       <entry name="family">Virtual Machine</entry>
Oct 20 09:34:41 user nova-compute[74039]:     </system>
Oct 20 09:34:41 user nova-compute[74039]:   </sysinfo>
Oct 20 09:34:41 user nova-compute[74039]:   <os>
Oct 20 09:34:41 user nova-compute[74039]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 09:34:41 user nova-compute[74039]:     <boot dev="hd"/>
Oct 20 09:34:41 user nova-compute[74039]:     <smbios mode="sysinfo"/>
Oct 20 09:34:41 user nova-compute[74039]:   </os>
Oct 20 09:34:41 user nova-compute[74039]:   <features>
Oct 20 09:34:41 user nova-compute[74039]:     <acpi/>
Oct 20 09:34:41 user nova-compute[74039]:     <apic/>
Oct 20 09:34:41 user nova-compute[74039]:     <vmcoreinfo/>
Oct 20 09:34:41 user nova-compute[74039]:   </features>
Oct 20 09:34:41 user nova-compute[74039]:   <clock offset="utc">
Oct 20 09:34:41 user nova-compute[74039]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 09:34:41 user nova-compute[74039]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 09:34:41 user nova-compute[74039]:     <timer name="hpet" present="no"/>
Oct 20 09:34:41 user nova-compute[74039]:   </clock>
Oct 20 09:34:41 user nova-compute[74039]:   <cpu mode="custom" match="exact">
Oct 20 09:34:41 user nova-compute[74039]:     <model>Nehalem</model>
Oct 20 09:34:41 user nova-compute[74039]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 09:34:41 user nova-compute[74039]:   </cpu>
Oct 20 09:34:41 user nova-compute[74039]:   <devices>
Oct 20 09:34:41 user nova-compute[74039]:     <disk type="file" device="disk">
Oct 20 09:34:41 user nova-compute[74039]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 09:34:41 user nova-compute[74039]:       <source file="/opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk"/>
Oct 20 09:34:41 user nova-compute[74039]:       <target dev="vda" bus="virtio"/>
Oct 20 09:34:41 user nova-compute[74039]:     </disk>
Oct 20 09:34:41 user nova-compute[74039]:     <interface type="ethernet">
Oct 20 09:34:41 user nova-compute[74039]:       <mac address="fa:16:3e:44:3e:c7"/>
Oct 20 09:34:41 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:34:41 user nova-compute[74039]:       <mtu size="1442"/>
Oct 20 09:34:41 user nova-compute[74039]:       <target dev="tap8274829a-aa"/>
Oct 20 09:34:41 user nova-compute[74039]:     </interface>
Oct 20 09:34:41 user nova-compute[74039]:     <serial type="pty">
Oct 20 09:34:41 user nova-compute[74039]:       <log file="/opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/console.log" append="off"/>
Oct 20 09:34:41 user nova-compute[74039]:     </serial>
Oct 20 09:34:41 user nova-compute[74039]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 09:34:41 user nova-compute[74039]:     <video>
Oct 20 09:34:41 user nova-compute[74039]:       <model type="virtio"/>
Oct 20 09:34:41 user nova-compute[74039]:     </video>
Oct 20 09:34:41 user nova-compute[74039]:     <rng model="virtio">
Oct 20 09:34:41 user nova-compute[74039]:       <backend model="random">/dev/urandom</backend>
Oct 20 09:34:41 user nova-compute[74039]:     </rng>
Oct 20 09:34:41 user nova-compute[74039]:     <controller type="usb" index="0" model="none"/>
Oct 20 09:34:41 user nova-compute[74039]:     <memballoon model="virtio">
Oct 20 09:34:41 user nova-compute[74039]:       <stats period="10"/>
Oct 20 09:34:41 user nova-compute[74039]:     </memballoon>
Oct 20 09:34:41 user nova-compute[74039]:   </devices>
Oct 20 09:34:41 user nova-compute[74039]: </domain>
Oct 20 09:34:41 user nova-compute[74039]:  {{(pid=74039) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1879223711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1879223711',id=51,image_ref='521da64d-e312-4568-b543-0fb61e4d10ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1751542138',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:30:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='235f30d0612f4bfba028314ba7155dcf',ramdisk_id='',reservation_id='r-5td7wqrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1190516011',owner_user_name='tempest-AttachVolumeShelveTestJSON-1190516011-project-member',shelved_at='2023-10-20T09:32:46.629213',shelved_host='user',shelved_image_id='521da64d-e312-4568-b543-0fb61e4d10ac'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T09:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd7771575aef439ebf1d55d3c4dcc377',uuid=1fdd0502-f3cf-4353-be1c-72d8abe57f0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converting VIF {"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:3e:c7,bridge_name='br-int',has_traffic_filtering=True,id=8274829a-aad4-4529-817c-3c7f77ab0c87,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8274829a-aa') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG os_vif [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:3e:c7,bridge_name='br-int',has_traffic_filtering=True,id=8274829a-aad4-4529-817c-3c7f77ab0c87,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8274829a-aa') {{(pid=74039) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4cf32e0f-e114-5d95-ae92-d8c4da0dafee', '_type': 'linux-noop'}}, row=False) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8274829a-aa, may_exist=True, interface_attrs={}) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8274829a-aa, col_values=(('qos', UUID('98a2519d-77f7-4479-bd9d-af2f26a40354')),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8274829a-aa, col_values=(('external_ids', {'iface-id': '8274829a-aad4-4529-817c-3c7f77ab0c87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:3e:c7', 'vm-uuid': '1fdd0502-f3cf-4353-be1c-72d8abe57f0a'}),), if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:41 user nova-compute[74039]: INFO os_vif [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:3e:c7,bridge_name='br-int',has_traffic_filtering=True,id=8274829a-aad4-4529-817c-3c7f77ab0c87,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8274829a-aa')
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] No BDM found with device name vda, not building metadata. {{(pid=74039) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 09:34:41 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] No VIF found with MAC fa:16:3e:44:3e:c7, not building metadata {{(pid=74039) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 09:34:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:43 user nova-compute[74039]: DEBUG nova.compute.manager [req-31405669-24ac-4aff-880c-8a0fd2479171 req-20d2a160-2a9f-45c2-9a4b-00a59683abdc service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received event network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:34:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-31405669-24ac-4aff-880c-8a0fd2479171 req-20d2a160-2a9f-45c2-9a4b-00a59683abdc service nova] Acquiring lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:34:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-31405669-24ac-4aff-880c-8a0fd2479171 req-20d2a160-2a9f-45c2-9a4b-00a59683abdc service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:34:43 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-31405669-24ac-4aff-880c-8a0fd2479171 req-20d2a160-2a9f-45c2-9a4b-00a59683abdc service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:34:43 user nova-compute[74039]: DEBUG nova.compute.manager [req-31405669-24ac-4aff-880c-8a0fd2479171 req-20d2a160-2a9f-45c2-9a4b-00a59683abdc service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] No waiting events found dispatching network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:34:43 user nova-compute[74039]: WARNING nova.compute.manager [req-31405669-24ac-4aff-880c-8a0fd2479171 req-20d2a160-2a9f-45c2-9a4b-00a59683abdc service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received unexpected event network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 09:34:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:43 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:43 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:34:44 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:45 user nova-compute[74039]: DEBUG nova.compute.manager [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Instance event wait completed in 0 seconds for  {{(pid=74039) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 09:34:45 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Guest created on hypervisor {{(pid=74039) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 09:34:45 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Instance spawned successfully.
Oct 20 09:34:45 user nova-compute[74039]: DEBUG nova.compute.manager [req-5571f247-9eaa-4133-9e9d-fabbdff0c316 req-5f95f641-5e4c-4b04-ae85-0bdf30c4b43f service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received event network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:34:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5571f247-9eaa-4133-9e9d-fabbdff0c316 req-5f95f641-5e4c-4b04-ae85-0bdf30c4b43f service nova] Acquiring lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:34:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5571f247-9eaa-4133-9e9d-fabbdff0c316 req-5f95f641-5e4c-4b04-ae85-0bdf30c4b43f service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:34:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-5571f247-9eaa-4133-9e9d-fabbdff0c316 req-5f95f641-5e4c-4b04-ae85-0bdf30c4b43f service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:34:45 user nova-compute[74039]: DEBUG nova.compute.manager [req-5571f247-9eaa-4133-9e9d-fabbdff0c316 req-5f95f641-5e4c-4b04-ae85-0bdf30c4b43f service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] No waiting events found dispatching network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:34:45 user nova-compute[74039]: WARNING nova.compute.manager [req-5571f247-9eaa-4133-9e9d-fabbdff0c316 req-5f95f641-5e4c-4b04-ae85-0bdf30c4b43f service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received unexpected event network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 09:34:45 user nova-compute[74039]: DEBUG nova.compute.manager [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Checking state {{(pid=74039) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 09:34:45 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-3f0d023f-6946-42a6-b099-9ffceb0f6db6 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.461s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:34:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:47 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:34:47 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:34:49 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:49 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:34:50 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:34:50 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:34:50 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Cleaning up deleted instances {{(pid=74039) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 09:34:50 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] There are 0 instances to clean {{(pid=74039) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 09:34:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:54 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:34:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:34:54 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Rebuilding the list of instances to heal {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 09:34:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:34:54 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:34:54 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:34:54 user nova-compute[74039]: DEBUG nova.objects.instance [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lazy-loading 'info_cache' on Instance uuid ae2d9955-4612-4761-8e98-3fcd0ab007dd {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:34:55 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Updating instance_info_cache with network_info: [{"id": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "address": "fa:16:3e:08:88:64", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d683a8e-79", "ovs_interfaceid": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:34:55 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:34:55 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:34:55 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:34:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:34:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:34:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:34:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:34:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:34:57 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:34:57 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:34:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:34:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:34:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:34:57 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:34:57 user nova-compute[74039]: DEBUG nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74039) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 09:34:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:34:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:34:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:34:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:34:58 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:34:58 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:34:58 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8849MB free_disk=25.265701293945312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:34:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:34:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:34:59 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance ae2d9955-4612-4761-8e98-3fcd0ab007dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:34:59 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 1fdd0502-f3cf-4353-be1c-72d8abe57f0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:34:59 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:34:59 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:34:59 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:34:59 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:34:59 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:34:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.710s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:34:59 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-60899d55-0d6a-440b-9186-e34bb3f1e7be req-05a88ada-730b-401f-90ab-92e927a5e00e service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Received event network-changed-8d683a8e-79e9-4059-a878-0b6cb1bad52a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:35:00 user nova-compute[74039]: DEBUG nova.compute.manager [req-60899d55-0d6a-440b-9186-e34bb3f1e7be req-05a88ada-730b-401f-90ab-92e927a5e00e service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Refreshing instance network info cache due to event network-changed-8d683a8e-79e9-4059-a878-0b6cb1bad52a. {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 09:35:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-60899d55-0d6a-440b-9186-e34bb3f1e7be req-05a88ada-730b-401f-90ab-92e927a5e00e service nova] Acquiring lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:35:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-60899d55-0d6a-440b-9186-e34bb3f1e7be req-05a88ada-730b-401f-90ab-92e927a5e00e service nova] Acquired lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:35:00 user nova-compute[74039]: DEBUG nova.network.neutron [req-60899d55-0d6a-440b-9186-e34bb3f1e7be req-05a88ada-730b-401f-90ab-92e927a5e00e service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Refreshing network info cache for port 8d683a8e-79e9-4059-a878-0b6cb1bad52a {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 09:35:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:35:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:35:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:35:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:35:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:35:00 user nova-compute[74039]: INFO nova.compute.manager [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Terminating instance
Oct 20 09:35:00 user nova-compute[74039]: DEBUG nova.compute.manager [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:35:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:00 user nova-compute[74039]: DEBUG nova.network.neutron [req-60899d55-0d6a-440b-9186-e34bb3f1e7be req-05a88ada-730b-401f-90ab-92e927a5e00e service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Updated VIF entry in instance network info cache for port 8d683a8e-79e9-4059-a878-0b6cb1bad52a. {{(pid=74039) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 09:35:00 user nova-compute[74039]: DEBUG nova.network.neutron [req-60899d55-0d6a-440b-9186-e34bb3f1e7be req-05a88ada-730b-401f-90ab-92e927a5e00e service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Updating instance_info_cache with network_info: [{"id": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "address": "fa:16:3e:08:88:64", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d683a8e-79", "ovs_interfaceid": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:35:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-60899d55-0d6a-440b-9186-e34bb3f1e7be req-05a88ada-730b-401f-90ab-92e927a5e00e service nova] Releasing lock "refresh_cache-ae2d9955-4612-4761-8e98-3fcd0ab007dd" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:35:01 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Instance destroyed successfully.
Oct 20 09:35:01 user nova-compute[74039]: DEBUG nova.objects.instance [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lazy-loading 'resources' on Instance uuid ae2d9955-4612-4761-8e98-3fcd0ab007dd {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T09:29:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-109260176',display_name='tempest-TestVolumeBootPattern-server-109260176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-109260176',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJQZqpYomopBvyPT79YeuY+pWP4JiFbz530rSSrDfMUmZXfBwTwQSswPKsBo1t1+jn1XQ66AYvtoNfJ5xebswSw6yHcnRHX1AQXk3BmN8XWO1jgu5mgBIib3k6FLvE2iA==',key_name='tempest-TestVolumeBootPattern-1653654445',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:30:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='367334c57f8f47b696a477460afba369',ramdisk_id='',reservation_id='r-57a3mudp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1725287482',owner_user_name='tempest-TestVolumeBootPattern-1725287482-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:30:11Z,user_data=None,user_id='8d68ed2131b34e57a5f10a01409fee62',uuid=ae2d9955-4612-4761-8e98-3fcd0ab007dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "address": "fa:16:3e:08:88:64", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d683a8e-79", "ovs_interfaceid": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converting VIF {"id": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "address": "fa:16:3e:08:88:64", "network": {"id": "cf88be3b-cec8-4cac-a987-c7fea785c6b5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2110505584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "367334c57f8f47b696a477460afba369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d683a8e-79", "ovs_interfaceid": "8d683a8e-79e9-4059-a878-0b6cb1bad52a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:88:64,bridge_name='br-int',has_traffic_filtering=True,id=8d683a8e-79e9-4059-a878-0b6cb1bad52a,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d683a8e-79') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_vif [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:88:64,bridge_name='br-int',has_traffic_filtering=True,id=8d683a8e-79e9-4059-a878-0b6cb1bad52a,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d683a8e-79') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d683a8e-79, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=866d70ac-25c4-4bb2-a76f-ada194a89a4b) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:35:01 user nova-compute[74039]: INFO os_vif [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:88:64,bridge_name='br-int',has_traffic_filtering=True,id=8d683a8e-79e9-4059-a878-0b6cb1bad52a,network=Network(cf88be3b-cec8-4cac-a987-c7fea785c6b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d683a8e-79')
Oct 20 09:35:01 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] calling os-brick to detach iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fae8414b760>, {'target_iqn': 'iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOXrxEPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 09:35:01 user nova-compute[74039]: WARNING os_brick.initiator.connectors.base [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f699a79-1746-4519-82de-f80a1b871ccd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 09:35:01 user nova-compute[74039]: No targets found.
Oct 20 09:35:01 user nova-compute[74039]: iSNS:
Oct 20 09:35:01 user nova-compute[74039]: No targets found.
Oct 20 09:35:01 user nova-compute[74039]: STATIC:
Oct 20 09:35:01 user nova-compute[74039]: Target: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935
Oct 20 09:35:01 user nova-compute[74039]:         Portal: 172.16.0.220:3260,-1
Oct 20 09:35:01 user nova-compute[74039]:                 Iface Name: default
Oct 20 09:35:01 user nova-compute[74039]: FIRMWARE:
Oct 20 09:35:01 user nova-compute[74039]: No targets found.
Oct 20 09:35:01 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 09:35:01 user nova-compute[74039]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 09:35:01 user nova-compute[74039]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74039) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935', 0)] {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[02722804-e980-4a6d-9ca0-4e041154f32b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2070458-550d-4923-b0bc-3290bc3cb7ac]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)
Oct 20 09:35:01 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 (non-flash)
Oct 20 09:35:01 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae7c146cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935'): ({'sdb'}, set())}) {{(pid=74039) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Removing single pathed devices sdb {{(pid=74039) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed0330c-8bb9-4120-9207-31ac77c09eef]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[441c0d18-6cce-4847-8b8e-b758db11638e]: (4, ('ok\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Flushing IO for device /dev/sdb {{(pid=74039) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae3f42d-03f2-4903-be83-c483b523b773]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74039) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdf7e0e-afe9-4846-97b4-b9e80db22873]: (4, ('1', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.initiator.linuxscsi [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] SCSI volumes sdb have been removed. {{(pid=74039) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a78db01e', '/dev/disk/by-id/scsi-1SCST_BIOa78db01e-4c8ec8c54231704f', '/dev/disk/by-id/scsi-23463386563386335') {{(pid=85466) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[492386c9-9cd4-4890-9d0b-4ef2992ec05d]: (4, None) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935')] {{(pid=74039) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb20f9d-0f21-415d-a85d-ca2671228ade]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --logout {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c88a459-fd57-4995-92e7-c091dd3f8a32]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935, portal: 172.16.0.220,3260]
Oct 20 09:35:01 user nova-compute[74039]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935, portal: 172.16.0.220,3260] successful.
Oct 20 09:35:01 user nova-compute[74039]:  stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op delete {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bec70a-6857-4681-abb8-a1a367550935 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85466) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18c1d96-828d-4c71-8ae8-04c4e801aa05]: (4, ('', '')) {{(pid=85466) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74039) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.base [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] <== disconnect_volume: return (286ms) None {{(pid=74039) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG nova.virt.libvirt.volume.iscsi [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Disconnected iSCSI Volume {{(pid=74039) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 09:35:01 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Deleting instance files /opt/stack/data/nova/instances/ae2d9955-4612-4761-8e98-3fcd0ab007dd_del
Oct 20 09:35:01 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Deletion of /opt/stack/data/nova/instances/ae2d9955-4612-4761-8e98-3fcd0ab007dd_del complete
Oct 20 09:35:01 user nova-compute[74039]: INFO nova.compute.manager [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Took 1.11 seconds to destroy the instance on the hypervisor.
Oct 20 09:35:01 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:35:01 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:35:02 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:35:02 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Took 0.49 seconds to deallocate network for instance.
Oct 20 09:35:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-9b219898-80a0-47e7-9b3f-c2c025188384 req-4e582928-29aa-4234-9c9b-23ad9ec55270 service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Received event network-vif-deleted-8d683a8e-79e9-4059-a878-0b6cb1bad52a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:35:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-693d8cfb-f1c0-44e6-8600-c60d8e038919 req-8cec5caa-57d0-4884-a45b-1aef785cecd0 service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Received event network-vif-unplugged-8d683a8e-79e9-4059-a878-0b6cb1bad52a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:35:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-693d8cfb-f1c0-44e6-8600-c60d8e038919 req-8cec5caa-57d0-4884-a45b-1aef785cecd0 service nova] Acquiring lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:35:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-693d8cfb-f1c0-44e6-8600-c60d8e038919 req-8cec5caa-57d0-4884-a45b-1aef785cecd0 service nova] Lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:35:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-693d8cfb-f1c0-44e6-8600-c60d8e038919 req-8cec5caa-57d0-4884-a45b-1aef785cecd0 service nova] Lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:35:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-693d8cfb-f1c0-44e6-8600-c60d8e038919 req-8cec5caa-57d0-4884-a45b-1aef785cecd0 service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] No waiting events found dispatching network-vif-unplugged-8d683a8e-79e9-4059-a878-0b6cb1bad52a {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:35:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-693d8cfb-f1c0-44e6-8600-c60d8e038919 req-8cec5caa-57d0-4884-a45b-1aef785cecd0 service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Received event network-vif-unplugged-8d683a8e-79e9-4059-a878-0b6cb1bad52a for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:35:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-693d8cfb-f1c0-44e6-8600-c60d8e038919 req-8cec5caa-57d0-4884-a45b-1aef785cecd0 service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Received event network-vif-plugged-8d683a8e-79e9-4059-a878-0b6cb1bad52a {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:35:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-693d8cfb-f1c0-44e6-8600-c60d8e038919 req-8cec5caa-57d0-4884-a45b-1aef785cecd0 service nova] Acquiring lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:35:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-693d8cfb-f1c0-44e6-8600-c60d8e038919 req-8cec5caa-57d0-4884-a45b-1aef785cecd0 service nova] Lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:35:02 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-693d8cfb-f1c0-44e6-8600-c60d8e038919 req-8cec5caa-57d0-4884-a45b-1aef785cecd0 service nova] Lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:35:02 user nova-compute[74039]: DEBUG nova.compute.manager [req-693d8cfb-f1c0-44e6-8600-c60d8e038919 req-8cec5caa-57d0-4884-a45b-1aef785cecd0 service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] No waiting events found dispatching network-vif-plugged-8d683a8e-79e9-4059-a878-0b6cb1bad52a {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:35:02 user nova-compute[74039]: WARNING nova.compute.manager [req-693d8cfb-f1c0-44e6-8600-c60d8e038919 req-8cec5caa-57d0-4884-a45b-1aef785cecd0 service nova] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Received unexpected event network-vif-plugged-8d683a8e-79e9-4059-a878-0b6cb1bad52a for instance with vm_state active and task_state deleting.
Oct 20 09:35:03 user nova-compute[74039]: INFO nova.compute.manager [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] [instance: ae2d9955-4612-4761-8e98-3fcd0ab007dd] Took 0.92 seconds to detach 1 volumes for instance.
Oct 20 09:35:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:35:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:35:03 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:35:03 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:35:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:35:03 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Deleted allocations for instance ae2d9955-4612-4761-8e98-3fcd0ab007dd
Oct 20 09:35:03 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-781b0f68-60b6-4319-ae6d-776cc9baa60f tempest-TestVolumeBootPattern-1725287482 tempest-TestVolumeBootPattern-1725287482-project-member] Lock "ae2d9955-4612-4761-8e98-3fcd0ab007dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.839s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:35:04 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:05 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:35:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:08 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:35:09 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:09 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:35:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:14 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:35:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:35:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:35:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:35:31 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:36 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:39 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:35:39 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74039) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 09:35:41 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:35:44 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:35:46 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:48 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:35:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:35:49 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:35:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:51 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:52 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:35:52 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Triggering sync for uuid 1fdd0502-f3cf-4353-be1c-72d8abe57f0a {{(pid=74039) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 09:35:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:35:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:35:52 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:35:52 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:35:55 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:35:56 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:35:56 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:35:56 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:35:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 09:35:56 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquired lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 09:35:56 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Forcefully refreshing network info cache for instance {{(pid=74039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 09:35:57 user nova-compute[74039]: DEBUG nova.network.neutron [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Updating instance_info_cache with network_info: [{"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:35:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Releasing lock "refresh_cache-1fdd0502-f3cf-4353-be1c-72d8abe57f0a" {{(pid=74039) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 09:35:57 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Updated the network info_cache for instance {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 09:35:57 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:35:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:35:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:35:57 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:35:57 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:35:57 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:35:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:35:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk --force-share --output=json {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 09:35:58 user nova-compute[74039]: DEBUG oslo_concurrency.processutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74039) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 09:35:58 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:35:58 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:35:58 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=8923MB free_disk=25.264556884765625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:35:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:35:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:35:58 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Instance 1fdd0502-f3cf-4353-be1c-72d8abe57f0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74039) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 09:35:58 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:35:58 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:35:58 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:35:58 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:35:58 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:35:58 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:36:00 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:36:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:36:04 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:36:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:36:11 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:36:12 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:16 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:21 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:36:25 user nova-compute[74039]: INFO nova.compute.manager [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Terminating instance
Oct 20 09:36:25 user nova-compute[74039]: DEBUG nova.compute.manager [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Start destroying the instance on the hypervisor. {{(pid=74039) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG nova.compute.manager [req-f5058908-10f7-4372-8b17-427995c716dc req-c9d51086-1506-4f98-8ee5-dcaa59ed0956 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received event network-vif-unplugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f5058908-10f7-4372-8b17-427995c716dc req-c9d51086-1506-4f98-8ee5-dcaa59ed0956 service nova] Acquiring lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f5058908-10f7-4372-8b17-427995c716dc req-c9d51086-1506-4f98-8ee5-dcaa59ed0956 service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-f5058908-10f7-4372-8b17-427995c716dc req-c9d51086-1506-4f98-8ee5-dcaa59ed0956 service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG nova.compute.manager [req-f5058908-10f7-4372-8b17-427995c716dc req-c9d51086-1506-4f98-8ee5-dcaa59ed0956 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] No waiting events found dispatching network-vif-unplugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG nova.compute.manager [req-f5058908-10f7-4372-8b17-427995c716dc req-c9d51086-1506-4f98-8ee5-dcaa59ed0956 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received event network-vif-unplugged-8274829a-aad4-4529-817c-3c7f77ab0c87 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:25 user nova-compute[74039]: INFO nova.virt.libvirt.driver [-] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Instance destroyed successfully.
Oct 20 09:36:25 user nova-compute[74039]: DEBUG nova.objects.instance [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lazy-loading 'resources' on Instance uuid 1fdd0502-f3cf-4353-be1c-72d8abe57f0a {{(pid=74039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG nova.virt.libvirt.vif [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T09:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1879223711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1879223711',id=51,image_ref='f58b9629-4790-4951-9492-6447e1485638',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIC6P4bigUg+cbKshQKP1+j2wpIMIpTI+VHhB8KKEetlHyMIQd+jzYXwLCG0+Hu5vAkheTNunlTBHaRXH1aKNpCzLLY86NI0bJzkVCsqrStByvLxANaY472MINupLINA6g==',key_name='tempest-keypair-1751542138',keypairs=<?>,launch_index=0,launched_at=2023-10-20T09:34:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='235f30d0612f4bfba028314ba7155dcf',ramdisk_id='',reservation_id='r-5td7wqrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f58b9629-4790-4951-9492-6447e1485638',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1190516011',owner_user_name='tempest-AttachVolumeShelveTestJSON-1190516011-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T09:34:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd7771575aef439ebf1d55d3c4dcc377',uuid=1fdd0502-f3cf-4353-be1c-72d8abe57f0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converting VIF {"id": "8274829a-aad4-4529-817c-3c7f77ab0c87", "address": "fa:16:3e:44:3e:c7", "network": {"id": "cec109f3-e0c8-43f8-b059-cc8af5e85da7", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1154791141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235f30d0612f4bfba028314ba7155dcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8274829a-aa", "ovs_interfaceid": "8274829a-aad4-4529-817c-3c7f77ab0c87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG nova.network.os_vif_util [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:3e:c7,bridge_name='br-int',has_traffic_filtering=True,id=8274829a-aad4-4529-817c-3c7f77ab0c87,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8274829a-aa') {{(pid=74039) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG os_vif [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:3e:c7,bridge_name='br-int',has_traffic_filtering=True,id=8274829a-aad4-4529-817c-3c7f77ab0c87,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8274829a-aa') {{(pid=74039) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8274829a-aa, bridge=br-int, if_exists=True) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98a2519d-77f7-4479-bd9d-af2f26a40354) {{(pid=74039) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:36:25 user nova-compute[74039]: INFO os_vif [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:3e:c7,bridge_name='br-int',has_traffic_filtering=True,id=8274829a-aad4-4529-817c-3c7f77ab0c87,network=Network(cec109f3-e0c8-43f8-b059-cc8af5e85da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8274829a-aa')
Oct 20 09:36:25 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Deleting instance files /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a_del
Oct 20 09:36:25 user nova-compute[74039]: INFO nova.virt.libvirt.driver [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Deletion of /opt/stack/data/nova/instances/1fdd0502-f3cf-4353-be1c-72d8abe57f0a_del complete
Oct 20 09:36:26 user nova-compute[74039]: INFO nova.compute.manager [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 20 09:36:26 user nova-compute[74039]: DEBUG oslo.service.loopingcall [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74039) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 09:36:26 user nova-compute[74039]: DEBUG nova.compute.manager [-] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Deallocating network for instance {{(pid=74039) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 09:36:26 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] deallocate_for_instance() {{(pid=74039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 09:36:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:26 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG nova.network.neutron [-] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Updating instance_info_cache with network_info: [] {{(pid=74039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 09:36:27 user nova-compute[74039]: INFO nova.compute.manager [-] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Took 1.39 seconds to deallocate network for instance.
Oct 20 09:36:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-b2626e53-e1f6-4e6b-9d3e-06a8c9b336a2 req-62382a86-56b0-4cf5-af8a-b470619fb1d2 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received event network-vif-deleted-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received event network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] Acquiring lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] No waiting events found dispatching network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:36:27 user nova-compute[74039]: WARNING nova.compute.manager [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received unexpected event network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 for instance with vm_state active and task_state deleting.
Oct 20 09:36:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received event network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] Acquiring lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] No waiting events found dispatching network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:36:27 user nova-compute[74039]: WARNING nova.compute.manager [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received unexpected event network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 for instance with vm_state active and task_state deleting.
Oct 20 09:36:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received event network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] Acquiring lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] No waiting events found dispatching network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:36:27 user nova-compute[74039]: WARNING nova.compute.manager [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received unexpected event network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 for instance with vm_state active and task_state deleting.
Oct 20 09:36:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received event network-vif-unplugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] Acquiring lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] No waiting events found dispatching network-vif-unplugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received event network-vif-unplugged-8274829a-aad4-4529-817c-3c7f77ab0c87 for instance with task_state deleting. {{(pid=74039) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received event network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] Acquiring lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG nova.compute.manager [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] No waiting events found dispatching network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 {{(pid=74039) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 09:36:27 user nova-compute[74039]: WARNING nova.compute.manager [req-713e2e7a-4703-474a-ac0b-ff1603ef5a21 req-f56d955d-031b-4638-a193-030a1855f5d8 service nova] [instance: 1fdd0502-f3cf-4353-be1c-72d8abe57f0a] Received unexpected event network-vif-plugged-8274829a-aad4-4529-817c-3c7f77ab0c87 for instance with vm_state active and task_state deleting.
Oct 20 09:36:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:36:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:36:27 user nova-compute[74039]: INFO nova.scheduler.client.report [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Deleted allocations for instance 1fdd0502-f3cf-4353-be1c-72d8abe57f0a
Oct 20 09:36:27 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-f0ced632-9d3b-4b3c-a490-badff124e5b4 tempest-AttachVolumeShelveTestJSON-1190516011 tempest-AttachVolumeShelveTestJSON-1190516011-project-member] Lock "1fdd0502-f3cf-4353-be1c-72d8abe57f0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.549s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:36:29 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:36:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:36:46 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:36:48 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:36:48 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:36:49 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:36:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:36:53 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:36:55 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:36:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:36:57 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:36:57 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:36:57 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Rebuilding the list of instances to heal {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 09:36:57 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Didn't find any instances for network info cache update. {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 09:36:59 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:36:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:36:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:36:59 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:36:59 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:37:00 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:37:00 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:37:00 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=9086MB free_disk=25.291152954101562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:37:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:37:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:37:00 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:37:00 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:37:00 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing inventories for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 09:37:00 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Updating ProviderTree inventory for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 09:37:00 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Updating inventory in ProviderTree for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 09:37:00 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing aggregate associations for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb, aggregates: None {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 09:37:00 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Refreshing trait associations for resource provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE {{(pid=74039) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 09:37:00 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:37:00 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:37:00 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:37:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:37:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:37:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:37:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:37:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:37:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:37:00 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:37:02 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:37:05 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:37:06 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:37:08 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:37:10 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:37:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:37:15 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:37:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:37:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:37:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:37:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:37:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:37:20 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:37:25 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:37:30 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:37:35 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:37:37 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:37:40 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:37:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:37:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:37:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:37:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:37:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:37:45 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:37:48 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:37:49 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:37:49 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74039) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 09:37:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 09:37:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:37:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74039) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 09:37:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:37:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74039) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 09:37:50 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:37:51 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:37:55 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:37:55 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:37:57 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:37:58 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:37:58 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Starting heal instance info cache {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 09:37:58 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Rebuilding the list of instances to heal {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 09:37:58 user nova-compute[74039]: DEBUG nova.compute.manager [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Didn't find any instances for network info cache update. {{(pid=74039) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 09:38:00 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:38:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:38:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:38:00 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:38:00 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Auditing locally available compute resources for user (node: user) {{(pid=74039) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 09:38:01 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:38:01 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:38:01 user nova-compute[74039]: WARNING nova.virt.libvirt.driver [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 09:38:01 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Hypervisor/Node resource view: name=user free_ram=9260MB free_disk=25.27143096923828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74039) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 09:38:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 09:38:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 09:38:01 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 09:38:01 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74039) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 09:38:01 user nova-compute[74039]: DEBUG nova.compute.provider_tree [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed in ProviderTree for provider: 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb {{(pid=74039) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 09:38:01 user nova-compute[74039]: DEBUG nova.scheduler.client.report [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Inventory has not changed for provider 2e813dfe-3db6-40c5-8768-7e4aa3c40bcb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74039) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 09:38:01 user nova-compute[74039]: DEBUG nova.compute.resource_tracker [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Compute_service record updated for user:user {{(pid=74039) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 09:38:01 user nova-compute[74039]: DEBUG oslo_concurrency.lockutils [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.122s {{(pid=74039) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 09:38:03 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 09:38:06 user nova-compute[74039]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74039) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 09:38:07 user nova-compute[74039]: DEBUG oslo_service.periodic_task [None req-8adf3509-3d23-4347-b2ba-b77b67ac698a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74039) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}